data pipeline developer

Tata Consultancy Services (TCS)

<div></div><div><div><div><div><p>Hiring Azure Data engineer with 5+ years of experience for PAN India</p>
<p>
Required Technical Skillset - Azure, Databricks, Data build tool (DBT)</p>
<p>
Job Description</p><br>
<p></p>
<p>
Role Overview:</p>
<p>
We are seeking a Data Engineer with strong expertise in dbt (Data Build Tool) as the primary skill and Databricks as a secondary capability. The role focuses on building scalable data transformation workflows, ensuring data quality, and enabling analytics through modern data stack practices.</p><br>
<p></p>
<p>
Shape</p><br>
<p></p>
<p>
Key Responsibilities</p><br>
<p></p>
<p>
Data Modeling and Transformation:</p>
<p>
Design, build, and maintain robust and scalable data models using dbt and SQL. Create reusable transformations and ensure data is structured for efficient analysis.</p><br>
<p></p>
<p>
Pipeline Development:</p>
<p>
Develop and optimize ELT pipelines, leveraging dbt for transformations and Databricks for compute and orchestration when needed.</p><br>
<p></p>
<p>
Quality Assurance:</p>
<p>
Implement and manage data quality tests within dbt to ensure data integrity, accuracy, and consistency.</p><br>
<p></p>
<p>
Documentation and Governance:</p>
<p>
Maintain comprehensive documentation for dbt models, data lineage, and dependencies.</p><br>
<p></p>
<p>
CI/CD and Version Control:</p>
<p>
Apply software engineering best practices using Git and set up CI/CD pipelines for automated dbt project deployments.</p><br>
<p></p>
<p>
Collaboration:</p>
<p>
Partner with data analysts, data scientists, and business stakeholders to deliver clean, reliable datasets for BI and ML use cases.</p><br>
<p></p>
<p>
Shape</p><br>
<p></p>
<p>
Essential Skills</p><br>
<p></p>
<p>
Technical Skills:</p><br>
<p></p>
<p>
dbt (Primary):</p>
<p>
Hands-on expertise with dbt Core and dbt Cloud, including writing models, tests, macros, and using the CLI.</p><br>
<p></p>
<p>
SQL:</p>
<p>
Expert-level proficiency in writing complex, efficient SQL queries for data transformation.</p><br>
<p></p>
<p>
Databricks (Secondary):</p>
<p>
Experience with Azure Databricks for data processing and orchestration. Familiarity with Spark is a plus.</p><br>
<p></p>
<p>
Azure Data Platform:</p>
<p>
Knowledge of Azure Synapse Analytics, Azure Data Lake Storage, and Azure Data Factory.</p><br>
<p></p>
<p>
Programming:</p>
<p>
Proficiency in Python for scripting and pipeline automation. Familiarity with Jinja for dbt templating.</p><br>
<p></p>
<p>
Data Warehousing:</p>
<p>
Strong understanding of dimensional modeling, star/snowflake schemas, and data warehousing concepts.</p><br>
<p></p>
<p>
Version Control &amp; DevOps:</p>
<p>
Experience with Git and CI/CD tools (Azure DevOps or similar).</p>
</div></div></div><div><div><div><b>Location</b></div>
<div>Bengaluru</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Developer</div>
</div><div><div><b>Job Id</b></div>
<div>378830</div>
</div><div><div><b>Desired Skills</b></div>
<div>Azure</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF ENGINEERING</div></div></div><div></div>

Azure Data Engineer

Amco IT Systems

<p><b>Job Title: Snowflake Developer</b></p><p><b>Location: Saudi Arabia</b></p><p><b>Experience: 3&ndash;5 years</b></p><p><b>Job Summary:</b></p><p>We&rsquo;re looking for a Snowflake Developer to build and optimize data pipelines and warehouse solutions. The ideal candidate should have hands-on experience with Snowflake architecture, strong SQL skills, and expertise in data modeling and workflow automation.</p><p><b>Key Responsibilities:</b></p><ul><li>Design and optimize Snowflake-based data pipelines.</li><li>Implement Snowpipe, Streams, Tasks, and Virtual Warehouses.</li><li>Automate workflows using Airflow or Luigi.</li><li>Integrate Snowflake with GCP and other cloud platforms.</li></ul><p><b>Requirements</b>:</p><ul><li>3&ndash;5 years&rsquo; experience in data engineering.</li><li>Strong SQL and data warehouse skills.</li><li>Proficiency in Snowflake and cloud integrations (preferably GCP).</li></ul><p>Job Type: Contract<br/>Contract length: 6 months</p><p>Ability to commute/relocate:</p><ul><li>Riyadh: Reliably commute or planning to relocate before starting work (Required)</li></ul><p>Application Question(s):</p><ul><li>What is your Nationality?</li><li>What is your notice period in days?</li><li>What is your current monthly salary?</li><li>What is your expected monthly salary in SAR?</li><li>How many years of experience do you have as a Snowflake developer?</li><li>Are you comfortable with 6 months contract (extendable)</li></ul><p>Language:</p><ul><li>Arabic (Required)</li></ul>

Snowflake Developr

State Street

<div><div>Title: Data Integration Developer &ndash; Assistant Manager</div><div>
Department: Alpha Data Platform</div><div>
Reports To: Data Integration Lead, Engineering</div><div></div><div>
Summary:</div><div>
State Street Global Alpha Data Platform , lets you load, enrich and aggregate investment data. Alpha Clients will be able to manage multi-asset class data from any service provider or data vendor for a more holistic and integrated view of their holdings. This platform reflects State Street&rsquo;s years of experience servicing complex instruments for our global client base and our investments in building advanced data management technologies.</div><div>
Reporting to the Alpha Development delivery manager in &lt;&lt;Hyderabad&gt;&gt;, Data Integration Developer is responsible for overall development life cycle leading to successful delivery and support of Alpha Data Platform(ADP) Services to clients.</div><div></div><div>
Responsibilities:</div><ul><li><div>
As a Data Integration Developer, be hands-on ETL/ELT data pipelines (Talend DI), Snowflake DWH, CI/CD deployment Pipelines and data-readiness (data quality) design, development, implementation and address code or data issues.</div></li><li><div>
Experience in designing and implementing modern data pipelines for a variety of data sets which include internal/external data sources, complex relationships, various data formats and high-volume.</div></li><li><div>
Experience and understanding of ETL Job performance techniques, Exception handling,</div></li><li><div>
Query performance tuning/optimizations and data loads meeting the runtime/schedule time SLAs both batch and real-time data uses cases.</div></li><li><div>
Demonstrate strong collaborative experience across regions (APAC, EMEA and NA) to come up with design standards, High level design solutions document, cross training and resource onboarding activities.</div></li><li><div>
Good understanding of SDLC process, Governance clearance, Peer Code reviews, Unit Test Results, Code deployments, Code Security Scanning, Confluence Jira/Kanban stories.</div></li><li><div>
Strong attention to detail during root cause analysis, SQL query debugging and defect issue resolution by working with multiple business/IT stakeholders.</div></li></ul><div></div><div>
Qualifications:</div><div>
Education:</div><ul><li><div>
B.S. degree (or foreign education equivalent) in Computer Science, Engineering, Mathematics, and Physics or other technical course of study required. MS degree strongly preferred.</div></li></ul><div></div><div>
Experience:</div><ul><li><div>
A minimum of 8 - 10 years of experience in data integration/orchestration services, data architecture, design, development and implementations and providing data driven solutions for client requirements</div></li><li><div>
Experience in Snowflake DWH SQL, SQL server database query/performance tuning.</div></li><li><div>
Strong Data warehousing Concepts, ETL tools such as Talend Cloud Data Integration tool.</div></li><li><div>
Exposure to the financial domain knowledge is considered a plus.</div></li><li><div>
Cloud Managed Services such as source control code Github, MS Azure/Devops is considered a plus.</div></li><li><div>
Experience with Qlik Replicate and Compose tools (Change Data Capture) tools is considered a plus</div></li><li><div>
Exposure to Third party data providers such as Factset, Opturo, Bloomberg, Reuters, MSCI and other Rating agencies is a plus.</div></li></ul><div></div><div>
Supervisory Responsibility:</div><ul><li>Individual Contributor Team Lead Manager of Managers</li></ul><div></div><div>
Travel:</div><div>
May be required on a limited basis.</div><div></div><div>
About State Street</div><div></div><div>
Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.</div><div></div><div>
We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you&rsquo;ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.</div><div></div><div>
As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.</div><div></div><div>
Discover more information on jobs at <div>StateStreet.com/careers</div></div><div></div><div>
Read our <div>CEO Statement</div></div></div>

Data Integration Developer, Assistant Manager

Bosch

<div><b>Company Description</b><p><br>
In India, Bosch is a leading supplier of technology and services in the areas of Mobility Solutions, Industrial Technology, Consumer Goods, and Energy and Building Technology. Additionally, Bosch has in India the largest development center outside Germany, for end to end engineering and technology solutions. The Bosch Group operates in India through twelve companies. Bosch set-up its manufacturing operation in 1951, which has grown over the years to include 18 manufacturing sites, and seven development and application centers. Bosch Group in India employs over 31,000 associates and generated consolidated revenue of about &#8360;.21,450 crores* (2.66 billion euros) in 2018 of which &#8360;. 15,824 crores*(1.96 billion euros) from third party. The Group in India has close to 18,000 research and development associates.</p><p>
In India, Bosch Limited is the flagship company of the Bosch Group. It earned revenue of over &#8360;. 12,460 crores (1.54 billion euros) in 2018. Additional information can be accessed at www.bosch.in.</p><p>
We at Bidadi have adopted the IATF 16949. Based on the input from our excellence journey we have designed processes management system. Process management is the unrelenting focus to create and to deliver value to the customer.</p><p>
To become a Global Manufacturing hub and be an indispensable player in the International Production Network, the Leadership at Bidadi Plant focuses on Lean &amp; Flat Organization which will constantly strive for Supply Chain Excellence. At Bidadi, the focus is on Agile organization Model with transparent collaborative approach.</p><b><br>
Job Description</b><p><b><br>
Job purpose / Objective</b></p><p>
The purpose of the role is to design, develop, and maintain the data architecture and infrastructure within an organization to enable efficient and effective data processing, storage, and retrieval.Manage the data pipeline and ensure that data is collected, transformed, and made available for analysis and decision-making.</p><p><b>
Primary Responsibility</b></p><p><b>
1. Area </b>: Data Pipeline Development</p><p><b>
Key activities:</b></p><p>
Design, develop, and maintain data pipelines to extract, transform, and load (ETL) data from various sources into data warehouses or data lakes.</p><p>
Key Result Areas / Indicators<b> :</b> Connectivity percentage</p><p><b>
2. Area :</b> Data Modeling and Quality Assurance</p><p><b>
Key activities:
</b></p><p>Create and optimize data models that define data structures, relationships, and data transformation processes. Implement data quality checks and validation processes to ensure data accuracy and reliability.</p><p>
Key Result Areas / Indicators<b> :</b> Data quality 100%</p><p><b>
3. Area : </b>Data Integration, Scripting and Automation</p><p><b>
Key activities: </b>Integrate data from multiple sources, ensuring consistency, accuracy, and timeliness. Write scripts and use automation tools to streamline data engineering processes.</p><p>
Key Result Areas / Indicators<b> </b>: Data availability 100%</p><p><b>
4. Area </b>: ETL Processes and Database Management</p><p><b>
Key activities:</b></p><p>
Develop and manage ETL processes to automate data movement and transformation tasks. Manage and optimize databases, including backups, indexing, and performance tuning.</p><p>
Key Result Areas / Indicators<b> </b>: Data security</p><p><b>
5. Area : </b>Collaboration</p><p><b>
Key activities:</b></p><ul><li>
Work closely with data scientists, analysts, and business stakeholders to understand their data needs and provide data support.</li></ul><p>
Key Result areas/Indicators:</p><p>
No. of usecases</p><b><br>
Qualifications</b><p><br>
Education</p><ul><li>
Bachelor degree in Computer Science or equivalent</li><li>
Data Science Program (desirable)</li></ul><p>
Experience</p><ul><li>
Min 3 years of Experience in Data management within the area of software development rollout and maintenance.</li><li>
Min 2 Years of specific experience with data pipeline development, monitoring and maintenance.</li></ul><br>
<b>
Additional Information</b><p><br>
Knowledge on Cloud technologies preferred.</p><p>
Basic Knowledge on IIoT, hardware architecture, SDLC etc.</p></div>

IN_RBIN_ Senior Engineer_ BidP1/TEF4

PayPal

<div><p><b>The Company</b></p><p>
PayPal has been revolutionizing commerce globally for more than 25 years. Creating innovative experiences that make moving money, selling, and shopping simple, personalized, and secure, PayPal empowers consumers and businesses in approximately 200 markets to join and thrive in the global economy.</p><p><br>
We operate a global, two-sided network at scale that connects hundreds of millions of merchants and consumers. We help merchants and consumers connect, transact, and complete payments, whether they are online or in person. PayPal is more than a connection to third-party payment networks. We provide proprietary payment solutions accepted by merchants that enable the completion of payments on our platform on behalf of our customers.</p><p><br>
We offer our customers the flexibility to use their accounts to purchase and receive payments for goods and services, as well as the ability to transfer and withdraw funds. We enable consumers to exchange funds more safely with merchants using a variety of funding sources, which may include a bank account, a PayPal or Venmo account balance, PayPal and Venmo branded credit products, a credit card, a debit card, certain cryptocurrencies, or other stored value products such as gift cards, and eligible credit card rewards. Our PayPal, Venmo, and Xoom products also make it safer and simpler for friends and family to transfer funds to each other. We offer merchants an end-to-end payments solution that provides authorization and settlement capabilities, as well as instant access to funds and payouts. We also help merchants connect with their customers, process exchanges and returns, and manage risk. We enable consumers to engage in cross-border shopping and merchants to extend their global reach while reducing the complexity and friction involved in enabling cross-border trade.</p><p><br>
Our beliefs are the foundation for how we conduct business every day. We live each day guided by our core values of Inclusion, Innovation, Collaboration, and Wellness. Together, our values ensure that we work together as one global team with our customers at the center of everything we do &ndash; and they push us to ensure we take care of ourselves, each other, and our communities.</p>
<p>Job Description Summary: This job will design, develop, and maintain data pipelines and architectures to support business needs. You will work with stakeholders to understand data requirements and deliver solutions. Your role involves ensuring data quality, optimizing data processes, and collaborating with cross-functional teams.</p>
<p>Job Description:
</p><p><b>Essential Responsibilities:
</b></p><ul><li>Design and develop data pipelines for efficient data collection and processing.</li><li>
Build and maintain scalable data storage solutions.</li><li>
Ensure data quality and consistency through validation and cleansing processes.</li><li>
Implement data transformation techniques to prepare data for analysis.</li><li>
Collaborate with cross-functional teams to understand data requirements and provide solutions.</li><li>
Optimize data engineering processes for performance and reliability.</li></ul><p></p><p><b>
Expected Qualifications:</b></p><ul><li>
1+ years relevant experience and a Bachelor&rsquo;s degree OR Any equivalent combination of education and experience.</li></ul><p></p>
<p>Additional_Responsibilities_And_Preferred_Qualifications:
</p><h2 class="jobSectionHeader"><b>Position Overview</b></h2><p>
We are seeking a motivated Data Engineer (CL5) to join our dynamic data team. This role is perfect for an experienced professional who thrives in collaborative environments and is passionate about building robust data solutions. You'll work closely with cross-functional teams to design, develop, and maintain scalable data pipelines and infrastructure that drive business insights and decision-making.</p><h2 class="jobSectionHeader"><b>
Key Responsibilities</b></h2><h3 class="jobSectionHeader"><b>
Data Pipeline Development</b></h3><ul><li>
Design, build, and maintain efficient ETL/ELT pipelines to process large volumes of data</li><li>
Develop and optimize data workflows using modern data engineering tools and frameworks</li><li>
Ensure data quality, reliability, and performance across all data processing systems</li><li>
Monitor and troubleshoot data pipeline issues, implementing proactive solutions</li></ul><h3 class="jobSectionHeader"><b>
Data Infrastructure &amp; Modeling</b></h3><ul><li>
Create and maintain data models that support analytics and reporting requirements</li><li>
Work with BigQuery and other cloud data platforms to optimize data storage and retrieval</li><li>
Implement data governance best practices and ensure compliance with data standards</li><li>
Collaborate on data architecture decisions and technical design reviews</li></ul><h3 class="jobSectionHeader"><b>
Collaboration &amp; Continuous Learning</b></h3><ul><li>
Partner with data scientists, analysts, and business stakeholders to understand data requirements</li><li>
Participate in agile development processes and contribute to team planning and retrospectives</li><li>
Share knowledge and mentor junior team members</li><li>
Stay current with emerging data technologies and industry best practices</li></ul><h2 class="jobSectionHeader"><b>
Required Qualifications</b></h2><h3 class="jobSectionHeader"><b>
Technical Skills</b></h3><ul><li>
SQL Expertise: Advanced proficiency in SQL for complex data manipulation, optimization, and analysis</li><li>
BigQuery: Hands-on experience with Google BigQuery, including query optimization and cost management</li><li>
Programming: Proficiency in Python or other scripting languages for data processing and automation</li><li>
ETL Knowledge: Solid understanding of ETL concepts, tools, and best practices</li><li>
Data Modeling: Experience with dimensional modeling, data warehousing concepts, and schema design</li></ul><h3 class="jobSectionHeader"><b>
Professional Skills</b></h3><ul><li><b>
2-4 years of experience with 1+ years of relevant experience in data engineering or related field</b></li><li>
Strong problem-solving abilities and attention to detail</li><li>
Excellent communication skills and ability to explain technical concepts to non-technical stakeholders</li><li>
Experience working in collaborative, cross-functional team environments</li></ul><h2 class="jobSectionHeader"><b>
Preferred Qualifications</b></h2><ul><li>
Experience with cloud platforms (Google Cloud Platform, AWS, or Azure)</li><li>
Knowledge of data orchestration tools (Apache Airflow, Prefect, or similar)</li><li>
Familiarity with streaming data technologies (Apache Kafka, Pub/Sub)</li><li>
Experience with version control systems (Git) and CI/CD practices</li><li>
Understanding of data security and privacy principles</li><li>
Bachelor's degree in Computer Science, Engineering, or related field</li></ul><h2 class="jobSectionHeader"><b>
What We're Looking For</b></h2><h3 class="jobSectionHeader"><b>
Team Spirit &amp; Collaboration</b></h3><ul><li>
Genuine enthusiasm for working as part of a team</li><li>
Willingness to share knowledge and learn from others</li><li>
Positive attitude and constructive approach to problem-solving</li><li>
Ability to give and receive feedback effectively</li></ul><h3 class="jobSectionHeader"><b>
Growth Mindset</b></h3><ul><li>
Eagerness to learn new technologies and methodologies</li><li>
Adaptability to changing business requirements and technical landscapes</li><li>
Initiative to propose improvements and innovative solutions</li><li>
Commitment to personal and professional development</li></ul><h2 class="jobSectionHeader"><b>
What We Offer</b></h2><ul><li>
Opportunity to work with cutting-edge data technologies</li><li>
Collaborative and supportive team environment</li><li>
Professional development and learning opportunities</li><li>
Competitive compensation and benefits package</li><li>
Flexible work arrangements</li></ul><p></p>
<p>PayPal does not charge candidates any fees for courses, applications, resume reviews, interviews, background checks, or onboarding. Any such request is a red flag and likely part of a scam. To learn more about how to identify and avoid recruitment fraud please visit https://careers.pypl.com/contact-us.</p>
<p>For the majority of employees, PayPal's balanced hybrid work model offers 3 days in the office for effective in-person collaboration and 2 days at your choice of either the PayPal office or your home workspace, ensuring that you equally have the benefits and conveniences of both locations.</p><p><b><br>
Our Benefits:</b></p><p>
At PayPal, we&rsquo;re committed to building an equitable and inclusive global economy. And we can&rsquo;t do this without our most important asset-you. That&rsquo;s why we offer benefits to help you thrive in every stage of life. We champion your financial, physical, and mental health by offering valuable benefits and resources to help you care for the whole you.</p><p>
We have great benefits including a flexible work environment, employee shares options, health and life insurance and more. To learn more about our benefits please visit https://www.paypalbenefits.com<br>
</p><br>
<p><b>Who We Are:</b></p><p>
To learn more about our culture and community visit https://about.pypl.com/who-we-are/default.aspx<br>
</p><br>
<p><b>Commitment to Diversity and Inclusion</b></p><p>
PayPal provides equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, pregnancy, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state, or local law. In addition, PayPal will provide reasonable accommodations for qualified individuals with disabilities. If you are unable to submit an application because of incompatible assistive technology or a disability, please contact us at paypalglobaltalentacquisition@paypal.com.</p>
<p><b>Belonging at PayPal:</b></p><p>
Our employees are central to advancing our mission, and we strive to create an environment where everyone can do their best work with a sense of purpose and belonging. Belonging at PayPal means creating a workplace with a sense of acceptance and security where all employees feel included and valued. We are proud to have a diverse workforce reflective of the merchants, consumers, and communities that we serve, and we continue to take tangible actions to cultivate inclusivity and belonging at PayPal.</p><p><br>
Any general requests for consideration of your skills, please Join our Talent Community.</p><p><br>
We know the confidence gap and imposter syndrome can get in the way of meeting spectacular candidates. Please don&rsquo;t hesitate to apply.</p></div>

Data Engineer

<div><p><b>Line of Service
</b></p>Advisory
<p></p><p><b>Industry/Sector
</b></p>Technology
<p></p><p><b>Specialism
</b></p>Advisory - Other
<p></p><p><b>Management Level
</b></p>Associate
<p></p><p><b>Job Description &amp; Summary
</b></p>At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth.
<br>
<br>
In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data transformation solutions.
<p></p><p>Driven by curiosity, you are a reliable, contributing member of a team. In our fast-paced environment, you are expected to adapt to working with a variety of clients and team members, each presenting varying challenges and scope. Every experience is an opportunity to learn and grow. You are expected to take ownership and consistently deliver quality work that drives value for our clients and success as a team. As you navigate through the Firm, you build a brand for yourself, opening doors to more opportunities.
</p><p></p><p>Examples of the skills, knowledge, and experiences you need to lead and deliver value at this level include but are not limited to:
</p><p></p><ul><li>Apply a learning mindset and take ownership for your own development.
</li><li>Appreciate diverse perspectives, needs, and feelings of others.
</li><li>Adopt habits to sustain high performance and develop your potential.
</li><li>Actively listen, ask questions to check understanding, and clearly express ideas.
</li><li>Seek, reflect, act on, and give feedback.
</li><li>Gather information from a range of sources to analyse facts and discern patterns.
</li><li>Commit to understanding how the business works and building commercial awareness.
</li><li>Learn and apply professional and technical standards (e.g. refer to specific PwC tax and audit guidance), uphold the Firm's code of conduct and independence requirements.
</li></ul><p></p><p><b>Education </b><i>(if blank, degree and/or field of study not specified)
</i></p>Degrees/Field of Study required:
<p></p>Degrees/Field of Study preferred:
<p></p><p><b>Certifications </b><i>(if blank, certifications not specified)
</i></p><p></p><p><b>Required Skills
</b></p><p></p><p><b>Optional Skills
</b></p>Accepting Feedback, Accepting Feedback, Active Listening, Agile Scalability, Amazon Web Services (AWS), Apache Airflow, Apache Hadoop, Azure Data Factory, Communication, Data Anonymization, Data Architecture, Database Administration, Database Management System (DBMS), Database Optimization, Database Security Best Practices, Databricks Unified Data Analytics Platform, Data Engineering, Data Engineering Platforms, Data Infrastructure, Data Integration, Data Lake, Data Modeling, Data Pipeline, Data Quality, Data Strategy {+ 22 more}
<p></p><p><b>Desired Languages </b><i>(If blank, desired languages not specified)
</i></p><p></p><p><b>Travel Requirements
</b></p>Not Specified
<p></p><p><b>Available for Work Visa Sponsorship?
</b></p>No
<p></p><p><b>Government Clearance Required?
</b></p>No
<p></p><p><b>Job Posting End Date</b></p></div><p></p>

ETIC, Data Engineer, Associate

<div></div><div><div><div><div><p>a. Design, develop, and deploy end-to-end data engineering solutions on the Databricks platform.</p>
<p>b. Build scalable, reliable, and optimized data pipelines that support large-scale analytics, machine learning, and real-time data processing.</p>
<p>c. Utilize Databricks to integrate, transform, and analyze big data from various sources.</p>
<p>2. Team Leadership and Mentorship:</p>
<p>a. Lead and mentor a team of data engineers and developers in the creation of high-performing data systems.</p>
<p>b. Provide technical direction, guidance, and feedback to junior developers and data engineers.</p>
<p>c. Foster a collaborative environment within the team to encourage learning and knowledge sharing</p>
<p>3. Architecture &amp; Solution Design:</p>
<p>a. Design data architectures that support the business's data needs, ensuring the scalability and flexibility of data systems
</p>
<p>b. Work closely with data scientists, data analysts, and business analysts to understand requirements and create solutions that align with organizational goals
</p><p>c. Develop data models, workflows, and frameworks for seamless data integration
</p><p>4. Cloud Infrastructure Management:</p>
<p>a. Manage the Databricks environment in a cloud platform (AWS, Azure, or GCP), ensuring efficient provisioning, performance optimization, and cost management.
</p><p>b. Work with cloud teams to manage cloud resources, including storage, compute, and networking
</p><p>5. Collaboration with Stakeholders:</p>
<p>a. Collaborate with business leaders, product teams, and other stakeholders to define and prioritize data engineering initiatives
</p><p>b. Translate business requirements into technical solutions, ensuring that data needs are met effectively and efficiently
</p><p>6.</p>
</div></div></div><div><div><div><b>Location</b></div>
<div>Hyderabad</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Developer</div>
</div><div><div><b>Job Id</b></div>
<div>371241</div>
</div><div><div><b>Desired Skills</b></div>
<div>Data Analyst</div>
</div><div><div><b>Additional Information</b></div>
<div>Location Pan India</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF ENGINEERING</div></div></div><div></div>

Databricks lead developer

Search 10000+ Data pipeline developer jobs near you this November. New roles added regularly across leading industries. Apply today.