big data engineer

Nets-international Communication

<p><b>Job Summary</b><br/>We are seeking a highly skilled Big Data Engineer (Cloudera) to lead the design, development, and implementation of scalable data solutions. The ideal candidate will possess extensive experience in big data technologies, cloud platforms, and data modeling to support advanced analytics and data-driven decision-making. This role offers an exciting opportunity to work with cutting-edge tools and methodologies in a dynamic environment focused on innovation and excellence.</p><p><b>Duties</b></p><ul><li>Design, build and maintain robust large&#8208;scale data pipelines using the Cloudera Data Platform (CDP) / Hadoop ecosystem, supporting streaming and batch ingestion of structured and unstructured data.</li><li>Work with big-data frameworks such as Apache Spark, Hive, HDFS, and manage data processing jobs at scale.</li><li>Integrate data from diverse sources (Oracle, Microsoft SQL Server, external APIs, Linked Data) into centralized data lakes or warehouses.</li><li>Collaborate with the cloud team to implement data storage and compute solutions on platforms like AWS, Azure and Cloudera hybrid environments.</li><li>Develop and optimize ETL/ELT processes (using Python, SQL, Shell scripting, Bash) to support analytics, reporting and data science workloads.</li><li>Build data models and schemas appropriate for big data warehouses and analytics&mdash;ensuring performance, scalability, and maintainability.</li><li>Partner with analytics, BI and data science teams to define data requirements, ensure data quality, and make data available in usable form (for dashboards, machine learning, etc.).</li><li>Ensure data governance, security, lineage, and compliance standards are embedded in the data infrastructure.</li><li>Create and maintain documentation of architecture, data flows, processes and best practices.</li><li>Operate within Agile development processes, perform code reviews, and support production operations / incident resolution.</li></ul><p><b>Qualifications</b></p><ul><li>3-5 years of experience in a Data Engineer or Big Data Engineer role, working with big data technologies and platforms.</li><li>Hands-on experience with Cloudera Data Platform or Hadoop ecosystem: HDFS, Hive, Spark, Impala, etc.</li><li>Proficient in Python and/or Java/Scala for data processing, along with strong SQL skills (Oracle, MS SQL Server or similar).</li><li>Experience developing ETL/ELT workflows using Python, Shell/Bash scripting and SQL.</li><li>Familiarity with cloud data platforms (AWS S3/Glue/EMR, Azure Data Lake or equivalents) and managing data infrastructure in the cloud.</li><li>Understanding of data modelling for large-scale data warehouses, data lakes and analytics platforms.</li><li>Knowledge of RESTful API integration and processing data from APIs or real-time streams is a plus.</li><li>Experience collaborating with data science/analytics teams to support modelling, BI and advanced analytics efforts.</li><li>Excellent problem-solving skills, strong communication skills, and ability to work in a dynamic, multi-functional team environment.</li><li>Exposure to Agile methodologies and CI/CD pipelines for data engineering tasks is a plus.</li></ul><p>Job Type: Full-time</p><p>Ability to commute/relocate:</p><ul><li>Muscat: Reliably commute or planning to relocate before starting work (Required)</li></ul><p>Application Question(s):</p><ul><li>What is your monthly current salary?</li><li>What is your monthly expected salary?</li><li>What is your notice period?</li></ul><p>Education:</p><ul><li>Bachelor's (Required)</li></ul><p>Experience:</p><ul><li>Big Data Engineer: 3 years (Required)</li></ul>

Big Data Engineer

<p><b>Job Summary</b><br/>We are seeking a highly skilled Big Data Engineer (Cloudera) to lead the design, development, and implementation of scalable data solutions. The ideal candidate will possess extensive experience in big data technologies, cloud platforms, and data modeling to support advanced analytics and data-driven decision-making. This role offers an exciting opportunity to work with cutting-edge tools and methodologies in a dynamic environment focused on innovation and excellence.</p><p><b>Duties</b></p><ul><li>Design, build and maintain robust large&#8208;scale data pipelines using the Cloudera Data Platform (CDP) / Hadoop ecosystem, supporting streaming and batch ingestion of structured and unstructured data.</li><li>Work with big-data frameworks such as Apache Spark, Hive, HDFS, and manage data processing jobs at scale.</li><li>Integrate data from diverse sources (Oracle, Microsoft SQL Server, external APIs, Linked Data) into centralized data lakes or warehouses.</li><li>Collaborate with the cloud team to implement data storage and compute solutions on platforms like AWS, Azure and Cloudera hybrid environments.</li><li>Develop and optimize ETL/ELT processes (using Python, SQL, Shell scripting, Bash) to support analytics, reporting and data science workloads.</li><li>Build data models and schemas appropriate for big data warehouses and analytics&mdash;ensuring performance, scalability, and maintainability.</li><li>Partner with analytics, BI and data science teams to define data requirements, ensure data quality, and make data available in usable form (for dashboards, machine learning, etc.).</li><li>Ensure data governance, security, lineage, and compliance standards are embedded in the data infrastructure.</li><li>Create and maintain documentation of architecture, data flows, processes and best practices.</li><li>Operate within Agile development processes, perform code reviews, and support production operations / incident resolution.</li></ul><p><b>Qualifications</b></p><ul><li>3-5 years of experience in a Data Engineer or Big Data Engineer role, working with big data technologies and platforms.</li><li>Hands-on experience with Cloudera Data Platform or Hadoop ecosystem: HDFS, Hive, Spark, Impala, etc.</li><li>Proficient in Python and/or Java/Scala for data processing, along with strong SQL skills (Oracle, MS SQL Server or similar).</li><li>Experience developing ETL/ELT workflows using Python, Shell/Bash scripting and SQL.</li><li>Familiarity with cloud data platforms (AWS S3/Glue/EMR, Azure Data Lake or equivalents) and managing data infrastructure in the cloud.</li><li>Understanding of data modelling for large-scale data warehouses, data lakes and analytics platforms.</li><li>Knowledge of RESTful API integration and processing data from APIs or real-time streams is a plus.</li><li>Experience collaborating with data science/analytics teams to support modelling, BI and advanced analytics efforts.</li><li>Excellent problem-solving skills, strong communication skills, and ability to work in a dynamic, multi-functional team environment.</li><li>Exposure to Agile methodologies and CI/CD pipelines for data engineering tasks is a plus.</li></ul><p>Job Type: Full-time</p><p>Ability to commute/relocate:</p><ul><li>&#305;stanbul: Reliably commute or planning to relocate before starting work (Required)</li></ul><p>Application Question(s):</p><ul><li>What is your monthly current salary?</li><li>What is your monthly expected salary?</li><li>What is your notice period?</li></ul><p>Education:</p><ul><li>Bachelor's (Required)</li></ul><p>Experience:</p><ul><li>Big Data Engineer: 3 years (Required)</li></ul>

Metis International (Pvt) Ltd

<p><b>Responsibilities:</b></p><p>&middot; Develop, test, and maintain data processing pipelines and workflows, ensuring optimal performance and reliability.</p><p>&middot; Collaborate with data scientists and analysts to understand data requirements and design appropriate data models and schemas.</p><p>&middot; Optimize and tune existing data pipelines, storage systems, and analytical frameworks to improve efficiency and reduce processing time.</p><p>&middot; Monitor and troubleshoot data processing jobs, performance bottlenecks, and data quality issues.</p><p>&middot; Stay up-to-date with the latest advancements in big data technologies and recommend innovative solutions to improve our data infrastructure.</p><p>&middot; Collaborate with cross-functional teams to gather requirements and define technical specifications for data-related projects.</p><p>&middot; Document design decisions, technical specifications, and standard operating procedures for the big data infrastructure.</p><p>&middot; Mentor junior engineers and provide guidance on best practices for big data engineering and development.</p><p><b>Requirements:</b></p><p>&middot; Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.</p><p>&middot; Proven experience as a Big Data Engineer or similar role with expertise in Azure and Hadoop technologies.</p><p>&middot; Strong knowledge of the Azure cloud platform, including Azure Data Lake Storage, Azure Data Factory, Azure Databricks, and Azure HDInsight.</p><p>&middot; Proficiency in Hadoop ecosystem technologies such as HDFS, MapReduce, Hive, Pig, Spark, and HBase.</p><p>&middot; Experience with big data processing frameworks like Apache Kafka and Apache Storm is a plus.</p><p>&middot; Solid understanding of data modeling, data warehousing, and ETL processes.</p><p>&middot; Strong programming skills in languages such as Java, Scala, or Python.</p><p>&middot; Familiarity with SQL and NoSQL databases.</p><p>&middot; Knowledge of data governance, data privacy, and data security best practices.</p><p>&middot; Excellent problem-solving and analytical skills with a strong attention to detail.</p><p>&middot; Ability to work effectively in a fast-paced, collaborative environment and manage multiple priorities.</p><p>&middot; Strong communication and interpersonal skills, with the ability to effectively communicate technical concepts to both technical and non-technical stakeholders.</p><p>Job Type: Full-time</p><p>Work Location: In person</p>

Vodafone

<div><div><div><div><h2 class="jobSectionHeader"><b>Who we are</b></h2>
</div><div><p>
VOIS (Vodafone Intelligent Solutions) is a strategic arm of Vodafone Group Plc, creating value for customers by delivering intelligent solutions through Talent, Technology &amp; Transformation.<br>
As the largest shared services organisation in the global telco industry with 30,000 FTE, our portfolio of next-generation solutions and services are designed in partnership with customers across Vodafone Group, local markets, and partner markets to simplify and drive growth. With our strategic partner Accenture, we work alongside our Vodafone customers, other Telco and tech companies to drive transformation, meet the challenges of our industry and ensure we stay relevant and resilient. This partnership is a unique, industry-first model which brings together the best of in-house and 3rd party capability.<br>
We work with customers across 28 countries from 10 VOIS locations: Albania, Egypt, Hungary, India, Romania, Spain, Turkey, UK, Germany, Ireland, and with a network of teams in Czech Republic, Italy, Greece, and Portugal.<br>
#VOIS #BeUnrivalled #CreateTheFuture</p></div></div><div><div><h2 class="jobSectionHeader"><b>
About this Role</b></h2>
</div><div><p>
We are seeking a skilled Big Data Engineer to join our Data and Analytics (DNA) team on a 6-month contract basis. Based in Pune, Bangalore, or Ahmedabad, this role is pivotal in designing and maintaining scalable big data solutions that support efficient data processing and analytics. The ideal candidate will collaborate with cross-functional teams to build robust data pipelines and leverage big data technologies to drive data-driven decision-making across the organisation.</p></div></div><div><div><h2 class="jobSectionHeader"><b>
What you&rsquo;ll do</b></h2>
</div><div><ul><li>Design, develop, and maintain scalable data pipelines for processing structured and unstructured data.</li><li>
Build and optimise data storage solutions including distributed file systems, NoSQL databases, and data warehouses.</li><li>
Utilise big data frameworks such as Apache Hadoop, Spark, Flink, and Kafka to develop data processing workflows.</li><li>
Ensure high performance and scalability through parallel processing, distributed computing, and caching strategies.</li><li>
Implement monitoring, alerting, and automated scaling mechanisms for big data systems.</li><li>
Maintain data quality and governance by applying validation, cleansing, and enrichment processes.</li><li>
Collaborate with data scientists, analysts, and engineers to align data solutions with business objectives.</li><li>
Document system architecture and processes, and provide training and support to stakeholders.</li></ul></div></div><div><div><h2 class="jobSectionHeader"><b>
Who you are</b></h2>
</div><div><ul><li>Graduate or Postgraduate in Computer Science, Engineering, or a related technical field.</li><li>
Over 5 years of experience in building cloud-based data engineering solutions.</li><li>
Proficient in SQL and programming languages such as Python, Java, or Scala.</li><li>
Hands-on experience with big data technologies including Apache Hadoop, Spark, Flink, and Kafka.</li><li>
Familiar with cloud platforms such as AWS, GCP, or Azure.</li><li>
Experienced in streaming tools like Amazon Kinesis, Apache Kafka, Flink, or Pulsar.</li><li>
Strong understanding of distributed systems and database management principles.</li><li>
Excellent communication and collaboration skills with a proactive approach to problem-solving.</li><li>
Ability to work independently and manage multiple priorities in a fast-paced environment.</li><li>
Familiarity with ITIL practices and experience in large global organisations is desirable.</li><li>
</li></ul></div></div><div><div><h2 class="jobSectionHeader"><b>
Not a perfect fit?</b></h2>
</div><div><p>
Concerned you may not meet every requirement? Vodafone is committed to creating an inclusive workplace where everyone can thrive. If you are excited about this role but your experience does not align exactly with every aspect of the job description, you are encouraged to apply. You may be the right candidate for this or another opportunity, and the recruitment team will support you in exploring where your skills fit best.</p></div></div><div><div><h2 class="jobSectionHeader"><b>
What's in it for you</b></h2>
</div><div><ul><li>Opportunity to work on cutting-edge big data technologies and cloud platforms.</li><li>
Exposure to large-scale data engineering projects within a global telecom environment.</li><li>
Collaborative work culture with cross-functional teams.</li><li>
Flexible work location options including Pune, Bangalore, and Ahmedabad.</li><li>
Be part of a dynamic team driving innovation and digital transformation.</li></ul></div></div><div><div><h2 class="jobSectionHeader"><b>
What skills you will learn</b></h2>
</div><div><ul><li>Advanced big data processing using Apache Hadoop, Spark, Flink, and Kafka.</li><li>
Cloud-based data engineering practices across AWS, GCP, or Azure.</li><li>
Real-time data streaming and processing with tools like Kinesis and Pulsar.</li><li>
Best practices in data governance, quality assurance, and system monitoring.</li><li>
Cross-functional collaboration and agile delivery in a global enterprise environment.</li></ul></div></div><div><div><h2 class="jobSectionHeader"><b>
VOIS Equal Opportunity Employer Commitment</b></h2>
</div><div><p>
Vodafone recognises and celebrates the value of diversity in building a workforce that reflects the customers and communities it serves. No form of discrimination is tolerated. This includes, but is not limited to, discrimination based on race, colour, age, veteran status, gender identity, gender expression, sexual orientation, pregnancy, maternity or parental status, ethnicity, disability, religion or belief, political affiliation, trade union membership, nationality, citizenship, indigenous status, medical condition, HIV status, neurodiversity, social origin, cultural background, marital or civil partnership status, or socio-economic background.</p></div></div><div><div><h2 class="jobSectionHeader"><b>
Join Us</b></h2>
</div><div><p>
At Vodafone, we&rsquo;re working hard to build a better future. A more connected, inclusive and sustainable world. As a dynamic global community, it's our human spirit, together with technology, that empowers us to achieve this.<br>
We challenge and innovate in order to connect people, businesses, and communities across the world. Delighting our customers and earning their loyalty drive us, and we experiment, learn fast and get it done, together.<br>
With us, you can be truly be yourself and belong, share inspiration, embrace new opportunities, thrive, and make a real difference.</p></div></div><div><div><h2 class="jobSectionHeader"><b>
Alert</b></h2>
</div><div><p>
Apply for Vodafone jobs only through the official Vodafone Careers website to avoid job scams and fraud.<br>
#JDEnhancedByTARA</p></div></div><div><div><h2 class="jobSectionHeader"><b>
Follow us on social media and #StayConnected</b></h2>
</div><div><ul><li>LinkedIn</li><li>
Facebook</li><li>
Instagram</li><li>
You can also chat with our employees to learn more about our projects: Click here</li></ul></div></div></div></div>

Rackspace Technology

<div><div><div><b>About the Role</b></div><div></div><div><br>
We are seeking a Senior Big Data Engineer with deep expertise in distributed systems, batch data processing, and large-scale data pipelines. The ideal candidate has strong hands-on experience with Oozie, Pig, the Apache Hadoop ecosystem, and programming proficiency in Java (preferred) or Python. This role requires a deep understanding of data structures and algorithms, along with a proven track record of writing production-grade code and building robust data workflows.</div><div></div><div><br>
This is a fully remote position and requires an independent, self-driven engineer who thrives in complex technical environments and communicates effectively across teams.</div><div></div><div><b><br>
Work Location:</b> US-Remote, Canada-Remote</div></div>
<div><div><h3 class="jobSectionHeader"><b>Key Responsibilities:
</b></h3><ul><li><ul><li>Design and develop scalable batch processing systems using technologies like Hadoop, Oozie, Pig, Hive, MapReduce, and HBase, with hands-on coding in Java or Python (Java is a must).</li><li>
Must be able to lead Jira Epics</li><li>
Write clean, efficient, and production-ready code with a strong focus on data structures and algorithmic problem-solving applied to real-world data engineering tasks.</li><li>
Develop, manage, and optimize complex data workflows within the Apache Hadoop ecosystem, with a strong focus on Oozie orchestration and job scheduling.</li><li>
Leverage Google Cloud Platform (GCP) tools such as Dataproc, GCS, and Composer to build scalable and cloud-native big data solutions.</li><li>
Implement DevOps and automation best practices, including CI/CD pipelines, infrastructure as code (IaC), and performance tuning across distributed systems.</li><li>
Collaborate with cross-functional teams to ensure data pipeline reliability, code quality, and operational excellence in a remote-first environment.</li></ul></li></ul></div></div>
<div><div><h3 class="jobSectionHeader"><b>Qualifications:
</b></h3><ul><li><ul><li>Bachelors's degree in Computer Science, software engineering or related field of study.</li><li>
Experience with managed cloud services and understanding of cloud-based batch processing systems are critical.</li><li>
Must be able to lead Jira Epics is MUST
</li><li>Proficiency in Oozie, Airflow, Map Reduce, Java are MUST haves.</li><li>
Strong programming skills with Java (specifically Spark), Python, Pig, and SQL.</li><li>
Expertise in public cloud services, particularly in GCP.</li><li>
Proficiency in the Apache Hadoop ecosystem with Oozie, Pig, Hive, Map Reduce.</li><li>
Familiarity with BigTable and Redis.</li><li>
Experienced in Infrastructure and Applied DevOps principles in daily work. Utilize tools for continuous integration and continuous deployment (CI/CD), and Infrastructure as Code (IaC) like Terraform to automate and improve development and release processes.</li><li>
Proven experience in engineering batch processing systems at scale.</li></ul></li></ul></div></div><br>
<div></div>
<div><div><h3 class="jobSectionHeader"><b>
Must Have: (Important)</b></h3><ul><li><ul><li>
5+ years of experience in customer-facing software/technology or consulting.</li><li>
5+ years of experience with &ldquo;on-premises to cloud&rdquo; migrations or IT transformations.</li><li>
5+ years of experience building, and operating solutions built on GCP
</li><li>Proficiency in Oozie andPig</li><li>
Must be able to lead Jira Epics</li><li>
Proficiency in Java or Python</li></ul></li></ul></div></div>
<div><div>The following information is required by pay transparency legislation in the following states: CA, CO, HI, NY, and WA. This information applies only to individuals working in these states.
</div><div>
</div><ul><li>The anticipated starting pay range for Colorado is: $116,100 - $170,280.
</li><li>The anticipated starting pay range for the states of Hawaii and New York (not including NYC) is: $123,600 - $181,280.
</li><li>The anticipated starting pay range for California, New York City and Washington is: $135,300 - $198,440.</li></ul><div></div><div><br>
Unless already included in the posted pay range and based on eligibility, the role may include variable compensation in the form of bonus, commissions, or other discretionary payments. These discretionary payments are based on company and/or individual performance and may change at any time. Actual compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location. Information on benefits offered is here.</div><div></div><div><b><br>
About Rackspace Technology</b></div><div>
We are the multicloud solutions experts. We combine our expertise with the world&rsquo;s leading technologies &mdash; across applications, data and security &mdash; to deliver end-to-end solutions. We have a proven record of advising customers based on their business challenges, designing solutions that scale, building and managing those solutions, and optimizing returns into the future. Named a best place to work, year after year according to Fortune, Forbes and Glassdoor, we attract and develop world-class talent. Join us on our mission to embrace technology, empower customers and deliver the future.</div><div></div><div><br>
</div><div><b>
More on Rackspace Technology</b></div><div>
Though we&rsquo;re all different, Rackers thrive through our connection to a central goal: to be a valued member of a winning team on an inspiring mission. We bring our whole selves to work every day. And we embrace the notion that unique perspectives fuel innovation and enable us to best serve our customers and communities around the globe. We welcome you to apply today and want you to know that we are committed to offering equal employment opportunity without regard to age, color, disability, gender reassignment or identity or expression, genetic information, marital or civil partner status, pregnancy or maternity status, military or veteran status, nationality, ethnic or national origin, race, religion or belief, sexual orientation, or any legally protected characteristic. If you have a disability or special need that requires accommodation, please let us know.</div><div></div><div><br>
</div><div>
#LI-VM1</div></div>
<div><div>We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.</div></div></div>

Sr Big Data Engineer - Oozie and Pig (GCP)

EPAM Systems

<div><p>We are looking for a skilled <b>Big Data DevOps Engineer </b>with profound knowledge of cloud technologies and experience with a variety of data tools and platforms.</p><p>
The ideal candidate will have proven experience in managing and optimizing big data operations across cloud environments.</p><p><b>
Responsibilities</b></p><ul><li>
Cloud Solutions Development: Build, deploy, and maintain scalable and secure big data solutions across major cloud platforms (AWS, Azure, Google Cloud) to support advanced data processing and analytics</li><li>
Data Tools Management: Configure and manage data processing tools such as Apache Spark, Kafka, Airflow, and Databricks to efficiently handle large-scale data workflows</li><li>
Automation and CI/CD: Utilize Terraform for infrastructure as code, automate workflows with Jenkins, and maintain code with GitLab for continuous integration and continuous delivery processes</li><li>
Performance Optimization: Monitor and optimize the performance of big data tools and cloud platforms, ensuring cost-effectiveness and operational efficiency</li><li>
Security and Compliance: Implement and enforce data security measures, ensuring compliance with data protection regulations and best practices in cloud environments</li><li>
Collaborative Development: Work collaboratively with data scientists, data engineers, and other stakeholders to understand requirements and deliver high-quality data solutions</li></ul><p><b>
Requirements</b></p><ul><li>
Strong experience with big data technologies, particularly Apache Spark or Databricks</li><li>
Extensive background in cloud services administration with platforms like AWS, Azure, or Google Cloud</li><li>
In-depth knowledge of infrastructure as code using Terraform</li><li>
Proficiency in implementing CI/CD pipelines with tools such as Jenkins, GitLab or GitHub Actions</li><li>
Solid scripting skills in Python, Scala, or similar languages</li><li>
Experience with SQL and relational/non-relational databases</li><li>
Excellent problem-solving abilities and a team-oriented attitude</li></ul><p><b>
Nice to have</b></p><ul><li>
Certifications in cloud technology (e.g., AWS Certified Solutions Architect, Google Cloud Certified Professional Cloud Architect)</li><li>
Additional experience with real-time data processing tools like Apache Kafka</li></ul><p><b>
We offer</b></p><ul><li>
CONTINUOUS UPSKILLING, LEARNING &amp; DEVELOPMENT<ul><li>
Diversity of tasks and projects</li><li>
Assessment center for objective review of competency level</li><li>
Personal development plan</li><li>
Mentoring programs and leadership development</li><li>
Certification and professional development support</li><li>
Access to learning platforms including more than 2,500 internal courses and the LinkedIn Learning library with 20,000+ courses</li><li>
English courses taught by certified teachers</li></ul></li><li>
CORPORATE BENEFITS<ul><li>
Extra leave days</li><li>
Referral bonuses</li></ul></li><li>
COMPENSATION PACKAGE<ul><li>
Competitive compensation paid in USD</li><li>
Regular salary and performance reviews</li></ul></li><li>
MEDICAL &amp; HEALTHCARE<ul><li>
Private health insurance</li><li>
Well-being events</li></ul></li><li>
WORKING ENVIRONMENT<ul><li>
Recreation areas and kitchens</li><li>
Tea, coffee, and snacks</li><li>
Well-being events</li><li>
Sports equipment and game consoles</li><li>
IT Equipment</li><li>
Microsoft's Software Assurance Home Use Program (HUP)</li></ul></li></ul><p><i>
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.</i></p></div>

Middle Big Data DevOps Engineer

Tata Consultancy Services (TCS)

<div></div><div><div><div><div><div><div>TCS Inviting applicants for
</div><div>Role: Azure Data Engineer
</div><div>Experience: 5 to 10 years
</div><div>Location: Chennai
</div><div>Job Description:
</div><div>1. Expertise in PySpark, Python</div><br>
<div><br>
</div><div>2. Knowledge and Skill in Databricks</div><br>
<div><br>
</div><div>3. Strong proficiency in Azure services: Data Factory, Synapse, Data Lake, Databricks.</div><br>
<div><br>
</div><div>4. Hands-on experience with ETL tools and data pipeline orchestration.</div><br>
<div><br>
</div><div>5. Proficiency in Python or Scala for data processing.</div><br>
<div><br>
</div><div>6. Knowledge of SQL and NoSQL databases.</div><br>
<div><br>
</div><div>7. Familiarity with data modeling and data warehousing concepts.</div><br>
<div><br>
</div><div>8. Understanding of security best practices for data in AWS.</div><br>
<div><br>
</div><div>9. Good hands on experience on Python, Numpy , pandas.</div><br>
<div><br>
</div><div>10. Experience in building ETL/ Data Warehouse transformation process.</div><br>
<div><br>
</div><div>11. Experience working with structured and unstructured data.</div><br>
<div><br>
</div><div>12. Developing Big Data and non-Big Data cloud-based enterprise solutions in PySpark and SparkSQL and related frameworks/libraries,</div><br>
<div><br>
</div><div>13. Developing scalable and re-usable, self-service frameworks for data ingestion and processing,</div><br>
<div><br>
</div><div>14. Integrating end to end data pipelines to take data from data source to target data repositories ensuring the quality and consistency of data,</div><br>
<div><br>
</div><div>Knowledge of big data frameworks (Spark, Hadoop).
</div></div></div></div></div><div><div><div><b>Location</b></div>
<div>Chennai</div>
</div><div><div><b>Job Function</b></div>
<div>IT INFRASTRUCTURE SERVICES</div>
</div><div><div><b>Role</b></div>
<div>Engineer</div>
</div><div><div><b>Job Id</b></div>
<div>381897</div>
</div><div><div><b>Desired Skills</b></div>
<div>Azure Data Factory | Azure</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF ENGINEERING</div></div></div><div></div>

Data Engineer

Search 10000+ Big data engineer jobs near you this November. New roles added regularly across leading industries. Apply today.

10000 big data engineer jobs NEAR_ME

Big Data Engineer

Big Data Engineer

Big Data Engineer

Big Data Engineer

Sr Big Data Engineer - Oozie and Pig (GCP)

Middle Big Data DevOps Engineer

Data Engineer