big data engineer

RiskInsight Consulting Pvt Ltd

<div><h3 class="jobSectionHeader">Responsibilities</h3><ul>
<li>Design, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases.</li>
<li>Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis.</li>
<li>Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions.</li>
<li>Ensure data quality and integrity through effective validation, monitoring, and troubleshooting techniques.</li>
<li>Optimize data processing workflows for maximum performance and efficiency.</li>
<li>Stay up-to-date with evolving Big Data technologies and methodologies to enhance existing systems.</li>
<li>Implement best practices for data governance, security, and compliance.</li>
<li>Document technical designs, processes, and procedures to support knowledge sharing across teams.</li>
</ul>Requirements<ul>
<li>Bachelor's or Master's degree in Computer Science, Engineering, or a related field.</li>
<li>4+ years of experience as a Big Data Engineer or in a similar role.</li>
<li>Strong proficiency in Big Data technologies (Hadoop, Spark, Hive, Pig) and frameworks.</li>
<li>Extensive experience with programming languages such as Python, Scala, or Java.</li>
<li>Knowledge of data modeling and data warehousing concepts.</li>
<li>Familiarity with NoSQL databases like Cassandra or MongoDB.</li>
<li>Proficient in SQL for data querying and analysis.</li>
<li>Strong analytical and problem-solving skills.</li>
<li>Excellent communication and collaboration abilities.</li>
<li>Ability to work independently and effectively in a fast-paced environment.</li>
</ul>Benefits
Competitive salary and benefits package.
Opportunity to work on cutting-edge technologies and solve complex challenges.
Dynamic and collaborative work environment with opportunities for growth and career advancement.
Regular training and professional development opportunities.</div>

Big Data Engineer

Apple

<div>Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other&rsquo;s ideas stronger. That happens because every one of us shares a belief that we can make something wonderful and share it with the world, changing lives for the better. It&rsquo;s the diversity of our people and their thinking that inspires the innovation that runs through everything we do. When we bring everybody in, we can do the best work of our lives. Here, you&rsquo;ll do more than join something - you&rsquo;ll add something. As a BigData Software Engineer, you are an integral part of a small data-centric team driving large-scale data infrastructure and processes development, implementation, and improvement. Our organization thrives on collaborative partnerships. Join and play a key role in developing and driving the adoption of Data Mesh and data-centric micro-services. Apple's Manufacturing Systems and Infrastructure (MSI) team is responsible for capturing, consolidating and tracking all manufacturing data for Apple&rsquo;s products and modules worldwide. Our tools enable teams to confidently use data to shape the next generation of product manufacturing at Apple. We seek a practitioner with experience building large-scale data platforms, analytic tools, and solutions. If you are passionate about making data easily accessible, trusted, and available across the entire business at scale, we'd love to hear from you.
 
 
Description 
 
As a BigData Engineer, you will lead the development and implementation of our cloud-based data infrastructure. You will work closely with cross-functional teams to understand data requirements, design scalable solutions, and ensure the integrity and availability of our data. The ideal candidate will have a deep understanding of cloud technologies, data engineering best practices, and a proven track record of successfully delivering complex data projects. - Lead the design and implementation of cloud-based data architectures. - Collaborate with data scientists, analysts, and business stakeholders to understand data requirements. - Implement data security and privacy best practices. - Optimize data storage, retrieval, and processing for performance and cost efficiency. - Lead efforts to ensure data quality, consistency, and accuracy. - Mentor and provide technical guidance to junior data engineers. - Stay current with industry trends and emerging technologies in cloud data engineering.
 
 
Minimum Qualifications 
<ul><li>
Bachelor&rsquo;s or Master's degree in Computer Science or a related field
</li><li>Proven experience as a Big Data developer, with a focus on cloud platforms
</li><li>Strong proficiency in cloud services such as AWS, Azure, or Google Cloud
</li><li>Expertise in data modelling and data integration
</li><li>Experience with big data technologies (Hadoop, Spark, etc.)
</li><li>Proficient in programming languages such as Python, Java, Scala, GoLang
</li><li>Knowledge of data warehouse solutions (Redshift, BigQuery, Snowflake, Druid)
</li><li>Experience with streaming data technologies (Kafka, Kinesis)
</li></ul> 
Preferred Qualifications 
<ul><li>
Certification in cloud platforms (AWS Certified Big Data - Specialty, Microsoft Certified: Azure Data Engineer, etc.)
</li><li>Experience building data streaming solutions using Apache Spark, Storm, Link, Flume
</li><li>Experience using ETL tools and technologies like Reltio, Stibo, Informatics, Apache Atlas
</li><li>Knowledge of machine learning and data science concepts
</li><li>Contributions to the open source community
</li><li>Familiarity with data governance and compliance
</li><li>Strong problem-solving and analytical skills
</li>Excellent communication and leadership skills 
<li>
</li></ul> 
 
Submit CV</div>

Big Data Software Engineer - Manufacturing Systems & Infrastructure

Citi

<div>At Citi we&rsquo;re not just building technology, we&rsquo;re building the future of banking. Encompassing a broad range of specialties, roles, and cultures, our teams are creating innovations used across the globe. Citi is constantly growing and progressing through our technology, with laser focused on evolving the ways of doing things. As one of the world&rsquo;s most global banks we&rsquo;re changing how the world does business.<div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div>
Shape your Career with Citi
We&rsquo;re currently looking for a high caliber professional to join our team as 25909878 Officer, Data Engineer -C11- Hybrid based in Chennai, India. Being part of our team means that we&rsquo;ll provide you with the resources to meet your unique needs, empower you to make healthy decision and manage your financial well-being to help plan for your future.
</div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div>The Data Engineer is accountable for developing high quality data products to support the Bank&rsquo;s regulatory requirements and data driven decision making. A Data Engineer will serve as an example to other team members, work closely with customers, and remove or escalate roadblocks. By applying their knowledge of data architecture standards, data warehousing, data structures, and business intelligence they will contribute to business outcomes on an agile team. 
Responsibilities &amp; Qualifications:<ul><li>
5-8 years of relevant experience in Big Data: Experience of &lsquo;big data&rsquo; platforms such as Hadoop, Hive or Snowflake for data storage and processing.</li><li>
Experience in Big Data, PySpark .</li><li>
Demonstrated problem-solving and decision-making skills</li><li>
Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements</li></ul> 
Education:<ul><li>
Bachelor&rsquo;s degree/University degree or equivalent experience</li></ul>
-
Job Family Group:
Technology
-
Job Family:
Applications Development
-
Time Type:
Full time
-
Most Relevant Skills
Please see the requirements listed above.
-
Other Relevant Skills
For complementary skills, please see above and/or contact the recruiter.
-
Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law. 
If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi. 
 
View Citi&rsquo;s EEO Policy Statement and the Know Your Rights poster.</div>

Officer- Data Engineer (Big Data, PySpark)

INNONEXIS TECHNOLOGY PRIVATE LIMITED

# We&rsquo;re Hiring: Freelance Data EngineerWe are looking for a talented Freelance Data Engineer to help us design, build, and optimize scalable data pipelines and platforms. # Key Responsibilities:Design, develop, and maintain ETL pipelines and workflowsWork with structured and unstructured data across multiple sourcesImplement and optimize data solutions on AWS (Glue, Lambda, EMR, S3, EC2, ECR, Batch)Integrate and manage data in Snowflake, MySQL, SalesforceCollaborate with data scientists, analysts, and business teams to deliver data-driven solutionsEnsure high performance, reliability, and security in data workflowsWork on CI/CD pipelines and containerization with Docker &amp; GitHub# Skills &amp; Tools:# AWS (Glue, Lambda, EMR, S3, EC2, ECR, Batch) # Snowflake, MySQL, Salesforce # Python, PySpark, SQL # Apache Airflow, Kafka, ETL, CI/CD. # GitHub, Docker# What We&rsquo;re Looking For:3+ years of experience as a Data Engineer (or similar role)Strong expertise in building data pipelines and working with big data toolsHands-on experience with AWS cloud services and data warehousesProficiency in Python, SQL, PySparkAvailable to work on a freelance/contract basisExcellent problem-solving and collaboration skills# Location: Remote (Freelance) # Engagement: Contract / FreelanceIf you&rsquo;re passionate about working with data, cloud, and modern data engineering tools, we&rsquo;d love to hear from you!# Apply now: hr@innonexis.comNOTE -: Salary negotiable according to&#8203; interview.Job Types: Full-time, PermanentPay: &#8377;40,000.00 - &#8377;50,000.00 per monthWork Location: Remote

Data engineer

Cywarden, Inc.

Job Title: Data Engineer Location: Mohali - Onsite, US Shifts Job Type: Full-timeWe are seeking an experienced Data Engineer with 3+ years of relevant experience to join our growing team. If you are passionate about building robust data pipelines, optimizing data workflows, and ensuring high-quality data delivery, we&rsquo;d love to hear from you.Role Overview: As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data infrastructure. You will work closely with data scientists, analysts, and cross-functional teams to ensure efficient data flow and support analytics and business intelligence initiatives.Key Responsibilities:<ul><li>Design, build, and maintain scalable ETL/ELT pipelines and data integration workflows.</li><li>Develop and optimize data models for analytics and reporting.</li><li>Ensure data reliability, accuracy, and security across multiple systems.</li><li>Collaborate with data scientists, analysts, and engineers to support business needs.</li><li>Manage and optimize data warehouses, data lakes, and related infrastructure.</li><li>Implement best practices for data governance, quality, and compliance.</li><li>Troubleshoot data-related issues and provide timely resolutions.</li></ul>Requirements:<ul><li>Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Engineering, or related field.</li><li>3+ years of experience as a Data Engineer or in a similar role.</li><li>Strong proficiency in SQL and relational databases.</li><li>Hands-on experience with big data tools (e.g., Hadoop, Spark, Kafka).</li><li>Experience with cloud platforms (AWS, Azure, or GCP).</li><li>Proficiency in programming languages (Python, Scala, or Java).</li><li>Knowledge of data warehousing solutions (Snowflake, Redshift, BigQuery, etc.).</li><li>Strong problem-solving, analytical, and communication skills.</li></ul>Nice to Have:<ul><li>Experience with real-time data streaming pipelines.</li><li>Familiarity with DevOps and CI/CD for data projects.</li><li>Exposure to machine learning workflows and MLOps.</li></ul>What We Offer:<ul><li>Competitive salary and performance-based incentives.</li><li>Professional development and upskilling opportunities.</li><li>A collaborative and innovative work culture.</li><li>Health and wellness benefits.</li><li>Opportunity to work on challenging projects in a data-driven environment.</li></ul>Job Types: Full-time, PermanentPay: &#8377;625,949.58 - &#8377;1,293,621.83 per yearWork Location: In person

Data Engineer- 3+ years

Search 10000+ Big data engineer jobs near you this October. New roles added regularly across leading industries. Apply today.

10000 big data engineer jobs NEAR_ME

Big Data Engineer

Big Data Engineer

Big Data Engineer

Big Data Software Engineer - Manufacturing Systems & Infrastructure

Officer- Data Engineer (Big Data, PySpark)

Data engineer

Data Engineer- 3+ years