big data developer

Citi

<div>The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities. 
 
Responsibilities:<ul><li>
Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas</li><li>
Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users</li><li>
Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement</li><li>
Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality</li><li>
Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems</li><li>
Ensure essential procedures are followed and help define operating standards and processes</li><li>
Serve as advisor or coach to new or lower level analysts</li><li>
Has the ability to operate with a limited level of direct supervision.
</li><li>Can exercise independence of judgement and autonomy.
</li><li>Acts as SME to senior stakeholders and /or other team members.</li><li>
Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.</li></ul> 
Qualifications:<ul><li>
7 - 12 years of relevant experience</li><li>
Experience in systems analysis and programming of software applications</li><li>
Experience in managing and implementing successful projects</li><li>
Working knowledge of consulting/project management techniques/methods</li><li>
Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements</li></ul> 
Education:<ul><li>
Bachelor&rsquo;s degree/University degree or equivalent experience</li></ul> 
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
Backend Resource
<ul><li>Strong expertise in Big Data technologies (Spark, Hadoop, Hive, Impala, Kafka, Scala, Cloudera).</li><li>
Design, develop, and maintain robust and scalable data pipelines using Python, SQL, PySpark, and streaming technologies like Kafka.</li><li>
Strong SQL and NoSQL experience (Oracle, MongoDB, PostgreSQL) for data extraction, reconciliation, and transformation.</li><li>
Proficiency in Python and Shell scripting for data processing and automation.</li><li>
Familiarity with cloud-based data solutions (AWS, GCP, or Azure).</li><li>
Proficiency in building and managing data pipelines using APIs, ETL tools, and Kafka.</li><li>
Ability to translate complex regulatory requirements into actionable data strategies.</li><li>
Strong analytical and problem-solving skills with a compliance-driven mindset.</li><li>
Experience with data governance, data standardization, and metadata management frameworks.</li></ul>
-
Job Family Group:
Technology
-
Job Family:
Applications Development
-
Time Type:
Full time
-
Most Relevant Skills
Please see the requirements listed above.
-
Other Relevant Skills
For complementary skills, please see above and/or contact the recruiter.
-
Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law. 
If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi. 
 
View Citi&rsquo;s EEO Policy Statement and the Know Your Rights poster.</div>

Senior Python Big Data Developer – Assistant Vice President

Tata Consultancy Services (TCS)

<div></div><div><div><div><div><ul><li>Strong proficiency in Python programming.</li>
<li>Hands-on experience with PySpark and Apache Spark.</li>
<li>Knowledge of Big Data technologies (Hadoop, Hive, Kafka, etc.).</li>
<li>Experience with SQL and relational/non-relational databases.</li>
<li>Familiarity with distributed computing and parallel processing.</li>
<li>Understanding of data engineering best practices.</li>
<li>Experience with REST APIs, JSON/XML, and data serialization.</li></ul> 
 
</div></div></div><div><div><div>Location</div>
<div>Hyderabad</div>
</div><div><div>Job Function</div>
<div>TECHNOLOGY</div>
</div><div><div>Role</div>
<div>Developer</div>
</div><div><div>Job Id</div>
<div>385715</div>
</div><div><div>Desired Skills</div>
<div>Digital : PySpark | Python</div>
</div></div>Desired Candidate Profile
<div><div>Qualifications : BACHELOR OF TECHNOLOGY</div></div></div><div></div>

Python/Pyspark, Bigquery with GCP

Randstad Türkiye

<div>
 
 We are looking for a
 
 "Senior - Mid Big Data Engineer
 
 " on behalf of our global business partner runs in
 
 Telecommunications
 
 Industry.
 
 
 
 
 
 About Role
 
 
 
 
 
 We are looking for a
 
 Senior&ndash;Mid Big Data Engineer
 
 to join our delivery-focused Big Data team. This role is fully aligned with production data migration and Big Data service deployment activities.
 
 
 
 
 
 
 Key Responsibilities
 
 
 
 
 
 <ul>
 <li>
 Execute data migration projects, ensuring data accuracy, performance, and operational stability.
 </li>
 <li>
 Deploy, configure, and operate Big Data services and platforms in live production environments.
 </li>
 <li>
 Install, configure, and maintain Big Data clusters, including Hadoop ecosystem components (HDFS, Hive, Spark, Flink, MapReduce).
 </li>
 <li>
 Perform DWS (Data Warehouse Service) deployments, including setup, configuration, tuning, and post-deployment support.
 </li>
 <li>
 Design, implement, and maintain ETL/ELT pipelines for production Data Warehouses and Data Lakes.
 </li>
 <li>
 Optimize and troubleshoot batch processing workloads using Hive, Spark, and related technologies.
 </li>
 <li>
 Implement and support data ingestion pipelines, including real-time components where applicable.
 </li>
 <li>
 Provide on-site and remote delivery support to international customers during deployment and migration phases.
 </li>
 </ul>
 
 
 
 
 
 Requirements
 
 
 
 
 
 
 
 
 Required Qualifications
 
 
 
 
 
 
 <ul>
 <li>
 BSc or MSc degree in Computer Engineering, Computer Science, Software Engineering, or a related technical discipline.
 </li>
 <li>
 4&ndash;8 years of professional experience in Big Data Engineering, with a strong focus on delivery, data migration, and production operations.
 </li>
 <li>
 Strong experience with Spark, Flink, Hadoop, and related Big Data technologies.
 </li>
 <li>
 Proficiency in Python or Java.
 </li>
 <li>
 Solid experience with SQL development (MySQL, PostgreSQL).
 </li>
 <li>
 Hands-on experience with batch processing using Hive and Spark.
 </li>
 <li>
 Strong understanding of Data Warehouse and Data Lake architectures.
 </li>
 <li>
 Experience working in Unix/Linux environments.
 </li>
 <li>
 Ability to work in production environments with high availability and performance requirements.
 </li>
 <li>
 Strong communication skills in international delivery teams.
 </li>
 <li>
 Fluency in written and spoken English is mandatory.
 </li>
 <li>
 Willingness and flexibility to travel internationally.
 </li>
 <li>
 Strong sense of ownership for end-to-end delivery and production stability.
 </li>
 </ul>
 
 
 
 
 
 
 Nice to Have
 
 
 
 
 
 
 <ul>
 <li>
 Experience with real-time ingestion systems such as Kafka or RabbitMQ.
 </li>
 <li>
 Experience with monitoring, alerting, and performance tuning of Big Data platforms.
 </li>
 <li>
 Exposure to cloud-native Big Data services.
 </li>
 </ul>
 
 
 
 
 
 
 Seniority Expectations
 
 
 
 
 
 
 <ul>
 <li>
 Solid understanding of ETL/ELT methodologies and production best practices.
 </li>
 <li>
 Proven ability to design, deploy, and operate complex data pipelines in live environments.
 </li>
 <li>
 Ability to independently own delivery activities, guide implementation decisions, and mentor junior engineers.
 </li>
 </ul>
</div>

Big Data Engineer

Aceis Services Pvt Ltd

Role &amp; Responsibilities:● Design and build a hybrid data solution using a combination of on-premise and in-cloud services.● Work with business users and other stakeholders to understand business processes. Ability to design and implement Dimensional and Fact tables● Identify and implement data transformation/cleansing requirements● Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform and load data from various systems to the Enterprise Data Warehouse● Develop conceptual, logical, and physical data models with associated metadata including data lineage and technical data definitions● Diagnose and troubleshoot complex distributed systems problems and develop solutions with a significant impact on our massive scale.● Build tools to ingest and process terabyte-scale data on a daily basis.● Communicate with a wide set of teams, including product owners, business analysts, data and enterprise architects, platform engineers, and cloud vendors, etc.● Compilation of detailed design documents, technical specification documents, and test plans as required.● Independently manage development tasks as per technical specification documents, prod deployment, post prod support, etc.● Managing support to Unit Testing, SIT &amp; UAT.● Coordinate with business and support teams on testing and migration activities. Required Skills● Experience in developing Big Data solutions (migration, storage, processing)● Experience building and deploying cloud-based solutions at scale.● 3+ years&rsquo; experience of Hands-on in data structures, spark, SQL and NoSQL Databases● Hands-on experience in AWS Cloud with services such as AWS Glue, AWS Redshift, EC2, Lambda, S3.● Strong software development skills in Python and Pyspark.● Experience building and deploying cloud-based solutions at scale.● Experience in developing Big Data solutions (migration, storage, processing).● BS, MS or PhD degree in Computer Science or Engineering, and 4+ years of relevant work experience in Big Data and cloud systems● Experience in SQL and Query optimization.● Ability to clearly communicate technical roadmap, challenges and mitigation● Experience building and supporting large-scale systems in a production environment.Job Type: Full-timePay: ₹2,000,000.00 - ₹3,000,000.00 per yearWork Location: Remote

Architect Data

Cognizant Technology Solutions

<div>Job Title: - GCP Data Engineer with Big Query
 
Location: - AIA Pune 
Job Type 3 days from office (Hybrid)
Minimum 6 to 13 years of experience
Mandatory Skills: GCP Services &ndash; Big Query, Cloud SQL, Data flow 
Around 7+ years of experience in development in Data warehousing projects in GCP platforms, 
Good understanding of dimensional modelling 
Expertise in MySQL &amp; SQL/PL 
GCP &amp; BigQuery knowledge is must, GCP certification is added advantage 
Good experience in Cloud Composer, DAGs , airflow 
REST API development experience 
Good in analytical and problem solving, efficient communication 
Ability to lead the team members, convert requirements into technical solutions, assign the work, coordinate the team and review the deliverables and ensure on schedule.</div>

GCP Data Engineer with Big Query

Talan

<div>
 
 
 Talan &ndash; Positive Innovation
 
 
 
 Talan is an international consulting group specializing in innovation and business transformation through technology. With over 7,200 consultants in 21 countries and a turnover of &euro;850M, we are committed to delivering impactful, future-ready solutions.
 
 
 
 Talan at a Glance
 
 
 
 Headquartered in Paris and operating globally, Talan combines technology, innovation, and empowerment to deliver measurable results for our clients. Over the past 22 years, we&rsquo;ve built a strong presence in the IT and consulting landscape, and we&rsquo;re on track to reach &euro;1 billion in revenue this year.
 
 
 
 Our Core Areas of Expertise
 
 
 
 
 <ul>
 <li>
 
 Data &amp; Technologies:
 
 We design and implement large-scale, end-to-end architecture and data solutions, including data integration, data science, visualization, Big Data, AI, and Generative AI.
 
 
 
 </li>
 <li>
 
 
 Cloud &amp; Application Services:
 
 We integrate leading platforms such as SAP, Salesforce, Oracle, Microsoft, AWS, and IBM Maximo, helping clients transition to the cloud and improve operational efficiency.
 
 
 
 </li>
 <li>
 
 
 Management &amp; Innovation Consulting:
 
 We lead business and digital transformation initiatives through project and change management best practices (PM, PMO, Agile, Scrum, Product Ownership), and support domains such as Supply Chain, Cybersecurity, and ESG/Low-Carbon strategies.
 
 
 
 
 
 
 </li>
 </ul>
 
 We work with major global clients across diverse sectors, including Transport &amp; Logistics, Financial Services, Energy &amp; Utilities, Retail, and Media &amp; Telecommunications.
 
 
 
 
 Job Description
 
 
 
 
 As a
 
 Backend Spark developer
 
 , your mission will be to develop, test and deploy the technical and functional specifications from the Solution Designers / Business Architects / Business Analysts, guaranteeing the correct operability and the compliance with the internal quality levels.
 
 
 We need somebody like you to help us in different fronts:
 
 
 
 <ul>
 <li>
 You will develop end-to-end ETL processes with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc.
 </li>
 <li>
 You will use Scrum methodology, and be part of a high performance team
 </li>
 <li>
 You will document your solutions in the tools: JIRA, Confluence, ALM
 </li>
 <li>
 You will certify your delivery and its integration with other components, designing and performing the relevant test to ensure the quality of your team delivery
 </li>
 <li>
 You will work side by side with a technical specialist who will help you to improve the architecture and technical implementation of the solution in place
 </li>
 <li>
 You will collaborate with cross-functional and cross-country teams to integrate data from various sources
 </li>
 <li>
 You will develop and maintain data hub and data pipelines in microservices architecture
 </li>
 <li>
 You will collaborate with other developers to maintain and improve CI/CD pipelines
 
 
 
 </li>
 </ul>
 
 
 
 WHAT WE ARE LOOKING FOR
 
 
 
 
 <ul>
 <li>
 Bachelor's degree in Computer Science or a related field.
 </li>
 <li>
 1+ years of experience in data/software engineering (preferable in banking)
 </li>
 <li>
 Experience with Integration Solutions (using API and Microservices)
 </li>
 <li>
 Programming backend applications with BigData technologies(
 
 Apache Spark
 
 )
 </li>
 <li>
 Agile approach for software development
 </li>
 <li>
 Continuous Integration (Git, GitHub)
 </li>
 <li>
 Knowledge of SQL databases
 </li>
 <li>
 English (at least B2+)
 
 
 
 </li>
 </ul>
 
 Qualifications
 
 
 
 
 
 Preferred qualifications
 
 
 
 
 <ul>
 <li>
 Git hub actions
 </li>
 <li>
 Scala or Python
 </li>
 <li>
 Bash scripting
 </li>
 <li>
 ControlM, AirFlow
 </li>
 <li>
 Software development life cycle (HP ALM,..)
 </li>
 <li>
 Basics of cybersecurity &amp; Quality (sonar&hellip;)
 </li>
 <li>
 Basics of Cloud computing (Docker, Kubernetes, S3, Azure, AWS, EMR, DataBricks)
 </li>
 <li>
 SOA Architecture
 
 
 
 </li>
 </ul>
 
 Additional Information
 
 
 
 
 What do we offer you?
 
 
 
 
 <ul>
 <li>
 Full-time contract.
 </li>
 <li>
 Smart Office Pack so that you can work comfortably from home.
 </li>
 <li>
 Training and career development.
 </li>
 <li>
 Benefits and perks such as
 
 private medical insurance
 
 , life insurance.
 </li>
 <li>
 Possibility to be part of a multicultural team and work on international projects.
 </li>
 <li>
 
 This is a hybrid position based in Warsaw, Poland. Relocation is mandatory.
 
 </li>
 <li>
 Possibility to manage work-permits.
 
 
 
 </li>
 </ul>
 
 If you are passionate about development &amp; tech, we want to meet you!
 
 
 
 
 
 Talan Spain&rsquo;s commitment to non-discrimination based on gender, race, ideology, or any other reason, in accordance with the company&rsquo;s "Equality Plan" and the current regulations on gender equality between women and men (Royal Decree-Law 6/2019).
 
 
 
</div>

Junior Data Engineer  (Relocation to Poland)

Workforce İnsan Kaynakları

<div>
 
 Dan&inodot;&scedil;manl&inodot;&gbreve;&inodot;n&inodot; yapmakta oldu&gbreve;umuz Bili&scedil;im Teknolojileri sekt&ouml;r&uuml;nde faaliyet g&ouml;steren i&scedil; orta&gbreve;&inodot;m&inodot;z i&ccedil;in '' B&uuml;y&uuml;k Veri M&uuml;hendisi'' pozisyonu i&ccedil;in aday aray&inodot;&scedil;&inodot;m&inodot;z bulunmaktad&inodot;r.
 
 
 
 
 
 Bilgisayar, Yaz&inodot;l&inodot;m, Matematik, End&uuml;stri M&uuml;hendisli&gbreve;i B&ouml;l&uuml;mlerinden mezunu
 
 
 Alan&inodot;nda en az 4 sene tecr&uuml;be sahibi
 
 
 Rdbms veri tabanlar&inodot;nda &ccedil;al&inodot;&scedil;m&inodot;&scedil;, uygulama geli&scedil;tirmi&scedil;,
 
 
 Data modeling konusunda uzman seviyesinde bilgi sahibi
 
 
 Unix / Linux and shell script konusunda tecr&uuml;beli
 
 
 B&uuml;y&uuml;k veri ekosistemindeki teknolojiler Hadoop, Kafka, Airflow, Trino, Iceberg, Spark ve benzeri teknolojilerde alt yap&inodot; sahibi ve bu alanda kurulum, migration, performans testleri yapabilecek,
 
 
 Tercihen Da&gbreve;&inodot;t&inodot;k Mimari ve ilgili teknolojiler hakk&inodot;nda bilgi sahibi olmak
 
 
 Big data konusunda &ccedil;al&inodot;&scedil;maya istekli
 
 
 Python ile programlamada tecr&uuml;besine sahip
 
 
 Streaming architecture konusunda fikir sahibi
 
 
 &Ccedil;ok iyi derecede Sql ve analitik sql bilgisine sahip,
 
 
 Ekip &ccedil;al&inodot;&scedil;mas&inodot;n&inodot; seven ve ileti&scedil;imi kuvvetli
 
 
 Literat&uuml;r&uuml; takip edecek seviyede ingilizce bilgisine sahip
 
 
 Problem &ccedil;&ouml;zmeyi seven, analitik d&uuml;&scedil;&uuml;nme yap&inodot;s&inodot;na sahip
 
 
 Ankara'da ikamet eden/edebilecek
 
 
 
 
 
 
 
 
 Workforce &Idot;nsan Kaynaklar&inodot; ve Dan&inodot;&scedil;manl&inodot;k Hizmetleri Ltd. &Scedil;ti. &Idot;&scedil;kur'un denetiminde 24.12.2025 tarihli 897 No'lu lisans sahibi &ouml;zel istihdam b&uuml;rosudur.4904 say&inodot;l&inodot; i&scedil; kanunu gere&gbreve;i i&scedil; arayanlardan her ne ad alt&inodot;nda olursa olsun menfaat temin edilemez ve &uuml;cret al&inodot;namaz.
 
 
 
</div>

Büyük Veri Mühendisi

Search 10000+ Big data developer jobs near you this January. New roles added regularly across leading industries. Apply today.