Qureos Mentor

Impetus Technologies

<p></p><div><div><div><div><div><div><div><p>Indore, Madhya Pradesh, India</p></div></div></div><div><div><div><br>
</div></div></div></div></div></div><div><div><div><div><div><div><div><div><p>
Qualification</p><div>
:</div></div><div><div><p>
We are seeking an experienced Technical Lead to design, develop, and lead Big Data and Cloud-based solutions. The ideal candidate will have strong expertise in distributed data processing, cloud-native architectures, and modern data technologies, along with proven leadership in guiding teams and delivering enterprise-grade solutions.</p><br>
<p></p>
<p>Key Responsibilities:</p>
<ul><li>Lead end-to-end design and development of Big Data solutions using Spark, Kafka, and Python.</li>
<li>Architect and implement scalable data pipelines and real-time streaming applications.</li>
<li>Design and optimize data storage solutions using NoSQL and SQL databases.</li>
<li>Drive cloud-native development and deployment on GCP, including Cloud Storage and related services.</li>
<li>Implement workflow orchestration using Airflow for data pipelines.</li>
<li>Collaborate with cross-functional teams including DevOps, QA, and product stakeholders.</li>
<li>Ensure data security, scalability, and performance across platforms.</li>
<li>Mentor and guide development teams on best practices and coding standards.</li>
<li>Participate in architecture reviews and technical decision-making.</li>
<li>Implement CI/CD pipelines and ensure smooth deployments.</li>
</ul><ul><li>Deliver high-quality Big Data solutions within agreed timelines.</li>
<li>Maintain low-latency data processing and high system availability.</li>
<li>Optimize cloud resource utilization and cost efficiency.</li>
<li>Ensure compliance with security and governance standards.</li></ul><br>
<p>
</p><p>Required Skills &amp; Qualifications:</p>
<ul><li>Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Engineering, or related field.</li>
<li>8 to 12 years of experience in Big Data and cloud-based solution development, with at least 3 years in a technical lead role.</li>
<li>Strong proficiency in Big Data technologies: Spark, Kafka, Hadoop.</li>
<li>Expertise in Python programming.</li>
<li>Hands-on experience with GCP cloud services including Cloud Storage.</li>
<li>Experience with Airflow for workflow orchestration.</li>
<li>Strong knowledge of SQL and NoSQL database design and optimization.</li>
<li>Familiarity with CI/CD pipelines, containerization (Docker), and Kubernetes.</li>
<li>Strong problem-solving, leadership, and communication skills.</li>
</ul>
<p>Preferred Skills &amp; Certifications:</p>
<ul><li>GCP Professional Data Engineer or Cloud Architect certification.</li>
<li>Experience with data modeling and lakehouse architectures.</li>
<li>Knowledge of other cloud platforms (AWS, Azure)
</li></ul></div></div></div></div></div><div><div><div><div><p>Experience</p><div>
:</div></div><div><p>
8 to 12 years</p></div></div></div></div><div><div><div><div><p>
Job Reference Number</p><div>
:</div></div><div><p>
13524</p></div></div></div></div><div><div><div><div><p>
Skills Required</p><div>
:</div></div><div><p>
Bigdata, Python, Data Engineer, Cloud</p></div></div></div></div><div><div><div><div><p>
Role</p><div>
:</div></div><div><div><ul>
<li>Lead end-to-end design and development of Big Data solutions using Spark, Kafka, and Python.</li>
<li>Architect and implement scalable data pipelines and real-time streaming applications.</li>
<li>Design and optimize data storage solutions using NoSQL and SQL databases.</li>
<li>Drive cloud-native development and deployment on GCP, including Cloud Storage and related services.</li>
<li>Implement workflow orchestration using Airflow for data pipelines.</li>
<li>Collaborate with cross-functional teams including DevOps, QA, and product stakeholders.</li>
<li>Ensure data security, scalability, and performance across platforms.</li>
<li>Mentor and guide development teams on best practices and coding standards.</li>
<li>Participate in architecture reviews and technical decision-making.</li>
<li>Implement CI/CD pipelines and ensure smooth deployments.</li>
</ul><ul><li>Deliver high-quality Big Data solutions within agreed timelines.</li>
<li>Maintain low-latency data processing and high system availability.</li>
<li>Optimize cloud resource utilization and cost efficiency.</li>
<li>Ensure compliance with security and governance standards.</li></ul></div></div></div></div></div></div></div></div></div></div><p></p>

Lead – Big Data and Cloud

<p></p><div><div><div><div><div><div><div><p>Chennai, Tamil Nadu, India</p></div></div></div><div><div><div><br>
</div></div></div></div></div></div><div><div><div><div><div><div><div><div><p>
Qualification</p><div>
:</div></div><div><div><p>
Total - 3 Positions:<br>
2 Positions: Big Data; GCP; PySpark; Python; SQL<br>
1 Position : Big Data; GCP; ETL - Big Data / Data Warehousing; Git (GitHub, GitLab, BitBucket, SVN); PySpark; Python; SQL<br>
<br>
Position Required : Google Cloud - Data Engineer.We are looking for energetic, high-performing and highly skilled data engineers to help shape our technology and product roadmap. You will be part of the fast-paced, entrepreneurial Global Campaign Tracking (GCT) team under Enterprise PersonalizationPortfolio focused on delivering the next generation of global marketing capabilities. The team is responsible for marketing campaign tracking of new accounts acquisition and bounty payments and leverages large scale data engineering technologies, such as such as SQL, PySpark, GCP, Big Query, Data Proc, Adobe Analytics, Google Analytics, Hive, Kafka &amp;amp; Java.Focus: Designs, develops, solves problems, debugs, evaluates, modifies, deploys, and documents software and systems that meet the needs of customer-facing applications, business applications, and/or internal end user applications.Responsibilities&middot; Develop and maintain large scale data processing pipeline using PySpark Data Proc, Big Query and SQL.&middot; Use Big Query and Data proc to migrate existing Hadoop/Spark/Hive workloads to Google Cloud.&middot; Proficient in Big Query to carry out batch and interactive data analysis.&middot; Function as member of an agile team by contributing to software builds through consistent development practices (tools, common components, and documentation)&middot; Develops and tests software, including ongoing refactoring of code, and drives continuous improvement in code structure and quality&middot; Enable the deployment, support, and monitoring of software across test, integration, and production environmentsMinimum Qualifications:This high energy Engineer must have:A Bachelor&rsquo;s degree in computer science, computer engineering, other technical discipline, or equivalent work experience6 &ndash; 9 years of software development experience. Hands-on expertise with application design, software development, and automated testing.Strong programming knowledge in SQL, PySpark, Data Proc, Big QueryHands-on experience in Big Data technologies (Spark, Hive)Understanding and experience with UNIX / Shell / Perl / Python scriptingDatabase query optimization and indexingWeb services design and implementation using REST / SOAP and Java is a plusExperience collaborating with the business to drive requirements/Agile story analysis.Experience with design and coding across one or more platforms and languages as appropriateBonus skills:Machine learning/data miningObject-oriented design and codingAdobe Marketing Campaign products<br>
</p></div></div></div></div></div><div><div><div><div><p>Experience</p><div>
:</div></div><div><p>
5 to 7 years</p></div></div></div></div><div><div><div><div><p>
Job Reference Number</p><div>
:</div></div><div><p>
13584</p></div></div></div></div><div><div><div><div><p>
Skills Required</p><div>
:</div></div><div><p>
Bigdata, Pyspark, GCP</p></div></div></div></div><div><div><div><div><p>
Role</p><div>
:</div></div><div><div><p>
Total - 3 Positions:<br>
2 Positions: Big Data; GCP; PySpark; Python; SQL<br>
1 Position : Big Data; GCP; ETL - Big Data / Data Warehousing; Git (GitHub, GitLab, BitBucket, SVN); PySpark; Python; SQL<br>
<br>
Position Required : Google Cloud - Data Engineer.We are looking for energetic, high-performing and highly skilled data engineers to help shape our technology and product roadmap. You will be part of the fast-paced, entrepreneurial Global Campaign Tracking (GCT) team under Enterprise PersonalizationPortfolio focused on delivering the next generation of global marketing capabilities. The team is responsible for marketing campaign tracking of new accounts acquisition and bounty payments and leverages large scale data engineering technologies, such as such as SQL, PySpark, GCP, Big Query, Data Proc, Adobe Analytics, Google Analytics, Hive, Kafka &amp;amp; Java.Focus: Designs, develops, solves problems, debugs, evaluates, modifies, deploys, and documents software and systems that meet the needs of customer-facing applications, business applications, and/or internal end user applications.Responsibilities&middot; Develop and maintain large scale data processing pipeline using PySpark Data Proc, Big Query and SQL.&middot; Use Big Query and Data proc to migrate existing Hadoop/Spark/Hive workloads to Google Cloud.&middot; Proficient in Big Query to carry out batch and interactive data analysis.&middot; Function as member of an agile team by contributing to software builds through consistent development practices (tools, common components, and documentation)&middot; Develops and tests software, including ongoing refactoring of code, and drives continuous improvement in code structure and quality&middot; Enable the deployment, support, and monitoring of software across test, integration, and production environmentsMinimum Qualifications:This high energy Engineer must have:A Bachelor&rsquo;s degree in computer science, computer engineering, other technical discipline, or equivalent work experience6 &ndash; 9 years of software development experience. Hands-on expertise with application design, software development, and automated testing.Strong programming knowledge in SQL, PySpark, Data Proc, Big QueryHands-on experience in Big Data technologies (Spark, Hive)Understanding and experience with UNIX / Shell / Perl / Python scriptingDatabase query optimization and indexingWeb services design and implementation using REST / SOAP and Java is a plusExperience collaborating with the business to drive requirements/Agile story analysis.Experience with design and coding across one or more platforms and languages as appropriateBonus skills:Machine learning/data miningObject-oriented design and codingAdobe Marketing Campaign products</p></div></div></div></div></div></div></div></div></div></div><p></p>

GCP Data Engineer - MLSE

Join Impetus Technologies and explore 2   exciting career opportunities. They're hiring for various roles with options for remote or on-site work. Apply today and become part of their innovative team.

Impetus Technologies

ABOUT_COMPANY

Lead – Big Data and Cloud

GCP Data Engineer - MLSE