wordpress developer Jobs in Bangalore Jobs In Test Jobs In Mangaluru

wordpress developer

software developer Jobs in Bangalore Jobs In Test Jobs In Mangaluru

software developer

software development engineer Jobs in Bangalore Jobs In Test Jobs In Mangaluru

software development engineer

flutter developer Jobs in Bangalore Jobs In Test Jobs In Mangaluru

flutter developer

developer Jobs in Bangalore Jobs In Test Jobs In Mangaluru

developer

pyspark developer

Recruitment Hub 365

<p><b>Job Title:</b> PySpark Developer</p><p><b>Locations:</b> Chennai, Hyderabad, Kolkata<br/><b>Work Mode:</b> Monday&ndash;Friday (5 days WFO)<br/><b>Experience:</b> 5+ years in Backend/Data Engineering<br/><b>Notice Period:</b> Immediate &ndash; 15 days<br/><b>Must-Have:</b> Python, PySpark, Amazon Redshift, PostgreSQL</p><p><b>About the Role</b></p><p>We are seeking an experienced <b>PySpark Developer</b> with strong data engineering expertise to design, develop, and optimize scalable data pipelines for large-scale data processing. The role involves working across distributed systems, ETL/ELT frameworks, cloud data platforms, and analytics-driven architecture. You will collaborate closely with cross-functional teams to ensure efficient ingestion, transformation, and delivery of high-quality data.</p><p><b>Key Responsibilities</b></p><ul><li>Design and develop robust, scalable ETL/ELT pipelines using PySpark to process data from databases, APIs, logs, and file-based sources.</li><li>Convert raw data into analysis-ready datasets for data hubs and analytical data marts.</li><li>Build reusable, parameterized Spark jobs for batch and micro-batch processing.</li><li>Optimize PySpark performance to handle large and complex datasets.</li><li>Ensure data quality, consistency, lineage, and maintain detailed documentation for all ingestion workflows.</li><li>Collaborate with Data Architects, Data Modelers, and Data Scientists to implement data ingestion logic aligned with business requirements.</li><li>Work with AWS services (S3, Glue, EMR, Redshift) for data ingestion, storage, and processing.</li><li>Support version control, CI/CD practices, and infrastructure-as-code workflows as needed.</li></ul><p><b>Must-Have Skills</b></p><ul><li>Minimum <b>5+ years</b> of data engineering experience, with a strong focus on <b>PySpark/Spark</b>.</li><li>Proven experience building ingestion frameworks for relational, semi-structured (JSON, XML), and unstructured data (logs, PDFs).</li><li>Strong Python knowledge along with key data processing libraries.</li><li>Advanced SQL proficiency (Redshift, PostgreSQL, or similar).</li><li>Hands-on experience with distributed computing platforms (Spark on EMR, Databricks, etc.).</li><li>Familiarity with workflow orchestration tools (AWS Step Functions or similar).</li><li>Strong understanding of data lake and data warehouse architectures, including core data modeling concepts.</li></ul><p><b>Good-to-Have Skills</b></p><ul><li>Experience with AWS services: Glue, S3, Redshift, Lambda, CloudWatch, etc.</li><li>Exposure to Delta Lake or similar large-scale storage frameworks.</li><li>Experience with real-time streaming tools: Spark Structured Streaming, Kafka.</li><li>Understanding of data governance, lineage, and cataloging tools (Glue Catalog, Apache Atlas).</li><li>Knowledge of DevOps and CI/CD pipelines (Git, Jenkins, etc.).</li></ul><p>Job Type: Full-time</p><p>Pay: &#8377;1,400,000.00 - &#8377;1,800,000.00 per year</p><p>Application Question(s):</p><ul><li>How many years of experience you have as Pyspark Developer?</li><li>Have you worked with Python, Amazon Redshift, PostgreSQL?</li><li>Mention your Current Location?</li><li>Mention your NP, Current CTC and ECTC.</li></ul><p>Work Location: In person</p>

PySpark Developer

Citi

<div><p>The Applications Development Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.<br>
<br>
<b>Responsibilities:</b></p><ul><li>
Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements</li><li>
Identify and analyze issues, make recommendations, and implement solutions</li><li>
Utilize knowledge of business processes, system processes, and industry standards to solve complex issues</li><li>
Analyze information and make evaluative judgements to recommend solutions and improvements</li><li>
Conduct testing and debugging, utilize script tools, and write basic code for design specifications</li><li>
Assess applicability of similar experiences and evaluate options under circumstances not covered by procedures</li><li>
Develop working knowledge of Citi&rsquo;s information systems, procedures, standards, client server application development, network operations, database administration, systems administration, data center operations, and PC-based applications</li><li>
Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.</li></ul><p><b><br>
Qualifications:</b></p><ul><li>
0-2 years of relevant experience</li><li>
Experience in programming/debugging used in business applications</li><li>
Working knowledge of industry practice and standards</li><li>
Comprehensive knowledge of specific business area for application development</li><li>
Working knowledge of program languages</li><li>
Consistently demonstrates clear and concise written and verbal communication</li></ul><p><b><br>
Education:</b></p><ul><li>
Bachelor&rsquo;s degree/University degree or equivalent experience</li></ul><p></p><p><br>
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.</p><p></p><p>
-</p><p><b>
Job Family Group:
</b></p>Technology<p>
-</p><p><b>
Job Family:</b></p>
Applications Development<p>
-</p><p><b>
Time Type:</b></p>
Full time<p>
-</p><p><b>
Most Relevant Skills
</b></p>Please see the requirements listed above.<p>
-</p><p><b>
Other Relevant Skills
</b></p>PySpark.<p>
-</p><p><i>
Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.</i></p><p></p><p><i><br>
If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review </i><i>Accessibility at Citi</i><i>.</i><br>
<br>
<i>View Citi&rsquo;s </i><i>EEO Policy Statement</i><i> and the </i><i>Know Your Rights</i><i> poster.</i></p></div>

Pyspark Developer

<div></div><div><div><div><div><ul><div>7 - 9 Years</div>
<div></div><div>1 Opening</div>
 <div>Trivandrum</div></ul></div><p></p><div><br>
<div><div>
</div></div></div></div><div></div><div><h3 class="jobSectionHeader"><b>Role description</b></h3>
<div><p>Role Proficiency:</p>
<p>
This role requires proficiency in developing data pipelines including coding and testing for ingesting wrangling transforming and joining data from various sources. The ideal candidate should be adept in ETL tools like Informatica Glue Databricks and DataProc with strong coding skills in Python PySpark and SQL. This position demands independence and proficiency across various data domains. Expertise in data warehousing solutions such as Snowflake BigQuery Lakehouse and Delta Lake is essential including the ability to calculate processing costs and address performance issues. A solid understanding of DevOps and infrastructure needs is also required.</p>
<p>
Outcomes:</p>
<div>
<ul><li>Act creatively to develop pipelines/applications by selecting appropriate technical options optimizing application development maintenance and performance through design patterns and reusing proven solutions. Support the Project Manager in day-to-day project execution and account for the developmental activities of others.</li></ul>
<ul><li>Interpret requirements create optimal architecture and design solutions in accordance with specifications.</li></ul>
<ul><li>Document and communicate milestones/stages for end-to-end delivery.</li></ul>
<ul><li>Code using best standards debug and test solutions to ensure best-in-class quality.</li></ul>
<ul><li>Tune performance of code and align it with the appropriate infrastructure understanding cost implications of licenses and infrastructure.</li></ul>
<ul><li>Create data schemas and models effectively.</li></ul>
<ul><li>Develop and manage data storage solutions including relational databases NoSQL databases Delta Lakes and data lakes.</li></ul>
<ul><li>Validate results with user representatives integrating the overall solution.</li></ul>
<ul><li>Influence and enhance customer satisfaction and employee engagement within project teams.</li></ul>
</div>
<p></p><p>Measures of Outcomes:</p>
<div>
<ul><li>TeamOne's Adherence to engineering processes and standards</li></ul>
<ul><li>TeamOne's Adherence to schedule / timelines</li></ul>
<ul><li>TeamOne's Adhere to SLAs where applicable</li></ul>
<ul><li>TeamOne's # of defects post delivery</li></ul>
<ul><li>TeamOne's # of non-compliance issues</li></ul>
<ul><li>TeamOne's Reduction of reoccurrence of known defects</li></ul>
<ul><li>TeamOne's Quickly turnaround production bugs</li></ul>
<ul><li>Completion of applicable technical/domain certifications</li></ul>
<ul><li>Completion of all mandatory training requirementst</li></ul>
<ul><li>Efficiency improvements in data pipelines (e.g. reduced resource consumption faster run times).</li></ul>
<ul><li>TeamOne's Average time to detect respond to and resolve pipeline failures or data issues.</li></ul>
<ul><li>TeamOne's Number of data security incidents or compliance breaches.</li></ul>
</div>
<p></p><p>Outputs Expected:</p>
<p>
Code:</p>
<div>
<ul><li>Develop data processing code with guidance<br>
ensuring performance and scalability requirements are met.</li></ul>
<ul><li>Define coding standards<br>
templates<br>
and checklists.</li></ul>
<ul><li>Review code for team and peers.</li></ul></div><br>
<p><br>
Documentation:</p>
<div>
<ul><li>Create/review templates<br>
checklists<br>
guidelines<br>
and standards for design/process/development.</li></ul>
<ul><li>Create/review deliverable documents<br>
including design documents<br>
architecture documents<br>
infra costing<br>
business requirements<br>
source-target mappings<br>
test cases<br>
and results.</li></ul></div><br>
<p><br>
Configure:</p>
<div>
<ul><li>Define and govern the configuration management plan.</li></ul>
<ul><li>Ensure compliance from the team.</li></ul></div><br>
<p><br>
Test:</p>
<div>
<ul><li>Review/create unit test cases<br>
scenarios<br>
and execution.</li></ul>
<ul><li>Review test plans and strategies created by the testing team.</li></ul>
<ul><li>Provide clarifications to the testing team.</li></ul></div><br>
<p><br>
Domain Relevance:</p>
<div>
<ul><li>Advise data engineers on the design and development of features and components<br>
leveraging a deeper understanding of business needs.</li></ul>
<ul><li>Learn more about the customer domain and identify opportunities to add value.</li></ul>
<ul><li>Complete relevant domain certifications.</li></ul></div><br>
<p><br>
Manage Project:</p>
<div>
<ul><li>Support the Project Manager with project inputs.</li></ul>
<ul><li>Provide inputs on project plans or sprints as needed.</li></ul>
<ul><li>Manage the delivery of modules.</li></ul></div><br>
<p><br>
Manage Defects:</p>
<div>
<ul><li>Perform defect root cause analysis (RCA) and mitigation.</li></ul>
<ul><li>Identify defect trends and implement proactive measures to improve quality.</li></ul></div><br>
<p><br>
Estimate:</p>
<div>
<ul><li>Create and provide input for effort and size estimation<br>
and plan resources for projects.</li></ul></div><br>
<p><br>
Manage Knowledge:</p>
<div>
<ul><li>Consume and contribute to project-related documents<br>
SharePoint<br>
libraries<br>
and client universities.</li></ul>
<ul><li>Review reusable documents created by the team.</li></ul></div><br>
<p><br>
Release:</p>
<div>
<ul><li>Execute and monitor the release process.</li></ul></div><br>
<p><br>
Design:</p>
<div>
<ul><li>Contribute to the creation of design (HLD<br>
LLD<br>
SAD)/architecture for applications<br>
business components<br>
and data models.</li></ul></div><br>
<p><br>
Interface with Customer:</p>
<div>
<ul><li>Clarify requirements and provide guidance to the Development Team.</li></ul>
<ul><li>Present design options to customers.</li></ul>
<ul><li>Conduct product demos.</li></ul>
<ul><li>Collaborate closely with customer architects to finalize designs.</li></ul></div><br>
<p><br>
Manage Team:</p>
<div>
<ul><li>Set FAST goals and provide feedback.</li></ul>
<ul><li>Understand team members' aspirations and provide guidance and opportunities.</li></ul>
<ul><li>Ensure team members are upskilled.</li></ul>
<ul><li>Engage the team in projects.</li></ul>
<ul><li>Proactively identify attrition risks and collaborate with BSE on retention measures.</li></ul></div><br>
<p><br>
Certifications:</p>
<div>
<ul><li>Obtain relevant domain and technology certifications.</li></ul>
</div>
<p></p><p>Skill Examples:</p>
<div>
<ul><li>Proficiency in SQL Python or other programming languages used for data manipulation.</li></ul>
<ul><li>Experience with ETL tools such as Apache Airflow Talend Informatica AWS Glue Dataproc and Azure ADF.</li></ul>
<ul><li>Hands-on experience with cloud platforms like AWS Azure or Google Cloud particularly with data-related services (e.g. AWS Glue BigQuery).</li></ul>
<ul><li>Conduct tests on data pipelines and evaluate results against data quality and performance specifications.</li></ul>
<ul><li>Experience in performance tuning.</li></ul>
<ul><li>Experience in data warehouse design and cost improvements.</li></ul>
<ul><li>Apply and optimize data models for efficient storage retrieval and processing of large datasets.</li></ul>
<ul><li>Communicate and explain design/development aspects to customers.</li></ul>
<ul><li>Estimate time and resource requirements for developing/debugging features/components.</li></ul>
<ul><li>Participate in RFP responses and solutioning.</li></ul>
<ul><li>Mentor team members and guide them in relevant upskilling and certification.</li></ul>
</div>
<p></p><p>Knowledge Examples:</p>
<p>
Knowledge Examples</p>
<div>
<ul><li>Knowledge of various ETL services used by cloud providers including Apache PySpark AWS Glue GCP DataProc/Dataflow Azure ADF and ADLF.</li></ul>
<ul><li>Proficient in SQL for analytics and windowing functions.</li></ul>
<ul><li>Understanding of data schemas and models.</li></ul>
<ul><li>Familiarity with domain-related data.</li></ul>
<ul><li>Knowledge of data warehouse optimization techniques.</li></ul>
<ul><li>Understanding of data security concepts.</li></ul>
<ul><li>Awareness of patterns frameworks and automation practices.</li></ul>
</div>
<p></p><p>Additional Comments:</p>
<p></p>
<p>Job Title: Databricks and PySpark Developer Role Focus: Design, build, and optimize data pipelines and create notebooks on the Databricks platform. Ensure performance, scalability, and security of Databricks workloads. Perform operations support to deploy and manage Databricks for large-scale data processing. Key Responsibilities: Integrate and manage Databricks with AWS cloud services. Optimize query performance and cluster configurations in Databricks. Document processes, standards, and best practices for Databricks development. Apply strong knowledge of Apache Spark and distributed data processing. Build and maintain scalable data pipelines for both batch and streaming workloads. Perform data ingestion within Databricks to ingest, transform, and deliver data across development, UAT, and Production environments Develop solutions using Python, SQL, PySpark, and Airflow for data engineering and analytics. Work with CI/CD pipelines, DevOps/MLOps practices, and automation tools. Leverage knowledge of PostgreSQL and DB2 for data integration and optimization. Tools &amp; Technologies: AWS ecosystem (EC2, S3, IAM, Lambda, RDS, etc.) Infrastructure as Code: CDK (TypeScript), CloudFormation (YAML) Version Control &amp; Automation: GitHub, Bash/SH scripting Databricks, Python, Spark, Ariflow Snowflake (nice to have) Other Requirements: Strong awareness of data security practices and compliance standards. Ability to maintain data quality, operational stability, and reliability in production environments. Excellent problem-solving, documentation, and collaboration skills.</p></div>
<h3 class="jobSectionHeader"><b>Skills</b></h3>
<div><p>Databricks,PaySpark,Aws Cloud,Python,sql</p></div></div></div></div><p></p>
<br><div><h3 class="jobSectionHeader"><b>About UST</b></h3>
<div>UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world&rsquo;s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients&rsquo; organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact&mdash;touching billions of lives in the process.</div></div>

Lead II - Data Engineering

Peoplelogic

<div>Specialist Software Engineer - Data Engineer (Spark, Scala, PySpark)<br>
Missions<br>
<br>
<ul><li>Work with big data technologies, including Hadoop, Hive, and Spark, to process and</li></ul>
<br>
<ul><li>Collaborate with cross-functional teams to gather requirements and implement solutions</li></ul>
<br>
<ul><li>Key Responsibilities:</li></ul>
<br>
analyze large datasets.<br>
<br>
<br>
that meet business needs.<br>
<br>
<br>
<ul><li>Participate in all phases of the software development lifecycle, including planning,</li></ul>
<br>
<ul><li></li></ul>
<br>
development, testing, and deployment.<br>
<br>
Implement CI/CD pipelines using tools like Jenkins to automate build, test, and<br>
deployment processes.<br>
<br>
<br>
<ul><li>Adapt quickly to new technologies and methodologies, demonstrating a continuous</li></ul>
<br>
learning mindset.<br>
<br>
<br>
<ul><li>Troubleshoot and resolve issues in production and development environments.</li></ul>
<br>
<ul><li>Hands on experience in cloud (ex: Azure, AWS)</li></ul>
<br>
Profile<br>
Job Description:<br>
We are seeking a talented and motivated Software Engineer with expertise in big data<br>
technologies to join our dynamic team. The ideal candidate must have a strong background in<br>
big data frameworks such as Hadoop, Hive, and Spark, and a passion for delivering high-quality<br>
software solutions in an agile environment.<br>
Engineer with 5+ years of experience in software development<br>
Primary skills:<br>
<br>
<ul><li>Hands on experience in Spark, Pyspark, Hadoop, HDFS, Hive.</li></ul>
<br>
<ul><li>CI/CD and DevOps practices - Jenkins, Maven, GIT</li></ul>
<br>
<ul><li>Tools: GITHUB, SONARQUBE</li></ul>
<br>
Secondary skills<br>
<br>
<ul><li>Working in Agile setup</li></ul>
<br>
<ul><li>JFrog artifactory</li></ul></div>

Specialist Software Engineer - Data Engineer

<div><p>Company Profile:<br>
Founded in 1976, CGI is among the largest independent IT and business consulting services firms in the world. With 94,000 consultants and professionals across the globe, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business consulting to systems integration, managed IT and business process services and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68 billion and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more at cgi.com.<br>
<br>
Position: Lead ETL Developer (Databricks, Kimball, Power BI, MS Fabric)<br>
Experience: 6-8 years<br>
Category: Software Development/ Engineering<br>
Shift Timing: 12:00 PM to 10:00 PM<br>
Location: Chennai /Bangalore/Hyderabad/Pune/Mumbai<br>
Position ID: J1125-1344<br>
Employment Type: Full Time<br>
<br>
The ETL Lead Developer will be responsible for designing, developing, and implementing robust and scalable data architectures and ETL solutions. This role requires deep expertise in Databricks for data processing and Lakehouse architecture, Kimball dimensional modelling for data warehousing, and Power BI and Microsoft Fabric for data visualization and analytics platform implementation. As a Lead ETL Developer, you will lead the design and implementation of scalable, secure, and high-performance data solutions using the Databricks Lakehouse Platform. You will work with ETL Architects to define architectural standards, guide engineering teams, and collaborate with stakeholders to align data strategies with business goals. Your role will focus on leveraging Databricks' unified analytics capabilities to build enterprise-grade data platforms that support advanced analytics, machine learning, and real-time data processing.</p><p><b>
Your future duties and responsibilities</b></p><p>
Develop and own the end-to-end architecture of data platforms built on Databricks, including ingestion, transformation, storage, and consumption layers.<br>
. Develop and maintain data models, data flow diagrams, and other architectural documentation based on Kimball dimensional modelling principles.<br>
. Design and implement end-to-end data architectures leveraging Microsoft Fabric's capabilities ( Embedded Power BI integration/ implementation).<br>
. Design and implement Lakehouse architectures using Delta Lake, Unity Catalog, and structured streaming.<br>
. Proven expertise in implementing data governance using Unity Catalog, including fine-grained access control, column-level lineage, data classification, audit logging, and centralized metadata management across workspaces and cloud environments<br>
. Develop scalable ETL/ELT pipelines using Apache Spark, PySpark, and Databricks Workflows.<br>
. Development of integration of Databricks with enterprise systems such as data catalogs, data quality frameworks, ML platforms, and BI tools.<br>
. Design and development of high-performance reporting models and paginated reports, configurable inquiries and interactive dashboards using Power BI.<br>
. Guide and implement teams in implementing CI/CD pipelines, version control, and automated testing for Databricks notebooks and jobs.<br>
. Provide technical leadership in performance tuning, cost optimization, and cluster configuration.<br>
. Participate in architectural reviews, code audits, and mentoring sessions to ensure adherence to standards and scalability.<br>
. Provide technical leadership and guidance to data engineers and developers.<br>
. Collaborate closely with clients, business stakeholders, and internal teams to translate business requirements into technical solutions.<br>
. Stay current with Databricks innovations and advocate for adoption of new features and capabilities.</p><p><b>
Required qualifications to be successful in this role</b></p><div>
Education Qualification: Bachelor&rsquo;s degree in computer science or related field or higher with minimum 5 years of relevant experience.<br>
<br>
Must to have Skills-<br>
<br>
6+ of experience in data architecture and engineering, with 5+ years in Databricks and Apache Spark. Strong proficiency in SQL &amp; DAX<br>
. Experience of migrating Snowflake and other custom EDW/ ETL solutions to Databricks.<br>
. Experience of migrating different reporting solutions like Cognos, SAP BO etc to Power BI and Databricks.<br>
. Deep knowledge and practical experience with Kimball dimensional modelling and data warehousing concepts and temporal data structures.<br>
. Expertise in designing and deploying ETL/ELT pipelines for large-scale data integration.<br>
. Proficiency in Power BI for paginated report and dashboard development, including DAX.<br>
. Deep expertise in Delta Lake, structured streaming, PySpark, and SQL.<br>
. Strong understanding of Lakehouse architecture, data mesh, and modern data stack principles.<br>
. Experience with Unity Catalog, Databricks Repos, Jobs API, and Workflows.<br>
. Proven ability to design and implement secure, governed, and highly available data platforms.<br>
. Familiarity with cloud platforms (Azure, AWS, GCP) and their integration with Databricks.<br>
. Experience with CI/CD, DevOps, and infrastructure-as-code tools (Terraform, GitHub Actions, Azure DevOps).<br>
. Knowledge of machine learning lifecycle, MLflow, and model deployment strategies.<br>
. An understanding of E-R data models (conceptual, logical, and physical).<br>
. Understanding of advanced data warehouse concepts is required<br>
. Strong analytical skills, including a thorough understanding of how to interpret customer business requirements and translate them into technical designs and solutions.<br>
. Strong communication skills both verbal and written. Capable of collaborating effectively across a variety of IT and Business groups, across regions, roles and able to interact effectively with all levels.<br>
. Strong problem-solving skills. Ability to identify where focus is needed and bring clarity to business objectives, requirements, and priorities.<br>
<br>
Must to Have :<br>
<ul><li>Azure Databricks, Databricks Lakehouse Architecture</li><li>ETL / ELT, Data Architecture</li><li>Apache Spark / PySpark, Delta Lake, Delta Live Tables (DLT)</li><li>Unity Catalog, Medallion Architecture</li><li>Dimensional Modeling (Star &amp; Snowflake), Kimball, Data Vault</li><li>Slowly Changing Dimensions (SCD Types 1, 2, 3)</li><li>Data Governance, RBAC, Data Lineage, Metadata Management</li><li>CI/CD &amp; DevOps (Azure DevOps, GitHub Actions, Terraform)</li><li>SQL, Power BI, Self-Service Analytics, Semantic Model, Paginated Reports</li><li>Data Quality (Great Expectations), Performance Tuning, Cost Optimization</li><li>Cloud Platforms (Azure, AWS, GCP), Azure Data Factory, Synapse, Event Hubs</li></ul><br>
Nice-to-Have Skills:<br>
<ul><li>Streaming frameworks (Kafka, Event Hubs), workspace automation</li><li>Advanced data modeling for Finance, Performance Budgeting, HRM systems</li><li>Subject-area models for financial reporting, workforce analytics, payroll insights</li><li>Delta Change Data Feed (CDF) and real-time data marts</li><li>Certifications:
</li></ul>o Databricks Certified Data Engineer Associate / Professional<br>
o Databricks Certified Associate Developer for Apache Spark<br>
o Azure / Power BI certifications<br>
<br>
CGI is an equal opportunity employer. In addition, CGI is committed to providing accommodation for people with disabilities in accordance with provincial legislation. Please let us know if you require reasonable accommodation due to a disability during any aspect of the recruitment process and we will work with you to address your needs</div><p><b>
Together, as owners, let&rsquo;s turn meaningful insights into action.</b><br>
<br>
Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you&rsquo;ll reach your full potential because&hellip;<br>
<br>
You are invited to be an owner from day 1 as we work together to bring our Dream to life. That&rsquo;s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company&rsquo;s strategy and direction.<br>
<br>
Your work creates value. You&rsquo;ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.<br>
<br>
You&rsquo;ll shape your career by joining a company built to grow and last. You&rsquo;ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
<br>
<br>
Come join our team&mdash;one of the largest IT and business consulting services firms in the world.</p></div>

Lead Analyst - Azure Data Brick with ETL and Power BI

DataEconomy

<div><div><h3 class="jobSectionHeader"><b>Job Information</b></h3>
<ul><div><p>Date Opened</p>
<div>11/25/2025
</div></div><div><p>Job Type</p>
<div>Full time
</div></div><div><p>Industry</p>
<div>IT Services
</div></div><div><p>City</p>
<div>Hyderabad
</div></div><div><p>State/Province</p>
<div>Telangana
</div></div><div><p>Country</p>
<div>India
</div></div><div><p>Zip/Postal Code</p>
<div>500081
</div></div></ul></div><div><h3 class="jobSectionHeader"><b>About Us</b></h3>
<div><div>About DATAECONOMY: We are a fast-growing data &amp; analytics company headquartered in Dublin with offices inDublin, OH, Providence, RI, and an advanced technology center in Hyderabad,India. We are clearly differentiated in the data &amp; analytics space via our suite of solutions, accelerators, frameworks, and thought leadership.</div><br>
</div><p></p><h3 class="jobSectionHeader"><b>Job Description</b></h3>
<div><p><b>Job Title:</b> PySpark Data Engineer<br>
<b>Experience:</b> 6+ Years<br>
<b>Location:</b> Hyderabad/ Pune<br>
<b>Employment Type:</b> Full-Time</p><p></p><p><b><br>
Job Summary:</b></p><p><br>
We are looking for a skilled and experienced <b>PySpark Data Engineer</b> to join our growing data engineering team. The ideal candidate will have 6+ years of experience in designing and implementing data pipelines using <b>PySpark</b>, <b>AWS Glue</b>, and <b>Apache Airflow</b>, with strong proficiency in <b>SQL</b>. You will be responsible for building scalable data processing solutions, optimizing data workflows, and collaborating with cross-functional teams to deliver high-quality data assets.</p><div></div><h3 class="jobSectionHeader"><b><br>
Requirements</b></h3><p><b>
Key Responsibilities:</b></p><br>
<ul><li>
Design, develop, and maintain large-scale <b>ETL pipelines</b> using <b>PySpark</b> and <b>AWS Glue</b>.<br>
</li><li>
Orchestrate and schedule data workflows using <b>Apache Airflow</b>.<br>
</li><li>
Optimize data processing jobs for performance and cost-efficiency.<br>
</li><li>
Work with large datasets from various sources, ensuring data quality and consistency.<br>
</li><li>
Collaborate with Data Scientists, Analysts, and other Engineers to understand data requirements and deliver solutions.<br>
</li><li>
Write efficient, reusable, and well-documented code following best practices.<br>
</li><li>
Monitor data pipeline health and performance; resolve data-related issues proactively.<br>
</li><li>
Participate in code reviews, architecture discussions, and performance tuning.</li></ul><div></div><h3 class="jobSectionHeader"><b><br>
Requirements</b></h3><div><br>
<ul><li>
6+ years of experience in <b>data engineering</b> roles.<br>
</li><li>
Strong expertise in <b>PySpark</b> for distributed data processing.<br>
</li><li>
Hands-on experience with <b>AWS Glue</b> and other AWS data services (S3, Athena, Lambda, etc.).<br>
</li><li>
Experience with <b>Apache Airflow</b> for workflow orchestration.<br>
</li><li>
Strong proficiency in <b>SQL</b> for data extraction, transformation, and analysis.<br>
</li><li>
Familiarity with data modeling concepts and data lake/data warehouse architectures.<br>
</li><li>
Experience with version control systems (e.g., Git) and CI/CD processes.<br>
</li><li>
Ability to write clean, scalable, and production-grade code.</li></ul></div><div></div><h3 class="jobSectionHeader"><b><br>
Benefits</b></h3><div>
As per company standards.</div></div></div></div><p></p>

Lead/ Sr. Pyspark Data Engineer

L&T Technology Services

<div>
 <p>
  <strong>
   <u>
    Engineer (SQL, PySpark and Python)
   </u>
  </strong>
 </p>
 <p>
  Location: Bangalore
 </p>
 <p>
  Exp: 2-3 yrs
 </p>
 <p>
  <br/>
 </p>
 <p>
  Skills:
 </p>
 <ul>
  <li>
   Proficiency in
   <strong>
    SQL, PySpark and Python
   </strong>
   for data extraction and transformation
  </li>
  <li>
   Strong experience with
   <strong>
    dashboard development
   </strong>
   and
   <strong>
    data visualization tools
   </strong>
  </li>
  <li>
   Hands-on experience with the
   <strong>
    Skywise/Palantir Foundry platform
   </strong>
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  Good-to-Have:
 </p>
 <ul>
  <li>
   Familiarity with HTML, CSS, JavaScript, Google Apps Script and dashboard customization
  </li>
  <li>
   Understanding of aviation domain data (BITE).
  </li>
  <li>
   Avionics Knowledge as well
  </li>
 </ul>
 <p>
  <br/>
 </p>
</div>


Engineer

Explore 820+ Pyspark developer in Bangalore Jobs In Test Jobs In Mangaluru this December. Find roles across top companies and apply now to boost your career.