data solutions engineer

Higher Logic

<p></p><div><p><b>About Higher Logic:</b></p>
<p>
Higher Logic exists to connect people, knowledge, and ideas to improve lives and organizations. Through our community solutions, we empower growth-stage businesses and associations to build a more engaged and meaningful relationship with their customers and members. Higher Logic serves more than 3,000 customers, representing over 350,000 online communities with greater than 200 million users in more than 42 countries worldwide.</p>
<p>
Our team is a thriving community of authentic people with diverse experiences and perspectives. We are honest and genuine and believe that sharing ideas and feedback openly helps us to be successful. We believe that diversity and empathy bring us #AllTogether to make us stronger. We learn from failure and successes because both help us to grow and learn. We strive to understand the why behind our actions and bring our best selves to work every day.</p>
<p><b>
JOB SUMMARY</b></p>
<p>
The Data Solutions Engineer supports Higher Logic's strategic data initiatives by designing, developing, and scaling data pipelines and models that enable analytics, business intelligence, and AI workflows, using both structured and unstructured data. This role is critical in building our data warehouse and enabling AI capabilities across the organization and reports directly to the Chief Data Officer. The engineer works closely with internal stakeholders across departments to ensure data is reliable, accessible, and actionable for both operational and strategic use.</p>
<p>
Help design and build the next generation of our data platform. You'll play a key role in architecting scalable, performant, and governed data systems that power analytics, marketing automation, and customer insights across thousands of clients.<br>
Our environment spans <b>AWS</b>, <b>Databricks</b>, and <b>Power BI</b>, with data flowing continuously from multiple operational systems (AMS, CRM, LMS, events, behavioral streams) into a modern lakehouse architecture. If you thrive at the intersection of data engineering, architecture, and governance &mdash; this is the role for you.</p><br>
<p></p>
<p>
ESSENTIAL DUTIES AND RESPONSIBILITES:</p>
<p></p>
<ul><li><b>Architect and build</b> new data pipelines and lakehouse patterns to handle <b>~1 TB/day</b> of streaming and batch data.</li>
<li>Establish <b>data governance and lineage foundations</b>, designing systems that make data <b>traceable from source through warehouse and back</b> into our platforms.</li>
<li>Build and optimize pipelines that power <b>both analytics (Power BI)</b> and <b>operational workloads (e.g., marketing automation)</b>.</li>
<li>Design performant <b>warehouse schemas</b> and ETL/ELT processes for analytical and reverse ETL use cases.</li>
<li>Lead <b>performance and cost optimization</b> initiatives across Glue, Databricks, and S3.</li>
<li>Implement <b>data quality, documentation, and testing frameworks</b> using <b>dbt</b>.</li>
<li>Develop infrastructure as code using <b>Terraform</b> and automate deployments through <b>GitHub Actions</b>.</li>
<li>Partner closely with analysts, platform teams, and business stakeholders to <b>enable data visibility, traceability, and self-service analytics</b>.</li>
<li>Act as a <b>senior member of the data team</b>, setting best practices, mentoring others, and helping shape the data platform's future.</li>
</ul>
<p>KNOWLEDGE AND ABILITIES REQUIRED:</p>
<p></p>
<ul><li>5+ years of experience in <b>data engineering</b>, including <b>architecting scalable data platforms</b> in AWS.</li>
<li>Deep hands-on experience with <b>S3</b>, <b>Glue</b>, <b>Databricks</b>, <b>Postgres/MSSQL</b>, and <b>streaming pipelines</b>.</li>
<li>Strong background in <b>data modeling</b>, <b>warehouse performance tuning</b>, and <b>ELT patterns</b>.</li>
<li>Demonstrated experience implementing <b>data governance</b>, <b>quality frameworks</b>, and ideally designing <b>lineage systems</b>.</li>
<li>Proficiency with <b>Terraform</b> and CI/CD (GitHub Actions) for data infrastructure.</li>
<li>Excellent communication skills &mdash; able to translate business needs into data architecture.</li>
<li>Comfortable operating as a <b>senior team member</b> in a growing data org, influencing architecture and mentoring others.</li>
</ul>
<p>Nice to haves:</p>
<p></p>
<ul><li>Experience with tools like <b>OpenMetadata</b>, <b>DataHub</b>, or <b>Collibra</b> for lineage and cataloging.</li>
<li>Exposure to <b>reverse ETL</b> patterns and marketing automation platforms.</li>
<li>Certifications in <b>AWS Data</b>, <b>Databricks</b>, or related fields.</li>
<li>Experience in multi-tenant or high-scale SaaS environments.</li></ul><br>
<p></p>
<p></p>
<p></p><p>-</p>
<p><b>
You'll earn:</b></p>
<ul>
<li>Competitive compensation.</li>
<li>Comprehensive health benefits package.</li>
<li>401(k) plan with employer match.</li>
<li>Healthcare and dependent-care flexible spending account.</li>
<li>Company short-term and long-term disability insurance.</li>
<li>Company culture that recognizes its employees.</li>
<li>Room for growth and development and management that cares about your professional growth and will help you achieve your goals.</li>
<li>Significant advancement opportunities for outstanding performers.</li></ul></div><p></p>

Data Solutions Engineer

Accenture

<p><b>Project Role : </b>Data Engineer<br>
<b>Project Role Description : </b>Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
<br>
<b>Must have skills : </b>Python (Programming Language)<br>
<b>Good to have skills : </b>NA<br>
Minimum <b>3</b> year(s) of experience is required<br>
<b>Educational Qualification : </b>15 years full time education<br>
<br>
Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to effectively migrate and deploy data across various systems. You will collaborate with cross-functional teams to understand data requirements and contribute to the overall data strategy of the organization, ensuring that data is accessible and reliable for decision-making purposes. Roles &amp; Responsibilities: - Expected to perform independently and become an SME. - Required active participation/contribution in team discussions. - Contribute in providing solutions to work related problems. - Develop and optimize data pipelines to enhance data processing efficiency. - Collaborate with data scientists and analysts to understand data needs and provide necessary support. Professional &amp; Technical Skills: - Must To Have Skills: Proficiency in Python (Programming Language). - Strong understanding of data structures and algorithms. - Experience with ETL tools and data integration techniques. - Familiarity with database management systems and SQL. - Knowledge of data quality frameworks and best practices. Additional Information: - The candidate should have minimum 3 years of experience in Python (Programming Language). - This position is based at our Gurugram office. - A 15 years full time education is required.</p>
<br>
15 years full time education

Data Engineer

NatWest Group

<p></p><div><p>Join us as a Data Engineer</p><p></p><ul><li>
This is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiences</li><li>
You&rsquo;ll be simplifying the bank by developing innovative data driven solutions, using insight to be commercially successful, and keeping our customers&rsquo; and the bank&rsquo;s data safe and secure</li><li>
Participating actively in the data engineering community, you&rsquo;ll deliver opportunities to support the bank&rsquo;s strategic direction while building your network across the bank</li><li>
We're offering this role at associate level</li></ul><p></p><h2 class="jobSectionHeader"><b>
What you'll do</b></h2><p></p><p>
As a Data Engineer, you&rsquo;ll play a key role in driving value for our customers by building data solutions. You&rsquo;ll be carrying out data engineering tasks to build, maintain, test and optimise a scalable data architecture, as well as carrying out data extractions, transforming data to make it usable to data analysts and scientists, and loading data into data platforms.</p><p></p><p>
You&rsquo;ll also be:</p><p></p><ul><li>
Developing comprehensive knowledge of the bank&rsquo;s data structures and metrics, advocating change where needed for product development</li><li>
Practicing DevOps adoption in the delivery of data engineering, proactively performing root cause analysis and resolving issues</li><li>
Collaborating closely with core technology and architecture teams in the bank to build data knowledge and data solutions</li><li>
Developing a clear understanding of data platform cost levers to build cost effective and strategic solutions</li><li>
Sourcing new data using the most appropriate tooling and integrating it into the overall solution to deliver for our customers</li></ul><p></p><h2 class="jobSectionHeader"><b>
The skills you'll need</b></h2><p></p><p>
To be successful in this role, you&rsquo;ll need a good understanding of data usage and dependencies with wider teams and the end customer, as well as experience of extracting value and features from large scale data.</p><p></p><p>
You&rsquo;ll also demonstrate:</p><p></p><ul><li>
Experience of ETL technical design, including data quality testing, cleansing and monitoring, and data warehousing and data modelling capabilities</li><li>
At least five years of experience in Oracle PL-SQL, PySpark, AWS S3, Glue, and Airflow</li><li>
Experience of using programming languages alongside knowledge of data and software engineering fundamentals</li><li>
Good knowledge of modern code development practices</li><li>
Strong communication skills with the ability to proactively engage with a wide range of stakeholders</li></ul></div><p></p>

Data Engineer Pyspark

Commonwealth Bank of Australia

<div><p><b>Organization: </b>At CommBank, we never lose sight of the role we play in other people&rsquo;s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things
</p><p></p><p><b>Job Title: </b>Staff Data Engineer
</p><p><b>Location: </b>Bangalore-Manyata Tech Park (Hybrid)
 </p><p><b>Business &amp; Team </b>: Corp tech<br>
<br>
</p><p><b>Impact &amp; contribution: </b>To ensure the Group achieves sustainable competitive advantage through data engineering, you will need to play a key role in supporting and executing the Group&rsquo;s data strategy.
</p><p></p><p>We are looking for an experienced Data Engineer to join our Financial Crimes Technology Team under Delivery Chapter Area. We are a diverse team focused on building a simpler, better bank. In your role as Staff Data Engineer, you will be required to work in a fast paced, complex, agile environment to conduct process, technical and data analysis, and design reporting solutions that will help in combating Financial Crimes.
</p><p>ply software engineering principles and practices in programming technologies and platforms to achieve business outcomes, while building out core technology and domain knowledge required to be effective.<br>
</p><p><br>
<b>Roles &amp; Responsibilities:
</b></p><ul><li>We are looking for a talented Staff Data Engineer to join our team and lead end-to-end data warehouse projects in the banking industry. This role requires a unique blend of business analysis and data engineering skills to design, develop, and implement data solutions that meet business needs. The successful candidate will be responsible for gathering and documenting requirements, conducting gap analysis, building data pipelines, and ensuring data quality and availability.
</li><li>Contribute to thought leadership enabling business and technology teams to deliver world class data centric solutions and analytics by championing sustainable and re-useable data products.
</li><li>Participate in the full lifecycle of agile projects (ideation through implementation).
</li><li>Facilitate the elicitation and capturing of data-related business requirements, documenting the current and future states to identify and recommend improvements, verification, and validation.
</li><li>Work closely with stakeholders and change management to identify impacts on business and system processes due to application changes.
</li><li>Demonstrate fair understanding of end-to-end Data Lifecycle - Data Collection and Integration, Data Storage and Management, ETL (Extract, Transform, Load) Process and Big Data Technologies and Data Governance
</li><li>Collaborate with cross-functional teams to ensure alignment of data solutions with business objectives.
</li><li>Support tasks related to business and data analysis, including data loads and reporting requirements.
</li><li>Liaise with Data Stewards and Data offices to conduct data management activities in line with Group's data governance policies and procedures.
</li><li>Adopting tools, programming languages and templates to improve our data quality and efficiency.
</li><li>Evaluate effectiveness of solution delivery (SDLC) tools, processes, and methodologies, and make recommendations for continuous improvement.
</li><li>Enables, motivates, directs, and continuously develops a committed, empowered, and high-performing team.
</li><li>Work closely with the delivery team to ensure that the solution being developed meets business objectives.
</li><li>Complete project work stream deliverables including quality control/sign off for area of accountability.
</li><li>Provide support and participate in testing activities including unit testing, BA testing, system testing and Business Verification Testing ensuring adequate project coverage.
</li><li>Identify project delivery issues and risks, assist with mitigation strategies, and escalate where necessary.
</li><li>Provide on-going assistance to support teams for functionality released into production.
</li><li>Provide technical assistance to other members of the team.
</li>Apply agile methodology throughout day-to-day tasks.<br>
<li>
</li></ul><p><br>
<br>
<b>Essential Skills:
</b></p><ul><li>Minimum 9-11 years of experience.
</li><li>Demonstrated experience in Spark, AWS and ETL.
</li><li>Comfortable in scripting, data manipulation and automation
</li><li>Good understanding of Data Collection and Integration, ETL (Extract, Transform, Load) Process, Data Management, Data Governance principles.
</li><li>Jira and Confluence, Release train and Big Room Planning experience.
</li><li>Awareness of the various technology Platforms and ability to perform data mapping.
</li><li>Expert in Agile ways of working.
</li><li>A natural ability to effectively communicate, educate and influence the different stakeholders/ peers, to solve challenging problems, while working in collaboration with other cross-functional engineering and solution design teams
</li><li>A positive desire to contribute towards initiatives, along with a strong &lsquo;can-do&rsquo; attitude in juggling between constantly changing priorities.
</li><li>Demonstrated experience in delivering data solutions and querying data warehouses is highly desirable.
</li><li>Convert business needs into functional designs using knowledge of data warehousing and Big Data architecture and processes.
</li><li>Perform data analysis to extract meaningful insights and support decision-making processes.
</li><li>Develop and maintain documentation for data processes, systems, and workflows.
</li><li>Strong communication and interpersonal skills to work effectively with stakeholders.
</li><li>Ability to work independently and as part of a team in a fast-paced environment.
</li></ul><div></div><ul><li>Familiarity with Big Data and cloud Technologies
</li></ul><p></p><p><b>Education Qualifications: </b>Bachelor of Engineering (Computer Science, Information technology) or equivalent
</p><p></p><div><div><div><div><div><div><div><p>If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We&rsquo;re keen to support you with the next step in your career.
</p><p></p><p>We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.
</p></div></div></div></div></div></div></div><p></p>Advertising End Date: 14/11/2025</div>

Staff Data Engineer

Kraft Heinz

<p></p><div><div><div><div><div><div><div><div><div><ul><div><b>All Posting Locations:</b> Ahmedabad, Gujarat, IN
</div><div><b>Job Functions:</b> Global Business Services</div>
<div><b>Date Published:</b> October 23, 2025</div>
<div><b>Ref#:</b> R-97553</div></ul><div></div><div><br>
</div></div></div></div></div></div></div></div></div><p></p><div><div><div><div><div><div>ABOUT THE ROLE</div></div><div><div>
Job Description</div>
<div>GBS Analytics COE &ndash;Data Engineer<br>
About the Position<br>
We have an excellent opportunity available for a Data Engineer to make a difference at Kraft Heinz. The Data Engineer role lies within the newly created Analytics Centre of Excellence within the Global Business Services organization. The Analytics COE has been set up to build, maintain and enhance analytical products for our business to generate actionable insights from data and make better informed decisions. The individual for this position will be a technical expert providing leadership and expertise in the areas of data management, data quality, data governance, and data engineering. They will provide hands-on design, preparation, and development of data solutions for analytical products. They will work with internal stakeholders to translate business problems into data requirements and then create the data solutions to enable the development of analytical tools.<br>
Key Responsibilities<br>
<ul><li>Design, deliver and maintain the appropriate data solution to provide the correct data for analytical development to address key issues within the organization.</li><li>Gather detailed data requirements and collaborate with a cross-functional team to deliver high quality results (such as Tableau developers, analysts, business users).</li><li>Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions.</li><li>Contribute to generic frameworks for data ingestion, data processing, and data integrations per business requirements.</li><li>Extend DevOps capabilities for deploying data solutions.</li><li>Supports creation and adoption of data assets for the organization, putting data quality as the focus of all data solutions.</li><li>Act as a data owner and functional data SME for the assigned area.</li></ul>
&bull; Lead the coaching of all junior data engineering resources. &bull; Ensure effective and timely delivery of project work, raising issues and risks in a timely manner to project manager to ensure appropriate actions can be taken to mitigate. &bull; Ensure effective and timely delivery of project work. &bull; Enforce best practices for data design, architecture, and implementation.<br>
Qualifications &amp; Experience<br>
<ul><li>Bachelor&rsquo;s Degree or higher in Computer Science, Statistics, Business, Information Technology, or related field (Master&rsquo;s degree preferred)</li><li>5+ years of experience in delivering and supporting data engineering capabilities and building enterprise data solutions and data assets</li><li>Strong experience with cloud services within Azure, AWS, or GCP platforms (preferably Azure)</li><li>Strong experience with analytical tools (preferably SQL, dbt, Snowflake, BigQuery, Tableau)</li><li>Experience with design and software programming development (preferably Python, Javascript and/or R)</li><li>Experience building APIs (experience with GraphQL is a plus)</li><li>Hands-on experience with DevOps and CI/CD processes</li><li>Experience in Agile methodologies (certifications preferred)</li><li>Project management experience and strong communication skills</li><li>Self-Starter, driven with high business process acumen</li><li>Team Player with a positive attitude and ability to work across different business stakeholder and technical teams to accomplish complex tasks</li></ul>
Professional Attributes<br>
<ul><li>Communication Skills</li></ul>
o At Kraft Heinz you&rsquo;ll easily be exposed to senior management, no matter your level. Therefore, it&rsquo;s important you have excellent communication skills, to deal with all kinds of different stakeholders. &bull; Analytical o We&rsquo;re a very data driven company. You know how to translate complex data into a simple solution with your analytical mindset.<br>
<ul><li>Curiosity, positivity &amp; enthusiasm</li></ul>
o You&rsquo;re curious, positive and enthusiastic. People know you as the driver of the team.<br>
<ul><li>Project management skills</li></ul>
o Time management has no secrets for you. You&rsquo;re organized, structured and always have an overview of all the deliverables. You know how to bring multiple projects to a successful ending within the given timeframe.<br>
<ul><li>Team player</li></ul>
o Achieving results is nice, but achieving results with the team is simply the best. You&rsquo;re a team player, which means you&rsquo;re sometimes a leader, sometimes a follower but always working towards the same common goal together with your teammates.<br>
What we offer you<br>
<ul><li>An ambitious employer; we only want to the best for you;</li><li>A fast career track like only few other companies can match;</li><li>A competitive salary</li><li>Always room for new ideas; if you have an excellent idea, please let us know and we can set it in action!</li></ul></div>
<div>Location(s)</div>
<p>Ahmedabad &ndash; Mondeal Heights &ndash; GBS Center</p><p><br>
</p><p><b>Kraft Heinz is an Equal Opportunity Employer &ndash; Underrepresented Ethnic Minority Groups/Women/Veterans/Individuals with Disabilities/Sexual Orientation/Gender Identity and other protected classes</b><b>.</b></p></div></div></div></div></div></div>

Data Engineer I, Global GBS - DIPP

Johnson Controls

<div><p><b>Job Title:</b> Data Engineer</p><p><b>
Location:</b> Pune, Maharashtra, India</p><p><b>
Experience:</b> 4+ Years</p><p><b>
Job Description:</b></p><p>
Johnson Controls is seeking an experienced Data Engineer responsible for designing, implementing, and managing data solutions. The successful candidate will work closely with data architects, analysts, and stakeholders to ensure data is integrated efficiently for reporting and analytics purposes.</p><p><b>
How you will do it:</b></p><ul><li>
Deploy data ingestion processes using Azure Data Factory to load data models into Azure Synapse.</li><li>
Build, design, and support ETL/ELT processes with Azure Data Factory (ADF) and/or Python.</li><li>
Conduct data analysis using SQL and other tools to extract insights from datasets.</li><li>
Collaborate with stakeholders to understand data requirements and translate them into analytical solutions.</li><li>
Assemble datasets that meet functional business requirements.</li><li>
Maintain data models and manage DevOps pipeline deployments.</li><li>
Support data governance to enhance data quality.</li></ul><p><b>
What are we looking for?</b></p><ul><li>
Bachelor&rsquo;s degree in Engineering, Computer Science, Data Science, or a related field.</li><li><b>
4+ years of relevant experience</b> in data engineering, software engineering, or a similar role.</li><li><b>
Strong SQL knowledge</b> and experience with relational databases (SQL Server, Oracle, Azure SQL, etc.).</li><li>
Experience with ETL/ELT processes, data quality, and data modeling.</li><li>
Proficiency in Python for data manipulation and analysis.</li><li>
Ability to solve ETL/ELT problems with tactical/strategic solutions.</li><li>
Project management and organizational skills.</li><li>
Excellent communication skills and the ability to work collaboratively.</li></ul></div>

Sr. Software Developer Data solutions

Fiftyfive technologies

<div></div><div><h3 class="jobSectionHeader"><b>About the Role:</b></h3><div>
We are looking for an experienced <b>Senior Data Engineer</b> with strong hands-on expertise in <b>Azure Data Services</b>, particularly <b>Azure Databricks</b>. The ideal candidate will be responsible for building robust, scalable, and high-performance data solutions to support business analytics and insights. <b>Databricks certification</b> is highly preferred.</div><h3 class="jobSectionHeader"><b>
Key Responsibilities:</b></h3><ul><li>
Design, develop, and maintain <b>data pipelines</b> and <b>ETL/ELT workflows</b> using <b>Azure Data Factory</b> and <b>Azure Databricks</b>.</li><li>
Build and optimize <b>data lake</b> and <b>data warehouse</b> architectures on Azure.</li><li>
Implement efficient <b>data ingestion</b>, <b>transformation</b>, and <b>cleansing</b> processes from diverse sources.</li><li>
Develop and tune <b>PySpark/SparkSQL</b> code for large-scale data processing.</li><li>
Ensure <b>data quality</b>, <b>lineage</b>, and <b>security compliance</b> across all layers.</li><li>
Collaborate with data analysts, scientists, and business stakeholders to enable data-driven decision-making.</li><li>
Optimize cost and performance of data solutions in the <b>Azure cloud environment</b>.</li></ul><h3 class="jobSectionHeader"><b>
Technical Skills Required:</b></h3><ul><li><b>
Mandatory:</b></li><li>
Azure Databricks (<b>hands-on, advanced level</b>) &ndash; <i>Databricks Certification preferred</i></li><li>
Azure Data Factory (ADF)</li><li>
Azure Data Lake Storage (ADLS)</li><li>
Azure Synapse Analytics / SQL Data Warehouse</li><li>
Proficiency in <b>PySpark</b>, <b>SQL</b>, and data modeling</li><li><b>
Good to Have:</b></li><li>
Experience with <b>Delta Lake</b>, <b>Power BI</b>, or <b>Azure DevOps CI/CD pipelines</b></li><li>
Scripting experience in <b>Python</b> or <b>Scala</b></li><li>
Exposure to <b>data governance, monitoring, and optimization</b></li></ul><h3 class="jobSectionHeader"><b>
Qualifications:</b></h3><ul><li>
Bachelor&rsquo;s or Master&rsquo;s in Computer Science, Information Technology, or a related field.</li><li>
4&ndash;7 years of proven experience in <b>data engineering</b>, specifically within the <b>Azure ecosystem</b>.</li><li><b>
Azure Databricks certification</b> is a strong plus.</li></ul><h3 class="jobSectionHeader"><b>
What We&rsquo;re Looking For:</b></h3><ul><li>
Excellent analytical and problem-solving mindset.</li><li>
Strong communication and collaboration skills.</li><li>
Self-motivated and capable of delivering in fast-paced environments.</li></ul><div>
Let me know if we have any queries in this</div><div>
 Everyone As discussed in morning first complete your sourcing for our existing positions and create a pipeline, then start working on this</div></div><div></div>

Azure Data Engineer

Search 10000+ Data solutions engineer jobs near you this October. New roles added regularly across leading industries. Apply today.