senior data engineer

Immersion Consulting, LLC

<div>Description:

The Senior Data Engineer is responsible for designing, implementing, maintaining, and optimizing a cloud-based data architecture and data pipeline ecosystem. The position supports advanced analytics, machine learning operations, fraud detection initiatives, and investigative activities by delivering scalable, secure, and sustainable Azure-based data solutions. The Senior Data Engineer develops and maintains modern ELT/ETL pipelines, data models, source-controlled environments, and operational standards that enable efficient data ingestion, processing, storage, and access.<ul><li>
Design, implement, and maintain scalable Azure-based data architecture supporting audits, investigations, and fraud analytics.</li><li>
Develop, optimize, and sustain ELT/ETL pipelines within Azure Synapse Analytics and Azure Machine Learning environments.</li><li>
Migrate and integrate large-scale datasets into Azure Data Lake Storage (ADLS).</li><li>
Establish source control, version management, and development standards across data engineering assets.</li><li>
Implement pipeline monitoring, validation, logging, and error-handling frameworks.</li><li>
Design and maintain data models, data dictionaries, entity relationship diagrams, and architectural documentation</li><li>
Optimize ingestion, transformation, storage, and retrieval performance across diverse data sources and formats.</li><li>
Develop self-service data access capabilities for analysts and investigators.</li><li>
Collaborate with Data Scientists to ensure infrastructure effectively supports machine learning and AI initiatives.</li><li>
Author and maintain Standard Operating Procedures (SOPs) governing data pipeline development, deployment, and monitoring.</li><li>
Evaluate emerging AI-enabled engineering tools and LLM-assisted automation capabilities.</li><li>
Recommend and implement architectural improvements that increase efficiency, reliability, security, and cost effectiveness.</li></ul>
Requirements:
<ul><li>Bachelor's degree in Data Engineering, Computer Science, Data Science, Machine Learning, Mathematics, or related discipline; or 5 years of relevant applied experience.</li><li>
Five or more years of experience maintaining SQL database environments and performing advanced SQL/T-SQL operations.</li><li>
Five or more years of experience designing and maintaining cloud-based ELT/ETL solutions.</li><li>
Three or more years of experience working with Azure Synapse Analytics and Azure Machine Learning.</li><li>
Three or more years of experience developing data solutions using Python and Pandas.</li><li>
Experience supporting modern data platforms and cloud-native analytics architectures.</li><li>
Demonstrated expertise in data architecture design, pipeline optimization, and operational support.</li></ul></div>

Senior Data Engineer

<div>540 is seeking a Senior Data Engineer to support a mission-critical technology modernization effort for the Department of War. You will lead the design and evolution of Databricks-based data pipelines and lakehouse capabilities that enable secure data integration, analytics, AI/ML, and operational workloads at enterprise scale.

Working with engineers, architects, cybersecurity teams, and mission stakeholders, you will translate complex requirements into secure, scalable solutions using Databricks, Apache Spark, and Delta Lake. You will define engineering standards, guide technical delivery, and mentor engineers while ensuring data quality, governance, and platform reliability.

Location: Arlington, VA 
Citizenship &amp; Clearance Requirement: Per client requirements, candidates must be U.S. Citizens with an active DoW Secret (or higher) clearance 
Education Requirement: Bachelor's degree in Computer Science, Engineering, or a related technical field preferred; equivalent combinations of education and relevant experience will be considered 
540 Internal Thrive Level: Senior Data Engineer

WHY 540?

540 is a forward-thinking company that the government turns to in order to #getshitdone. We don't just talk about innovation &ndash; we deliver it. We break down barriers, build impactful technology, and solve mission-critical problems.

HOW YOU'LL DRIVE IMPACT
<ul>
<li>Lead the architecture and evolution of Databricks-based data pipelines and lakehouse capabilities</li>
<li>Translate mission requirements into scalable data architectures and implementation strategies</li>
<li>Define data engineering standards, reusable patterns, and best practices across engineering teams</li>
<li>Architect automated ETL/ELT pipelines using Python, SQL, PySpark, Apache Spark, and Delta Lake</li>
<li>Design scalable data models, schemas, data contracts, and medallion architecture patterns</li>
<li>Lead the development of batch and streaming capabilities supporting operational, analytical, and AI/ML workloads</li>
<li>Establish data quality, lineage, metadata, observability, and governance practices using Unity Catalog or similar technologies</li>
<li>Optimize Databricks and Spark workloads for performance, scalability, reliability, and cost efficiency</li>
<li>Establish CI/CD, infrastructure-as-code, testing, monitoring, and operational practices for Databricks environments</li>
<li>Lead design reviews and resolve complex issues spanning data pipelines, infrastructure, and production services</li>
<li>Partner with cybersecurity teams to incorporate security, access control, auditing, and governance requirements</li>
<li>Communicate architecture decisions and mentor engineers on Databricks and data engineering best practices</li>
</ul>
REQUIRED SKILLS &amp; EXPERIENCE
<ul>
<li>9+ years of relevant data engineering or software engineering experience</li>
<li>Experience leading enterprise-scale data platform and pipeline implementations using Databricks</li>
<li>Advanced proficiency with Python, SQL, PySpark, Apache Spark, and Delta Lake</li>
<li>Experience architecting large-scale ETL/ELT, batch, and streaming pipelines</li>
<li>Experience designing lakehouse architectures, data models, schemas, and data contracts</li>
<li>Experience managing and optimizing Databricks jobs, workflows, compute resources, and Spark workloads</li>
<li>Experience implementing data quality, monitoring, lineage, metadata management, and governance capabilities</li>
<li>Experience with Unity Catalog or similar data-governance and access-control solutions</li>
<li>Experience operating Databricks within AWS, Azure, or Google Cloud</li>
<li>Experience with CI/CD, infrastructure as code, automated testing, and source control</li>
<li>Strong understanding of data security, privacy, governance, and access-control principles</li>
<li>Experience leading technical reviews, mentoring engineers, and communicating architecture decisions</li>
</ul>
NICE TO HAVE
<ul>
<li>Relevant Databricks certification</li>
<li>Experience supporting DoW, federal, Advana, or other mission data environments</li>
<li>Experience building data platforms in classified, regulated, or mission-critical environments</li>
<li>Experience with Terraform, Databricks Asset Bundles, Airflow, or similar automation and orchestration tools</li>
<li>Experience architecting streaming solutions using Kafka, Kinesis, Pulsar, or Spark Structured Streaming</li>
<li>Experience supporting AI/ML pipelines, feature platforms, or MLflow</li>
<li>Currently holds, or is willing to obtain within 30 days of employment, an approved certification such as Cloud+, GSEC, Security+, or SSCP</li>
</ul>
BENEFITS &amp; PERKS
<ul>
<li>Flexible PTO + all Federal holidays off</li>
<li>Health, dental and vision insurance plans</li>
<li>Flexible Spending Account (FSA)</li>
<li>401k with employer match</li>
<li>Company-sponsored life insurance, short- and long-term disability</li>
<li>Professional development (training, certifications, conferences)</li>
<li>Paid cloud developer accounts</li>
<li>Referral bonuses</li>
<li>HQ office perks (parking / metro reimbursement, nitro coffee &amp; lunches)</li>
<li>Annual social events (540 Week, hackathon, charity golf tournament, etc.)</li>
<li>Access to 540's Washington Capitals &amp; Nationals tickets</li>
</ul>
EQUAL EMPLOYMENT OPPORTUNITY (EEO)

540's policy is to provide equal employment opportunity to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.</div>

Capital Technology Group

<div><div>Capital Technology Group provides expert consulting services software development, digital transformation, human-centered design, data analytics and visualization, and cybersecurity.

Our multidisciplinary teams use agile methodologies to rapidly and incrementally deliver value in close collaboration with our clients. For over a decade, we have been trusted by both federal and commercial clients to solve complex, mission-critical business challenges. The quality of our work has been recognized by our partners and peers through our inclusion in the Digital Services Coalition, a group of forward- thinking firms recognized for excellence in delivering IT services.</div><div>

Client Requirements: applicants MUST BE US Citizens and be able to obtain Public Trust clearance
<h3 class="jobSectionHeader">
The CTG Experience</h3>

At Capital Technology Group (CTG), our teams are passionate about modernizing how the federal government delivers software. We partner with federal agencies to build secure, scalable, and mission-driven solutions that make a meaningful impact on millions of people. Recognized by The Washington Post as a Top Workplace in 2025 and 2026. CTG fosters a culture rooted in our core values. Our values guide how we work together and support one another, creating an environment where employees feel trusted, empowered, and encouraged to grow both personally and professionally.
<h3 class="jobSectionHeader">
About the Role</h3>

CTG is seeking a Senior Data Engineer to design, build, and maintain scalable, efficient data pipelines and systems following modern data engineering best practices. The Senior Data Engineer will partner with other Data Engineers to evaluate and prototype new tools and technologies, assessing their risks and benefits to deliver exceptional value to our clients.
<h3 class="jobSectionHeader">
You Will Get To</h3>
</div><div><ul><li>Design, build, and maintain scalable data pipelines, ETL/ELT workflows, and data models using Python, Apache Spark (PySpark), Databricks, dbt, SQL (PostgreSQL), and AWS Glue.</li>
<li>Develop and optimize AWS-native data platforms leveraging AWS Glue, Amazon EMR, Amazon MWAA (Apache Airflow), Lambda, Step Functions, Amazon S3, Redshift, RDS, DMS, and CloudWatch.</li>
<li>Build high-performance ingestion, transformation, and orchestration workflows for structured and semi-structured data using Apache Iceberg, Parquet, ORC, and Avro.</li>
<li>Design and optimize analytical data platforms using Amazon Athena, Trino, Hive, OpenSearch, and enterprise data catalog technologies.</li>
<li>Integrate enterprise and external data sources across relational and NoSQL platforms including PostgreSQL, Oracle, Redshift, GraphDB, and other NoSQL databases.</li>
<li>Build AI-enabled data solutions using Amazon Bedrock, RAG pipelines, and vector search technologies including Amazon S3 Vector and OpenSearch vector indexes.</li>
<li>Develop cloud infrastructure using CloudFormation (Infrastructure as Code), GitHub, Harness, and enterprise CI/CD pipelines while leveraging SNS, SQS, and EventBridge for event-driven architectures.</li>
<li>Improve the reliability, scalability, performance, and maintainability of enterprise data platforms through monitoring, troubleshooting, automation, and continuous optimization.</li>
<li>Support mission-critical analytics and reporting solutions within large-scale AWS-based federal data environments, implementing solutions that comply with FedRAMP and NIST 800-53 security controls.</li>
<li>Lead modernization initiatives migrating legacy platforms including IBM DataStage, Hadoop, RunDeck, and shell-based workflows to cloud-native AWS services.</li>
<li>Mentor junior engineers through technical guidance, architecture discussions, and code reviews while promoting engineering best practices.</li>
<li>Collaborate with cross-functional teams in an Agile environment to define requirements, deliver high-quality data solutions, and communicate technical concepts effectively to technical and non-technical stakeholders.</li>
</ul><div><h3 class="jobSectionHeader">Who You Are</h3>
<ul><li>A strategic data engineer who enjoys designing complex systems and solving complex challenges</li>
<li>Strong in modern cloud-based solution design</li>
<li>Comfortable balancing business needs with technical constraints and long-term strategy</li>
<li>A strong communicator</li>
<li>Collaborative, proactive, and comfortable navigating ambiguity</li>
</ul><h3 class="jobSectionHeader">Qualifications</h3>
</div></div><ul><li>Bachelor's degree in Computer Science, Engineering, or a related technical field</li>
<li>9+ years of professional experience in data engineering or related domains</li>
<li><div>Strong hands-on experience with:</div>
<ul><li>Databricks, Apache Spark (PySpark), Python, SQL (PostgreSQL), and dbt for large-scale data engineering, ETL/ELT development, data transformation, and data modeling.</li>
<li>Designing, building, and maintaining AWS-native data platforms using AWS Glue, Amazon EMR, Amazon MWAA (Apache Airflow), AWS Lambda, AWS Step Functions, Amazon S3, Amazon Redshift, Amazon RDS, AWS DMS, and Amazon CloudWatch.</li>
<li>Developing scalable data pipelines, workflow orchestration, and data integration solutions across enterprise environments.</li>
<li>Working with modern data lake technologies including Apache Iceberg and data formats such as Parquet, ORC, and Avro.</li>
<li>Designing and optimizing solutions using relational and NoSQL databases including PostgreSQL, Redshift, Oracle, GraphDB, and other NoSQL platforms.</li>
<li>Building reliable, high-performance data platforms through performance tuning, system optimization, and enterprise-scale ETL/ELT architectures.</li>
<li>Java development and modern CI/CD practices using Harness.</li>
</ul></li><li>Strong analytical and problem-solving skills</li>
<li>Experience working in agile, iterative software development environments</li>
<li>Ability to quickly learn and apply new technologies and domain knowledge</li>
<li>Excellent written and verbal communication skills, with the ability to explain complex topics to diverse audiences</li>
</ul><h3 class="jobSectionHeader">Nice to Have</h3>
<ul><li>Experience supporting analytics, data engineering, or modernization initiatives for financial regulators, capital markets, or other highly regulated environments is a plus.</li>
<li>Experience with Kafka (streaming/data pipelines)</li>
<li>Experience with Docker and Kubernetes for containerization and orchestration</li>
<li>Proficiency with Splunk for log aggregation and system monitoring</li>
<li>Experience using Terraform for infrastructure automation and management</li>
<li>Strong SQL skills, including performance tuning and complex query design</li>
</ul><h3 class="jobSectionHeader">Salary</h3>

We are committed to offering a competitive salary for this position, with an estimated range of $130k to $165k annually. Please note that this range is intended to provide a general idea of what to expect; however, the final offer may vary based on experience, skills, and other factors. The stated range is not a guarantee and is subject to change.<div> 
</div><div><div>
<h4 class="jobSectionHeader">Full Time Employee Benefits</h4>
<div><ul><li>Remote Work (Hybrid roles will be specified in the job post)</li>
<li>Competitive Compensation Package</li>
<li>Medical, Dental, and Vision</li>
<li>Life Insurance, Short/Long Term Disability</li>
<li>Employee Assistance Program</li>
<li>401(k) with 4% matching</li>
<li>Liberal PTO vacation policy</li>
<li>Generous Annual Continuing Education</li>
<li>Annual Wellness Budget</li>
<li>Bonus Incentive Programs (Employee referrals and performance-based rewards)</li>
</ul>
Thanks for your interest in Capital Technology Group!

Capital Technology Group is an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law.</div></div></div></div>

Wells Fargo

<div>About this role:
Wells Fargo is seeking a Senior Data Engineer to join the CSBB Deposits Data &amp; Insights team Technology. The Consumer Technology organization provides data technology services to the Enterprise-wide lines of businesses, functions, and leaders. Business alignment includes Enterprise Risk, Enterprise Finance, Enterprise Data Management and Insights, Human Resources, Public Affairs (including Marketing), Customer Excellence, Audit and Legal. 
 
The Senior Data Engineer will be part of the BMG Data Warehouse team within the Consumer and Small Business/Digital Data team. The BMG data warehouse supports key Deposits, Servicing, and Debit/Credit Data sets used by CSBB and other LOB business partners for reporting and analytics. The role will be responsible for providing technical expertise for solution design for medium to complex data work efforts, hands-on development, code reviews and QA for the current state BMG Data Warehouse platform. The role may also include work related to the Target State Cloud Platform Strategy, Roadmap, and Migration activities.
In this role, you will:<ul><li>
Lead moderately complex initiatives within Technology and contribute to large scale data processing framework initiatives related to enterprise strategy deliverables</li><li>
Build and maintain optimized and highly available data pipelines that facilitate deeper analysis and reporting</li><li>
Review and analyze moderately complex business, operational or technical challenges that require an in-depth evaluation of variable factors</li><li>
Oversee the data integration work, including developing a data model, maintaining a data warehouse and analytics environment, and writing scripts for data integration and analysis</li><li>
Resolve moderately complex issues and lead teams to meet data engineering deliverables while leveraging solid understanding of data information policies, procedures and compliance requirements</li><li>
Collaborate and consult with colleagues and managers to resolve data engineering issues and achieve strategic goals</li></ul> 
Required Qualifications:<ul><li>
4+ years of Data Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education</li></ul> 
Desired Qualifications:<ul><li>
4+ years of experience with Apache Spark, ETL(Ab Initio/Informatica/Data Stage), DBMS(Teradata/SQL Server), Java/Python/Scala(Programming language), Cloud essentials</li><li>
3+ years of Teradata and Unix experience</li><li>
2+ years of Data Engineering experience using Cloud Technologies, preferably with GCP &ndash; Google Cloud</li><li>
2+ years of AI technology implementations</li><li>
2+ years of experience with Agile</li><li>
2+ years of experience using Database Tools: Teradata, Load / Unload Utilities, Big Query</li><li>
Strong analytical skills with high attention to detail and accuracy</li><li>
Excellent verbal, written, and interpersonal communication skills</li><li>
Advanced SQL experience</li><li>
Advanced Microsoft Excel skills using power query</li><li>
Technical application support experience</li><li>
Ability to research, trend, analyze and model data</li><li>
Customer service focused with experience actively listening, eliciting information, comprehending customer issues/needs, and recommending solutions</li><li>
Ability to act as a liaison between the client area and technical organization</li><li>
Effective organizational, multi-tasking, and prioritizing skills</li><li>
Solid knowledge and understanding processes, procedures, and technologies</li></ul> 
Job Expectations:<ul><li>
Ability to work in a fast-paced environment</li><li>
Ability to understand business requirements and translate into data models and solutions that efficiently meet customer needs</li><li>
Works quickly and independently to meet required sprint objectives</li><li>
Actively participates in cross-team meetings and is excited to share knowledge for broader team improvement</li></ul>
Posting End Date:
2 Aug 2026<ul><li>Job posting may come down early due to volume of applicants.</li></ul>
We Value Equal Opportunity
Wells Fargo is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other legally protected characteristic.
Employees support our focus on building strong customer relationships balanced with a strong risk mitigating and compliance-driven culture which firmly establishes those disciplines as critical to the success of our customers and company. They are accountable for execution of all applicable risk programs (Credit, Market, Financial Crimes, Operational, Regulatory Compliance), which includes effectively following and adhering to applicable Wells Fargo policies and procedures, appropriately fulfilling risk and compliance obligations, timely and effective escalation and remediation of issues, and making sound risk decisions. There is emphasis on proactive monitoring, governance, risk identification and escalation, as well as making sound risk decisions commensurate with the business unit&rsquo;s risk appetite and all risk and compliance program requirements.
Candidates applying to job openings posted in Canada: Applications for employment are encouraged from all qualified candidates, including women, persons with disabilities, aboriginal peoples and visible minorities. Accommodation for applicants with disabilities is available upon request in connection with the recruitment process.
Applicants with Disabilities
To request a medical accommodation during the application or interview process, visit Disability Inclusion at Wells Fargo.
Drug and Alcohol Policy 
Wells Fargo maintains a drug free workplace. Please see our Drug and Alcohol Policy to learn more.
Wells Fargo Recruitment and Hiring Requirements:
a. Third-Party recordings are prohibited unless authorized by Wells Fargo.
b. Wells Fargo requires you to directly represent your own experiences during the recruiting and hiring process.</div>

Novanta

<div>Build a career powered by innovations that matter! At Novanta, our innovations power technology products that are transforming healthcare and advanced manufacturing&mdash;improving productivity, enhancing people&rsquo;s lives and redefining what&rsquo;s possible. We create for our global customers engineered components and sub-systems that deliver extreme precision and performance for a range of mission-critical applications&mdash;from minimally invasive surgery to robotics to 3D metal printing.
Novanta is one global team with over 26 offices located in The Americas, Europe and Asia-Pacific. Looking for a great place to work? You have found it with a culture that embraces teamwork, collaboration and empowerment. Come explore Novanta.
Summary
The Senior Data Engineer owns Novanta&rsquo;s governed transformation layer end-to-end. As a senior individual contributor, you will design and build the Snowflake transformation layer (raw staging conformed marts), migrate legacy SQL views and user-maintained dimensions into versioned, tested dbt models with full lineage, and define the conformed dimensions and operational facts that unify our multi-ERP environment across the AET and Medical Solutions segments. You will set the modeling, testing, naming, documentation, and CI/CD standards that the future Data Engineer and MDM hires on this team will inherit. This role is hands-on; you should expect to spend most of your time in dbt, SQL, and Python rather than in meetings.
About the team
Novanta&rsquo;s Corporate &amp; Shared Services team serves as a strategic partner to the company&rsquo;s global business units, providing the expertise, systems, and infrastructure that enable growth, operational excellence, and innovation. Comprised of professionals across Finance, Accounting, Human Resources, Information Technology, Legal, Compliance, Corporate Development, and Corporate Marketing, the team collaborates closely with leaders across the organization to drive business performance, support strategic initiatives, enhance employee and customer experiences, and ensure the scalability of Novanta&rsquo;s global operations
Transformation Layer Design &amp; Build<ul><li>
Design and build the transformation layer in Snowflake (raw staging conformed marts) as the governed foundation for all downstream reporting and AI/ML use cases.</li><li>
Migrate existing SQL views to dbt-style versioned, tested models with full lineage.</li></ul>
Conformed Dimensions &amp; Dimensional Modeling<ul><li>
Define conformed dimensions and operational facts across Novanta&rsquo;s multi-ERP environment using Kimball dimensional modeling principles &mdash; star schemas, surrogate keys, fact grain decisions, and SCD Type 1 and Type 2 patterns where appropriate.</li><li>
Set modeling, testing, naming, documentation, and CI/CD standards for the team, including Git workflows, code review practices, dbt project structure, model contracts, and release management.</li></ul>
BI Migration &amp; Governance<ul><li>
Partner with report owners and stakeholders to validate semantic equivalence and minimize disruption during cutover from past datasets.</li><li>
Define and own the semantic layer where applicable (Snowflake Semantic layer, dbt Semantic Layer, Power BI semantic models) so that metric definitions are consistent across BI, AI, and embedded use cases.</li><li>
Implement data quality testing, observability, and lineage (dbt tests, Elementary, or equivalent), and partner with IT Audit on SOX-relevant controls for financial data flows.</li></ul>
AI / ML &amp; Agentic Readiness<ul><li>
Design models with downstream AI/ML and agent consumption in mind: documented model contracts, stable surrogate keys, semantically clear column names, and metadata sufficient for LLM-based retrieval and tool use.</li><li>
Partner with the AI/analytics team on feature-table patterns, golden-record exposure, and the data foundations required to support emerging agentic applications across Finance, Operations, and Commercial.</li></ul>
Mentorship &amp; Team Leadership<ul><li>
Bachelor&rsquo;s degree in Computer Science, Information Systems, Data Engineering, or a related quantitative field; equivalent professional experience considered.</li><li>
7+ years in data engineering or analytics engineering, including 4+ years building production workloads on a cloud data warehouse (Snowflake strongly preferred; BigQuery, Databricks, or Redshift considered with equivalent depth).</li><li>
Expert SQL&mdash;window functions, performance tuning, and incremental load patterns at scale.</li><li>
3+ years of dbt in production (or an equivalent transformation framework), including macros, generic and singular tests, snapshots, incremental strategies, exposures, and documentation. You have designed a dbt project from scratch and maintained it in production.</li><li>
Hands-on experience with Kimball dimensional modeling &mdash; star schemas, conformed dimensions, fact grain decisions, surrogate keys, and SCD Type 1 and Type 2 patterns.</li><li>
Production experience with at least one ingestion tool (Fivetran, Airbyte, Informatica, or Matillion) and one orchestrator (dbt Cloud, Airflow, Dagster, or Azure Data Factory).</li><li>
Hands-on Git and CI/CD for data (GitHub Actions, Azure DevOps Pipelines, or GitLab CI), including code review and release management practices.</li><li>
Proficient in Python for data tooling &mdash; dbt macros, automation scripts, data quality frameworks, and lightweight API integration. You are not required to be a software engineer; you are required to write maintainable Python that solves data problems.</li><li>
Direct experience modeling data sourced from at least one major enterprise ERP (Oracle, SAP S/4HANA, SAP ECC, Microsoft Dynamics, or comparable).</li><li>
Strong written communication&mdash;able to author standards, runbooks, and documentation that non-engineers can follow.</li><li>
Self-starter who thrives in a fast-paced, multi-ERP environment with minimal supervision and competing stakeholder priorities.</li><li>
Experience supporting AI/ML, RAG, or agentic workloads from a warehouse layer (feature tables, embeddings, semantic metadata).</li></ul>
Preferred Qualifications<ul><li>
Table-level experience with SAP ECC and/or S/4HANA finance and logistics tables (e.g., BSEG, BKPF, MARA, EKKO, VBAK).</li><li>
Hands-on experience with Power BI semantic models, DAX, and certified dataset patterns.</li><li>
Prior data engineering or analytics experience in manufacturing, medical devices, or another regulated industry.</li><li>
Familiarity with SOX ITGC and IT-audit controls for financial data lineage at a publicly traded company.</li><li>
Exposure to MDM tooling and processes (Reltio, Informatica MDM, Stibo, or comparable).</li></ul>
Compensation<ul><li>
The salary for this role will range from 101,100.00 - 161,800.00 USD annual based on full-time employment. Salary offers are based on a wide range of factors including but not limited to location, relevant skills, training, experience, education, etc.</li><li>
Certain roles may be eligible for performance-based incentive compensation and/or long-term incentives. Incentives could be discretionary or non-discretionary depending on the plan.</li><li>
Novanta supports all aspects of your life&rsquo;s needs. This position provides a full range of medical, financial, and other benefits to make your quality of life better</li></ul>
Travel Requirements
Occasional travel is required to Novanta global locations.
Physical Requirements
Mobility to work in a standard office setting and to use standard office equipment, including a computer. Ability to use vision to read a computer screen and read printed materials.
Novanta is proud to be an equal employment opportunity and affirmative action workplace. We consider all qualified applicants without regard to race, color, religion, sex (including pregnancy), sexual orientation, gender identity or expression, national origin, military and veteran status, disability, genetics, or any other category protected by federal law or Novanta policy.
Please call +1 781-266-5700 if you need a disability accommodation for any part of the employment process.</div>

The Museum of Modern Art

<div>The Museum of Modern Art is seeking an experienced Senior Data Engineer to be the technical owner of our data engineering team and the primary point of contact for departments and data analysts who rely on our data warehouse. This role guides and mentors the data engineers on technical standards and best practices, owns the relationship with stakeholders to make sure the data warehouse meets their needs, and serves as the resident expert on our data&mdash;how it is structured, how it relates, and how it should be used. This role requires a strong technical background, excellent problem-solving skills, and strong communication skills.

Responsibilities:
<ul>
<li>Serves as the technical anchor and mentor for the data engineering team, setting standards, reviewing work, and guiding design and architecture decisions.</li>
<li>Owns the relationship with other departments and data analysts, gathers their data needs, and ensures the data warehouse supports them.</li>
<li>Acts as the subject-matter expert on our data, advising analysts on how data is structured, how sources relate, and how best to query it.</li>
<li>Designs, develops, and maintains the data warehouse in Google Cloud Platform (GCP), ensuring scalability, performance, and reliability.</li>
<li>Builds and manage robust ELT pipelines to extract, transform, and load data from various sources into the data warehouse.</li>
<li>Defines and maintains data models that make data consistent and easy to understand for analysts and business users.</li>
<li>Manages and maintains databases, including MS SQL Server and PostgreSQL, ensuring data integrity and security.</li>
<li>Develops and maintains small software applications to support data management tasks and improve operational efficiency.</li>
<li>Collaborates with stakeholders to gather data requirements and translate them into technical solutions.</li>
<li>Troubleshoots data-related issues and provides timely solutions to ensure data availability and accuracy.</li>
<li>Stays up-to-date with the latest data engineering technologies and best practices, and shares them with the team.</li>
<li>Performs any other duties reasonably related to the functions described above.</li>
</ul>
Requirements:
<ul>
<li>Bachelor's or Master's degree in Computer Science or a related field.</li>
<li>Minimum of four years of experience as a Data Engineer with a strong understanding of data warehousing concepts and best practices.</li>
<li>Ability to guide and mentor other engineers and influence technical direction.</li>
<li>Proven experience partnering with analysts and stakeholders to understand their needs and translate them into data solutions.</li>
<li>Strong data modeling skills and the ability to explain how data relates and how it should be used.</li>
<li>Hands-on experience with GCP cloud services, including BigQuery, Cloud Storage, and Dataflow.</li>
<li>Proficiency in SQL and experience with database management systems such as MS SQL Server and PostgreSQL.</li>
<li>Experience building and maintaining ETL pipelines using tools like Apache Airflow or Google Cloud Composer.</li>
<li>Proficiency with Python and pandas.</li>
<li>Experience with other programming languages and paradigms such as C#, nodeJS and Ruby.</li>
<li>Knowledge of managing Linux and Windows servers.</li>
<li>Experience with data modeling and data visualization tools.</li>
<li>Experience with software development methodologies such as Agile.</li>
<li>Familiarity with version control systems like Git.</li>
<li>Excellent problem-solving and analytical skills.</li>
<li>Strong communication and collaboration skills.</li>
</ul>
Reports to: Director of Engineering

Salary Range: Minimum of $140,000 to a maximum of $160,000 per annum

Application instructions: To apply, please visit MoMA Jobs (https://recruiting.ultipro.com/MUS1002MOMA/JobBoard/9dbfa465-a36a-46c3-b31e-4929830ab266/?q=&amp;o=postedDateDesc). Applicants should submit a resume and a cover letter/statement of interest. Applications without cover letters will not be considered.

Equal Employment Opportunity has been, and will continue to be, a fundamental principle at the Museum, where employment is based upon personal capabilities and qualifications without discrimination because of race, color, religion, sex, age, national origin, disability, pregnancy, genetic information, military or veteran status, sexual orientation, gender, gender identity or expression, marital and civil partnership/union status, alienage or citizenship status, creed, genetic predisposition or carrier status, unemployment status, familial status, domestic violence, sexual violence or stalking victim status, caregiver status, arrest or conviction record to the extent required by applicable law, credit history, or any other protected category as established by applicable law, including the New York City Human Rights Law (&ldquo;NYCHRL&rdquo;).
Equal Opportunity Employer 
This employer is required to notify all applicants of their rights pursuant to federal employment laws. For further information, please review the Know Your Rights (https://www.eeoc.gov/poster) notice from the Department of Labor.</div>

BV Teck

<div>Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. 
 
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential. 
 
Job Title: Senior Data Engineer - Hadoop 
Location: 100% Remote (U.S.) 
Position Type: Full-time, Direct W2 
Salary Range: $145,000&ndash;$165,000 Annually 
Experience Required: 6+ years 
 
Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position. 
 
Job Summary: 
We are seeking an experienced Senior Data Engineer - Hadoop to design, build, and operate large-scale data processing pipelines and analytics platforms on Hadoop and related big-data ecosystems. In this role you will be responsible for ingesting, transforming, and analyzing massive volumes of structured and unstructured data to support enterprise analytics, machine learning, and reporting workloads. The ideal candidate will combine deep technical expertise across the Hadoop ecosystem with strong software engineering fundamentals and a clear understanding of how to deliver reliable, performant, and cost-effective data platforms in production environments. 
 
Required Qualifications<ul><li>
Bachelor&rsquo;s degree in Computer Science, Engineering, or a related technical discipline.</li><li>
Five or more years of professional experience designing and operating big-data pipelines on Hadoop.</li><li>
Strong hands-on expertise with Apache Spark (Scala, Python, or Java) in production environments.</li><li>
Solid experience with Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem.</li><li>
Hands-on experience with streaming data platforms such as Kafka, Spark Streaming, or Flink.</li><li>
Strong SQL skills and experience working with both relational and NoSQL data stores.</li><li>
Experience with workflow orchestration tools such as Airflow or Oozie.</li><li>
Solid understanding of distributed systems concepts, including partitioning, replication, and fault tolerance.</li><li>
Strong scripting skills in Python or Shell.</li><li>
Excellent troubleshooting, debugging, and documentation skills.</li></ul> 

Preferred Qualifications<ul><li>
Experience operating Hadoop on cloud platforms such as AWS EMR, Azure HDInsight, or Databricks.</li><li>
Familiarity with modern lakehouse formats (Delta, Iceberg, Hudi).</li><li>
Exposure to data governance tooling such as Apache Atlas or Collibra.</li><li>
Experience with Kubernetes-based data platforms (Spark-on-K8s, Trino).</li><li>
Hands-on experience with CI/CD and infrastructure-as-code in data engineering workflows.</li></ul> 

How to Apply 
 
Would you like to know more about this opportunity? For immediate consideration, please send your resume to Harry@bvteck.com or contact us at (908)676-4399. Learn more about Bright Vision Technologies at www.bvteck.com. 
 
Bright Vision Technologies is an Equal Opportunity Employer.
Equal Employment Opportunity (EEO) Statement
Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.
BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.
JxCmcU9X4b</div>

Senior Data Engineer – Hadoop

Search 9158+ Senior data engineer jobs near you this August. New roles added regularly across leading industries. Apply today.

9158 senior data engineer jobs Near Me

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer – Hadoop