data platform engineer

BV Teck

<div>Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential. 
 
Job Title: Data Platform Engineer 
Location: 100% Remote (U.S.) 
Position Type: Full-time, Direct W2 
Salary Range: $100,000&ndash;$150,000 Annually 
Experience Required: 6+ years 
 
Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position. 
 
Job Summary 
We are seeking an experienced Data Platform Engineer to design, build, and operate large-scale data processing pipelines and analytics platforms on Hadoop and related big-data ecosystems. In this role you will be responsible for ingesting, transforming, and analyzing massive volumes of structured and unstructured data to support enterprise analytics, machine learning, and reporting workloads. The ideal candidate will combine deep technical expertise across the Hadoop ecosystem with strong software engineering fundamentals and a clear understanding of how to deliver reliable, performant, and cost-effective data platforms in production environments. 
 
Required Qualifications<ul><li>
5+ years of professional experience designing and operating big-data pipelines on Hadoop.</li><li>
Strong hands-on expertise with Apache Spark (Scala, Python, or Java) in production environments.</li><li>
Solid experience with Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem.</li><li>
Hands-on experience with streaming data platforms such as Kafka, Spark Streaming, or Flink.</li><li>
Strong SQL skills and experience working with both relational and NoSQL data stores.</li><li>
Experience with workflow orchestration tools such as Airflow or Oozie.</li><li>
Solid understanding of distributed systems concepts, including partitioning, replication, and fault tolerance.</li><li>
Strong scripting skills in Python or Shell.</li><li>
Excellent troubleshooting, debugging, and documentation skills.</li></ul>
Preferred Qualifications<ul><li>
Experience operating Hadoop on cloud platforms such as AWS EMR, Azure HDInsight, or Databricks.</li><li>
Familiarity with modern lakehouse formats (Delta, Iceberg, Hudi).</li><li>
Exposure to data governance tooling such as Apache Atlas or Collibra.</li><li>
Experience with Kubernetes-based data platforms (Spark-on-K8s, Trino).</li><li>
Hands-on experience with CI/CD and infrastructure-as-code in data engineering workflows.</li></ul>
How to Apply 
Would you like to know more about this opportunity? 
For immediate consideration, please send your resume to jaya@bvteck.com or contact us at (908) 505-3545. Learn more about Bright Vision Technologies at www.bvteck.com. 
Bright Vision Technologies is an Equal Opportunity Employer. 
Equal Employment Opportunity (EEO) Statement
Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.
BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.
arX7ZI1Seu</div>

Data Platform Engineer

Georgia-Pacific

<div>Your Job
As a Lead Data Platform Engineer on the Georgia Pacific Data Platform team, you will help deliver trusted, high-quality data across hundreds of systems and thousands of data assets. You will own, deliver, operate, and help architect the Enterprise Data Lake, Ingestion Framework, and Databricks Platform while partnering with Data Governance, Data Delivery, Product Owners, and Solution Architects to keep the platform reliable, scalable, governed, and aligned with business needs.
This role is based in our Atlanta, GA HQ office located on Peachtree St. The expectation is hybrid (3x) in office per week.
Our Team
The Georgia Pacific Data Platform team builds, manages, &amp; operates centralized products that support Georgia Pacific's Business Units and IT. These products enable data to be ingested, stored, processed, governed, managed, presented, and consumed consistently across the enterprise.
What You Will Do 
<ul><li>
Lead and optimize the GP data platform (Enterprise Data Lake, Ingestion Framework, Databricks), ensuring reliability, integrity, and cost efficiency data and data infrastructure
</li><li>Collaborate with cross-functional teams to deliver features, maintain a healthy agile process, and enhance platform accessibility for customers
</li><li>Drive automation, operational excellence, and continuous improvement through performance monitoring, issue resolution, and development of self-service tools
</li></ul>Who You Are (Basic Qualifications) 
<ul><li>
Experience designing, building, and maintaining large-scale distributed systems
</li><li>Experience serving as a senior technical leader overseeing multiple data engineering teams
</li><li>Experience in architectural design and systems integration for multi-stakeholder, enterprise-grade platforms
</li><li>Experience leading operations for highly available data platforms and data lakes
</li><li>Demonstrated experience in data infrastructure, including proficiency with Infrastructure as Code practices and skilled in GIT and CI/CD design patterns
</li><li>Must have legal authorization to work permanently in the United States for any employer without requiring a visa transfer or visa sponsorship
</li></ul>What Will Put You Ahead 
<ul><li>
Delivered innovative, scalable data solutions using Python, SQL, Spark, and Delta Lake, while optimizing data accessibility with open table formats (Delta, Hudi, Iceberg)
</li><li>Enhanced system efficiency and reliability by leveraging Terraform, Git/CI-CD workflows, and DAG tools (Airflow, Step Functions, Databricks Declarative Pipelines)
</li><li>Implemented and optimized the Databricks Data Platform and AWS services (Lambda, Glue, EventBridge, ECS, Kafka, etc.) to support business objectives
</li></ul>At Koch companies, we are entrepreneurs. This means we openly challenge the status quo, find new ways to create value and get rewarded for our individual contributions. Any compensation range provided for a role is an estimate determined by available market data. The actual amount may be higher or lower than the range provided considering each candidate's knowledge, skills, abilities, and geographic location. If you have questions, please speak to your recruiter about the flexibility and detail of our compensation philosophy.
Hiring Philosophy
All Koch companies value diversity of thought, perspectives, aptitudes, experiences, and backgrounds. We are Military Ready and Second Chance employers. Learn more about our hiring philosophy here.
Who We Are
As a Koch company and a leading manufacturer of bath tissue, paper towels, paper-based packaging, cellulose, specialty fibers, building products and much more, Georgia-Pacific works to meet evolving needs of customers worldwide with quality products. In addition to the products we make, we operate one of the largest recycling businesses. Our more than 30,000 employees in over 150 locations are empowered to innovate every day - to make everyday products even better.
At Koch, employees are empowered to do what they do best to make life better. Learn how our business philosophy helps employees unleash their potential while creating value for themselves and the company.
Our Benefits
Our goal is for each employee, and their families, to live fulfilling and healthy lives. We provide essential resources and support to build and maintain physical, financial, and emotional strength focusing on overall wellbeing so you can focus on what matters most. Our benefits plan includes medical, dental, vision, flexible spending and health savings accounts, life insurance, ADD, disability, retirement, paid vacation/time off, educational assistance, and may also include infertility assistance, paid parental leave and adoption assistance. Specific eligibility criteria is set by the applicable Summary Plan Description, policy or guideline and benefits may vary by geographic region. If you have questions on what benefits apply to you, please speak to your recruiter.
Equal Opportunities
Equal Opportunity Employer, including disability and protected veteran status. Except where prohibited by state law, all offers of employment are conditioned upon successfully passing a drug test. This employer uses E-Verify. Please visit the following website for additional information: http://www.kochcareers.com/doc/Everify.pdf
#LI-RR1</div>

Lead Data Engineer

EXL Service

<div>Job Description: EXL Service is seeking an accomplished Senior Databricks Data Engineer with 10&ndash;12 years of experience designing, developing, and optimizing enterprise data platforms and large-scale ETL solutions. The ideal candidate brings deep expertise in Databricks, Spark, Delta Lake, Azure Data Platform, and modern data engineering practices.
This role is responsible for building scalable data pipelines, implementing cloud-native data solutions, improving platform performance, and delivering reliable data products for analytics, reporting, and AI/ML initiatives.
Base Compensation Range: 65,000 &ndash; 87,000
The posted range is the hiring range for this role &mdash; a subset of the broader range available to employees over time &mdash; and reflects base salary across our national hiring scale. Final offers are based on several factors, including the candidate's skills and experience, internal pay equity, work location, market conditions for the role, and the specific scope and responsibilities of the position. The top of the range is reserved for candidates who notably exceed the requirements; the lower end applies to those with less experience or fewer preferred qualifications. For positions based in higher-cost zones (e.g., California, New York, New Jersey), actual compensation may exceed the posted range; your recruiter will share specifics during the process.
For more information on benefits and what we offer please visit us at https://www.exlservice.com/us-careers-and-benefits</div>
 <div>Responsibilities: Key Responsibilities
Data Engineering &amp; Platform Development
<ul><li>Design, develop, and optimize enterprise-scale data pipelines using Databricks, Spark, Delta Lake, and Azure Data Lake Storage.
</li><li>Build batch and incremental ETL/ELT pipelines, real-time streaming architectures, and reusable data integration frameworks.
</li><li>Develop scalable ingestion frameworks supporting structured, semi-structured, and API-based data sources.
</li><li>Build reusable data engineering frameworks for ingestion, transformation, validation, reconciliation, and publishing.
</li><li>Develop Delta Lake solutions using partitioning, optimization, Z-Ordering, Liquid Clustering, and performance tuning techniques.
</li><li>Implement CDC, incremental processing, merge strategies, and data synchronization across enterprise platforms.
</li><li>Develop Databricks Workflows, notebooks, SQL Jobs, and automation for production workloads.
</li><li>Integrate external REST APIs and process JSON/XML data into analytics-ready datasets.
</li><li>Implement robust data quality checks, audit frameworks, monitoring, and error handling.
</li>Optimize Spark jobs for performance, scalability, and cost efficiency. 
<li>
</li></ul>Databricks &amp; Azure Development
<ul><li>Develop solutions using Azure Data Lake Storage Gen2, Databricks, Unity Catalog, Azure Key Vault, Azure DevOps, and Azure Synapse.
</li><li>Build secure data pipelines using Unity Catalog, RBAC, service principals, and managed identities.
</li><li>Develop reusable notebook frameworks using PySpark and Spark SQL.
</li><li>Implement CI/CD deployment pipelines using Azure DevOps.
</li><li>Manage environment promotion across Development, QA, UAT, and Production.
</li>Troubleshoot production issues and optimize workloads for reliability and scalability. 
<li>
</li></ul>Data Integration &amp; Analytics
<ul><li>Design enterprise data models supporting reporting, analytics, and downstream applications.
</li><li>Develop healthcare and financial data integration pipelines supporting multiple source systems.
</li><li>Build reusable metadata-driven ETL frameworks.
</li><li>Integrate third-party APIs including NLP, terminology normalization, and identity resolution services.
</li><li>Support data governance, lineage, and metadata management initiatives.</li></ul></div>
 <div>Qualifications: Required Skills &amp; Experience
Technical Expertise
<ul><li>10-12 years of experience in Data Engineering, ETL Development, and Data Warehousing.
</li><li>Hands-on Databricks development experience.
</li><li>Strong experience with Spark, Delta Lake, Unity Catalog, Databricks Workflows, and SQL Warehouses.
</li><li>Strong experience with PySpark, Spark SQL, SQL, and Python.
</li><li>Experience building enterprise ETL/ELT pipelines using Databricks and Azure Data Platform.
</li><li>Experience with Azure Data Lake Storage (ADLS Gen2), Azure Synapse, Azure Key Vault, and Azure DevOps.
</li><li>Experience implementing CDC, SCD, incremental loading, and data quality frameworks.
</li><li>Experience integrating REST APIs and processing JSON/XML datasets.
</li><li>Experience with Git, CI/CD, release management, and deployment automation.
</li><li>Strong knowledge of performance tuning, partitioning, caching, broadcast joins, and Spark optimization.
</li><li>Experience working with healthcare data platforms is preferred.
</li><li>Microsoft Azure certifications (e.g., DP-203 Azure Data Engineer Associate) or Databricks certifications (Data Engineer Associate/Professional).
</li><li>Experience with Ab Initio suite of products is also preferred.</li></ul></div>

Databricks Data Engineer

Reach Financial

<div>What is Reach Financial?
Reach Financial is a FinTech platform helping people outsmart debt for good. 
We are building innovative products and best-in-class support that enable our customers to take control of their debt and de-mystify their personal finances. Our products and tools empower our customers to turn their financial goals into a reality. 
Reach Financial launched in 2015 and has helped our customers pay off over $1 billion in debt. We offer debt consolidation loans and personal loans; together, these markets represent a $1.5T opportunity. In time, we will expand beyond these products to offer solutions for a variety of our customers' personal finance challenges. 
We are a fast-growing and fast-paced FinTech startup with the stability of an established firm. You will have a front-row seat at a rapidly growing company innovating the FinTech industry. 
About the role
As a Data Engineer II, you will be a key contributor to Reach's data platform modernization efforts. Working closely with Data Engineering, Analytics, Product, and Platform Engineering teams, you will design, build, and maintain reliable data pipelines, transformations, and models that power reporting, analytics, and operational decision-making. 
This role is ideal for an engineer who can independently deliver solutions to well-defined problems, participate in technical design discussions, and continuously improve the quality and reliability of our data ecosystem. 
What you'll do<ul><li>
Design, build, and maintain scalable data pipelines, transformations, and data models using modern ELT practices</li><li>
Participate in incident response and operational support activities, including occasional off-hours coverage for critical production issues, data incidents, and major platform deployments</li><li>
Develop and support data assets that enable reporting, analytics, and operational workflows</li><li>
Participate in technical design discussions and contribute to implementation planning and solution documentation</li><li>
Collaborate with analysts, data scientists, software engineers, and business stakeholders to understand requirements and deliver effective data solutions</li><li>
Troubleshoot data quality, reliability, and performance issues across data pipelines and systems</li><li>
Monitor and improve existing implementations by identifying gaps, inefficiencies, andopportunities for automation</li><li>
Contribute to engineering best practices around testing, version control, documentation, anddata quality</li><li>
Support deployment and maintenance of data pipelines through established CI/CD processes</li><li>
Participate in code reviews and provide constructive feedback to peers</li><li>
Continuously develop technical expertise and apply new tools, techniques, and approaches where appropriate</li></ul> 
What you should have<ul><li>
3&ndash;5 years of hands-on experience in Data Engineering, Analytics Engineering, or a relateddata-focused role</li><li>
Experience working in a product-oriented data squad, partnering closely with Product,Analytics, and Engineering to deliver end-to-end data solutions and data products</li><li>
Experience working with modern data platforms and tools such as dbt (Core or Cloud),Amazon RDS, PostgreSQL, or similar technologies; strongly preferred: experience withSnowflake (our primary data warehouse platform)</li><li>
Strong SQL skills with experience developing data transformations and data models</li><li>
Experience building and maintaining ETL/ELT pipelines</li><li>
Experience with Python or a similar programming language</li><li>
Understanding of data modeling, warehousing concepts, and relational databases</li><li>
Experience using Git-based development workflows</li><li>
Ability to independently manage assigned workstreams and deliver high-quality solutions</li><li>
Strong communication, collaboration, and problem-solving skills</li><li>
Demonstrated ability to learn new technologies, tools, and business domains and apply them effectively</li></ul> 
Nice to Have<ul><li>
Experience preparing and modeling data for analysis in Tableau, Sigma, or other BI tools</li><li>
Experience with reverse ETL / data activation tools such as FiveTran activations, Hightouch,etc</li><li>
Familiarity with dbt coding conventions and Medallion data architecture (i.e. Bronze, Silver, Gold data layers)</li><li>
Experience working in the Financial Services industry and familiarity with working in a SOC2and PCI-DSS environment</li></ul> 
Successful candidates will<ul><li>
Independently deliver reliable solutions to defined business and technical problems</li><li>
Balance implementation speed with maintainability and long-term platform health</li><li>
Create well-structured solutions to known problems and navigate moderate ambiguity</li><li>
Identify risks within their work and proactively propose mitigations</li><li>
Effectively troubleshoot user and system issues while contributing to continuous improvement</li><li>
Expand their technical expertise and apply new learnings to improve outcomes</li><li>
Collaborate effectively with stakeholders and engineering partners to clarify requirements and deliver value</li><li>
Contribute positively to team culture through knowledge sharing, collaboration, and constructive feedback</li></ul> 
What is it like working at Reach Financial?
Our culture is built around advancing our teams, and we are dedicated to the success and growth of every team member. We believe in retaining a high-performing workforce and we prioritize diversity, intellectual curiosity, and continued learning. Our generous benefits packages reflect that. 
We&rsquo;ve been hard at work perfecting our product for years, and now we&rsquo;re growing faster than ever before. Our strong foundation and company culture is readily equipped for this growth, and we believe that with the right people, our products will continue to help customers make real changes in their financial lives. 
What benefits will you receive?<ul><li> Remote First Culture with optional Hybrid opportunities</li><li> Healthcare, Life Insurance, 401k Match</li><li> Paid Time Off, Paid 12-week Parental Leave</li><li> Disability (short-term, long-term), Employee Assistance Program</li><li> Spending Accounts (Transit/Parking, Medical, Dependent Care)</li><li> Insurance Discounts (home, auto, pet)</li></ul> 
The pay range for this role is: 
120,000 - 150,000 USD per year(Remote (United States))</div>

Data Engineer II

hims & hers

<div>Hims &amp; Hers is the leading health and wellness platform, on a mission to help the world feel great through the power of better health. We are redefining healthcare by putting the customer first and delivering access to care that is affordable, accessible, and personal, from diagnosis to treatment to delivery. No two people are the same, so we provide access to personalized care designed for results. By normalizing health &amp; wellness challenges and innovating on their solutions, we&rsquo;re making better health outcomes easier to achieve.
Hims &amp; Hers is a public company, traded on the NYSE under the ticker symbol &ldquo;HIMS.&rdquo; To learn more about the brand and offerings, you can visit hims.com/about and hims.com/how-it-works . For information on the company&rsquo;s outstanding benefits, culture, and its talent-first flexible/remote work approach, see below and visit www.hims.com/careers-professionals.<h2 class="jobSectionHeader">
About the Role:</h2>
We're looking for a Staff Data Engineer to join the Data Platform Engineering team at Hims &amp; Hers as a key technical driver for our most critical platform initiatives. Your scope spans multiple squads: you will drive shared architectural decisions, enhance cross-team reliability, and improve the overall developer experience for a team of nine engineers building the infrastructure that powers patient care for millions of Hims &amp; Hers subscribers. 
This is a hands-on execution role. You will own large, complex deliverables end-to-end - from design through production - across our full stack: BigQuery, dbt, Airflow on Astronomer, Confluent Kafka, Databricks, Fivetran, and Terraform/OpenTofu. You will be the DRI (Directly Responsible Individual) for cross-squad initiatives and the engineer other Senior DEs look to for technical direction and growth.<h2 class="jobSectionHeader">
You Will:</h2><ul><li>
Serve as DRI for high-complexity, multi-sprint platform initiatives - Fivetran connector buildouts, Databricks Lakehouse migration workstreams, event streaming infrastructure, lower environment implementation, and engineering standards adoption</li><li>
Architect, build, and maintain production-grade ingestion pipelines and platform infrastructure - from source connectivity through Bronze/Silver layers - that Analytics Engineering, Data Science, and business teams build on daily</li><li>
Design, implement, and operate event-driven and streaming data pipelines using Kafka, PySpark, and Databricks Structured Streaming - including defining scaling strategies, cost guardrails, consumer lag alerting, and runbooks before those services reach production</li><li>
Own the ingestion and raw-to-cleansed layer (Bronze to Silver) data contracts, schema governance, and SLAs</li><li>
Own data quality for pipelines you build: write dbt tests, wire anomaly detection, validate schemas, and alert on data drift - pipelines ship with quality gates, not after them</li><li>
Own the reliability of systems you build: establish KPIs and SLOs, implement Datadog monitoring and alerting as code, participate in the on-call rotation, and own Tier 1 operational tickets and runbooks for systems under your domain</li><li>
Own the integration and data activation layer - Fivetran connectors and Hightouch reverse ETL pipeline connectors - end-to-end from IaC provisioning to production monitoring and schema change governance</li><li>
Support Analytics Engineers, Data Scientists, and ML engineers by building platform capabilities and data pipelines that unblock their roadmap; partner with legal, security, and DevOps on compliance controls and IaC hardening as needed. DE's responsibility is the platform layer and data delivery; transformation logic and model readiness for serving are owned by Analytics Engineering</li><li>
Identify and resolve systemic inefficiencies across DPE-owned pipelines and infrastructure - root cause, not just symptom</li><li>
Mentor Senior Data Engineers through design reviews, code reviews, and pairing; help them grow from squad-level to cross-squad scope</li><li>
Contribute to and drive adoption of engineering standards - testing practices, CI/CD patterns, observability-as-code, Schema Registry governance - and participate in ARC reviews for changes with cross-team or cost impact</li></ul><h2 class="jobSectionHeader">
You Have:</h2><ul><li>
8+ years of professional experience designing, building, and operating data pipelines and platform infrastructure</li><li>
Experience with CDC (Change Data Capture) patterns for real-time ingestion.</li><li>
Experience with Flink for stream processing</li><li>
Experience governing and administering dbt in a production BigQuery or Databricks environment - CI/CD configuration, testing standards, documentation standards, and platform-level schema governance. Hands-on dbt experience for ingestion-layer (Bronze/Silver) pipelines</li><li>
Experience building and operating Airflow DAGs at scale - task-level orchestration patterns, DAG reliability, and multi-priority scheduling</li><li>
Experience building event streaming pipelines using Kafka or Confluent Kafka - producers, consumers, schema evolution, Schema Registry governance, and consumer lag management</li><li>
Multi-cloud fluency across GCP and AWS - both are required day-to-day: BigQuery runs on GCP, Airflow runs on AWS EKS</li><li>
Experience owning data quality for production pipelines - dbt tests, anomaly detection, alerting on schema changes and data drift</li><li>
Experience with Fivetran or equivalent connector platform - IaC provisioning, schema change handling, and connector health monitoring</li><li>
Experience with the Databricks platform - Delta Lake, Databricks Workflows, and Unity Catalog</li><li>
Familiarity with data compliance in a regulated environment - HIPAA/PHI handling, access controls, and audit logging</li><li>
Infrastructure-as-code experience - Terraform or equivalent; you treat infrastructure changes like code changes</li><li>
Strong Python and SQL skills; comfortable writing, reviewing, and raising the bar on production-grade pipeline code</li><li>
Strong design instincts: you take ambiguous requirements, write clear solution designs, and ship to production with minimal rework</li></ul><h2 class="jobSectionHeader">
Preferred Qualifications:</h2><ul><li>
PySpark/SparkSQL for large-scale data processing</li><li>
Experience with Hightouch or equivalent reverse ETL platform</li><li>
Experience with MLOps - supporting ML engineers with data pipelines for model training, feature stores, or experimentation</li><li>
Familiarity with Looker LookML or equivalent BI serving layer</li><li>
Go experience for Kafka service development</li><li>
Experience at a direct-to-consumer healthcare, telehealth, or similarly regulated company</li><li>
Familiarity with UK/GDPR data compliance requirements distinct from US HIPAA</li></ul><h2 class="jobSectionHeader">
Our Benefits (there are more but here are some highlights):</h2><ul><li>
Competitive salary &amp; equity compensation for full-time roles</li><li>
Unlimited PTO, company holidays, and quarterly mental health days</li><li>
Comprehensive health benefits including medical, dental &amp; vision, and parental leave</li><li>
Employee Stock Purchase Program (ESPP)</li><li>
401k benefits with employer matching contribution</li><li>
Offsite team retreats</li></ul>
We are committed to building a workforce that reflects diverse perspectives and prioritizes ethics, wellness, and a strong sense of belonging. If you're excited about this role, we encourage you to apply&mdash;even if you're not sure if your background or experience is a perfect match.
Hims considers all qualified applicants for employment, including applicants with arrest or conviction records, in accordance with the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance, the California Fair Chance Act, and any similar state or local fair chance laws.
It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
Hims &amp; Hers is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, please contact us at accommodations@forhims.com and describe the needed accommodation. Your privacy is important to us, and any information you share will only be used for the legitimate purpose of considering your request for accommodation. Hims &amp; Hers gives consideration to all qualified applicants without regard to any protected status, including disability. Please do not send resumes to this email address.
To learn more about how we collect, use, retain, and disclose Personal Information, please visit our Global Candidate Privacy Statement.
Compensation Range: $170K - $200K</div>

Staff Data Engineer

IT America Inc

Data Engineer (Databricks)Azure Databricks EnvironmentAustin, TX - HybridGeneral InformationDescription:The Databricks Data and AI Agent Automation Engineer is responsible for designing, developing, and deploying intelligent agents that automate data engineering development (dev) and quality assurance (QA) tasks within the Azure Databricks environment. This role bridges software engineering and data platform operations, leveraging AI/ML capabilities, prompt engineering, and low-code/no-code automation frameworks to accelerate platform development cycles, reduce manual toil, and improve code quality. The engineer will work closely with the Data Platform team to build, test, and operationalize agents that enhance developer productivity, streamline CI/CD pipelines, and automate governance and compliance checks.Responsibilities&middot; Design and implement intelligent agents (LLM-powered, rule-based, or hybrid) that automate data engineering workflows in Azure Databricks&middot; Develop agents for automated code generation, refactoring, and optimization of PySpark and SQL workloads&middot; Build agents that automate data quality validation, testing, and reconciliation tasks in dev and QA environments&middot; Create agents for metadata management, lineage tracking, and governance automation within Databricks&middot; Develop autonomous CI/CD pipeline tasks, including automated test case generation, deployment validation, and rollback logic&middot; Implement agents that perform intelligent monitoring, anomaly detection, and root-cause analysis for data pipelines&middot; Build prompt engineering frameworks and agent orchestration patterns tailored to data engineering use cases&middot; Collaborate with data engineers and architects to identify high-impact automation opportunities and prioritize agent development roadmap&middot; Establish best practices for agent development, testing, deployment, and observability within Azure Databricks&middot; Document agent workflows, decision logic, and operational runbooks for team knowledge sharing&middot; Evaluate emerging AI/agent frameworks and technologies; recommend adoption where applicableJob RequirementsEducation&middot; Bachelor's degree in Computer Science, Software Engineering, Data Science, or related field (Master's preferred)Experience&middot; 5+ years of data engineering or software engineering experience, with hands-on work in cloud data platforms (Databricks, Snowflake, Azure)&middot; Proven experience developing automation solutions, agents, or AI-powered tools (e.g., using LLMs, prompt engineering, or orchestration frameworks like Databricks Agent Framework (or LangChain, AutoGen)&middot; Strong proficiency in Python and SQL with focus on production-grade code quality&middot; Demonstrated experience with Azure Databricks (notebooks, jobs, workflows, DLT) or equivalent modern data platforms&middot; Hands-on experience with CI/CD/CT tools (GitHub Actions, Azure DevOps Pipelines) and automation frameworks&middot; Experience building data quality frameworks, testing patterns, or QA automation&middot; Prior work in regulated or risk-sensitive environments preferredSkills &amp; Competencies&middot; Expert-level Python programming with strong software engineering practices (testing, documentation, version control)&middot; Strong SQL and PySpark optimization skills&middot; Hands-on experience with LLM APIs, prompt engineering, and AI agent frameworks (e.g., Databricks Agent Bricks, LangChain, OpenAI, Azure OpenAI)&middot; Proficiency in Azure Databricks, including Delta Lake, workflows, and Databricks Asset Bundles&middot; Experience designing and implementing automation workflows using orchestration tools or serverless platforms&middot; Strong problem-solving and systems thinking skills; ability to decompose complex workflows into automatable components&middot; Excellent communication and documentation skills; ability to articulate technical concepts and agent design rationale&middot; Self-directed learner with curiosity about emerging AI/automation technologies&middot; Ability to collaborate effectively with cross-functional teams (data engineers, architects, QA, operations)Pay: $65.00 - $70.00 per hourWork Location: Hybrid remote in Austin, TX 78701

Azure Data Engineer

LeafLink

<div><div><h2 class="jobSectionHeader">About LeafLink</h2>

LeafLink is the largest unified B2B cannabis platform, providing licensed cannabis businesses a suite of tools to manage their business more effectively, sell or order from their favorite brands and accelerate growth. We are one platform, one solution and we&rsquo;re defining the way thousands of cannabis brands, distributors, and retailers streamline their operations. With thousands of brands and retailers across 30+ markets in North America, we are setting the industry standard for how cannabis businesses grow together. LeafLink processes more than $5 billion in wholesale cannabis orders annually.

Our team, backed by funding from leading VC's, including Founders Fund, Thrive Capital, Nosara Capital, and Lerer Hippeau is poised to define the cannabis supply chain through technology. LeafLink was named one of Inc. 5000&rsquo;s &lsquo;Top 5000 Fastest-Growing Private Companies&rsquo;; one of Fast Company's 'Top 10 Most Innovative Companies in Enterprise for 2020', joining the ranks of Amazon, Slack, and VMWare; one of Built In NYC's 'Best Places to Work in 2021'; 2024 Fast Company&rsquo;s Best WorkPlaces for Innovators for Banking, Finance, and Fintech category; 2024 Green Market Report Award for Best Fintech in cannabis - and we're just getting started!</div><div><h2 class="jobSectionHeader">
The Role</h2>

LeafLink is seeking a Staff Data Engineer to help lead the evolution of our data platform and analytics infrastructure. This role will design and scale systems that power analytics, reporting, and operational insights across the organization.

Staff Data Engineers influence how data is modeled, moved, and consumed across the company. This role partners with engineering, finance, product, and operations teams to ensure the data platform remains reliable, scalable, and capable of supporting critical decision-making.
<h2 class="jobSectionHeader">
What You&rsquo;ll Be Doing</h2>
<ul><li>Design and lead development of scalable data pipelines using Airflow, dbt, and Python.</li>
<li>Guide architecture and evolution of the company data platform.</li>
<li>Build integrations across modern data stack tools including Fivetran, Redshift, and Sigma.</li>
<li>Develop serverless data services using AWS services such as Lambda.</li>
<li>Partner with stakeholders to define reliable data models and analytics datasets.</li>
<li>Improve pipeline reliability through testing, monitoring, and observability.</li>
<li>&quot;mention the word grass in your application&quot;</li>
<li>Modernize legacy data processes and improve automation across the platform.</li>
<li>Mentor engineers and analysts on data modeling and platform best practices.</li>
<li>Drive improvements in data governance and documentation.</li>
</ul><h2 class="jobSectionHeader">What You&rsquo;ll Bring to the Team</h2>
<ul><li>8+ years of experience building production data pipelines and analytics infrastructure.</li>
<li>Strong SQL skills and experience modeling large datasets.</li>
<li>Strong Python experience for building pipelines and automation.</li>
<li>Experience with Airflow, dbt, or similar orchestration and transformation tools.</li>
<li>Experience with modern data stack tools such as Fivetran, Redshift, or Sigma.</li>
<li>Experience with AWS and serverless data processing such as Lambda.</li>
<li>Strong understanding of data warehouse architecture and analytics engineering</li>
<li>Demonstrated ability to lead technical initiatives across teams.</li>
</ul><h2 class="jobSectionHeader">LeafLink Perks &amp; Benefits</h2>
<ul><li>Flexible PTO - you&rsquo;re going to be working hard so enjoy time off with no cap!</li>
<li>A robust stock option plan to give our employees a direct stake in LeafLink&rsquo;s success</li>
<li>5 Days of Volunteer Time Off (VTO) - giving back is important to us and we want our employees to prioritize cultivating a better community</li>
<li>Competitive compensation and 401k</li>
<li>Comprehensive health coverage (medical, dental, vision)</li>
<li>Commuter Benefits through our Flexible Spending Account</li>
</ul>
LeafLink&rsquo;s employee-centric culture has earned us a coveted spot on BuiltInNYC&rsquo;s Best Places to Work for in 2021 list.</div><div><div>
Base salary range
$170,000 - $230,000 USD</div></div></div>

Search 8527+ Data platform engineer jobs near you this August. New roles added regularly across leading industries. Apply today.

8527 data platform engineer jobs Near Me

Data Platform Engineer

Lead Data Engineer

Databricks Data Engineer

Data Engineer II

Staff Data Engineer

Azure Data Engineer

Staff Data Engineer