data engineer

principal data scientist

senior data engineer (aws, azure, gcp) Jobs in Chicago

senior data engineer (aws, azure, gcp)

backend engineering specialist Jobs in Chicago

backend engineering specialist

data analyst

lead data engineer

Capital One

<div>Lead Data Engineer<p></p><p>
Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking <b>Data Engineers</b> who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you&rsquo;ll have the opportunity to be on the forefront of driving a major transformation within Capital One.</p><p></p><p><b>
What You&rsquo;ll Do:</b></p><ul><li><p>
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies</p></li><li><p>
Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems</p></li><li><p>
Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake</p></li><li><p>
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal &amp; external technology communities, and mentoring other members of the engineering community</p></li><li><p>
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment</p></li><li><p>
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance</p></li></ul><p></p><p><b>
Basic Qualifications:</b></p><ul><li><p>
Bachelor&rsquo;s Degree</p></li><li><p>
At least 4 years of experience in application development (Internship experience does not apply)</p></li><li><p>
At least 2 years of experience in big data technologies</p></li><li><p>
At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)</p></li></ul><p></p><p><b>
Preferred Qualifications:</b></p><ul><li><p>
7+ years of experience in application development including Python, SQL, Scala, or Java</p></li><li><p>
4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)</p></li><li><p>
4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)</p></li><li><p>
4+ year experience working on real-time data and streaming applications</p></li><li><p>
4+ years of experience with NoSQL implementation (Mongo, Cassandra)</p></li><li><p>
4+ years of data warehousing experience (Redshift or Snowflake)</p></li><li><p>
4+ years of experience with UNIX/Linux including basic commands and shell scripting</p></li><li><p>
2+ years of experience with Agile engineering practices</p></li></ul><p></p><p><b><i>
At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer).</i></b></p><p></p><p>
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.</p><p></p>
Chicago, IL: $179,400 - $204,700 for Lead Data Engineer<p></p><p><br>
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate&rsquo;s offer letter.</p><p></p>
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.<p></p><p>
Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.</p><p></p>
This role is expected to accept applications for a minimum of 5 business days.<p></p>
No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City&rsquo;s Fair Chance Act; Philadelphia&rsquo;s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.<p></p><p>
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.</p><p></p><p>
For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com</p><p></p><p>
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.</p><p></p><p>
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).</p></div>

Lead Data Engineer

84.51°

<div><div><p><b>84.51&deg; Overview:</b></p>
<p>
84.51&deg; is a retail data science, insights and media company. We help The Kroger Co., consumer packaged goods companies, agencies, publishers and affiliates create more personalized and valuable experiences for shoppers across the path to purchase.</p>
<p>
Powered by cutting-edge science, we utilize first-party retail data from more than 62 million U.S. households sourced through the Kroger Plus loyalty card program to fuel a more customer-centric journey using 84.51&deg; Insights, 84.51&deg; Loyalty Marketing and our retail media advertising solution, Kroger Precision Marketing.</p>
<p><i>
84.51&deg; follows a 5‑day in‑office work schedule to support collaboration, alignment, and team connection.</i></p>
<p>
Join us at 84.51&deg;!</p>
<p>
__________________________________________________________</p></div><p></p><p><b><br>
Lead Data Engineer</b></p>
<p><b>
Location: Cincinnati, OH / Chicago, IL</b></p>
<p><b>
Summary</b></p>
<p>
We are seeking a Lead Data Engineer to build modern data platform solutions that turn data into actionable insights, reporting and AI-enabled capabilities used to personalize the customer experience.</p>
<p>
As a Lead Data Engineer, you will partner cultivate strategies and solutions to ingest, store, transform, and distribute data at scale. Our engineers use Snowflake, Databricks, Azure Data Factory (ADF), SQL, Python, JSON, and related technologies in agile scrum teams to develop products, tools, and features that support analytics, reporting, and AI-enabled capabilities.</p>
<p><b>
Responsibilities</b></p>
<p>
Take ownership of features and drive them to completion through all phases of the SDLC. This includes platform capabilities, data products, and process improvement activities such as:</p>
<ul>
<li>Lead design of data platform and SQL-based solutions</li>
<li>Perform development of data pipelines, transformations, and orchestration workflows</li>
<li>Design and implement solutions using Snowflake, Databricks, Azure Data Factory (ADF), SQL, Python, and JSON</li>
<li>Support data ingestion, storage, transformation, and distribution</li>
<li>Contribute to data platform architecture supporting analytical and operational use cases</li>
<li>Execute unit, integration, and data validation testing</li>
<li>Collaborate with team members to ensure consistent development practices</li>
<li>Partner with analytics and data science teams to support AI/ML and advanced analytics use cases</li>
<li>Help establish governed, scalable data foundations for AI-enabled capabilities</li>
<li>Contribute to standards for data quality, governance, lineage, and observability</li>
<li>Provide mentoring to junior resources</li>
<li>Participate in retrospective reviews</li>
<li>Participate in estimation for new work and releases</li>
<li>Bring new perspectives to problems and be driven to improve yourself and the way things are done</li>
</ul>
<p><b>Qualifications, Skills, and Experience</b></p>
<ul>
<li>Bachelor's degree typically in Computer Science, Management Information Systems, Mathematics, Business Analytics, Engineering, or another technically strong program</li>
<li>5+ years proven ability of professional data engineering or data development experience</li>
<li>Strong understanding of Agile Principles (Scrum)</li>
<li>5+ years proven ability developing with SQL</li>
<li>Full understanding of ETL/ELT concepts and data warehousing concepts</li>
<li>3+ years developing experience with Python, Scala, or Java</li>
<li>Hands-on experience with Snowflake, Databricks, and Azure Data Factory (ADF)</li><br>
</ul>
<p><b>Preferred Skills</b></p>
<ul>
<li>Azure data services</li>
<li>Data platform architecture</li>
<li>Event-driven or near real-time data patterns</li>
<li>AI/ML-enabled data solutions</li>
<li>Generative AI or LLM-enabled workflows</li>
<li>Data governance, metadata, and lineage tooling</li>
</ul>
<p>#LI-SSS</p></div>

Lead Data Engineer (P249)

<div>Lead Data Engineer (Java, Snowflake, AWS)<p></p><p>
Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment?<br>
<br>
At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you&rsquo;ll have the opportunity to be on the forefront of driving a major transformation within Capital One.</p><p></p><p><b>
What You&rsquo;ll Do:</b></p><ul><li><p>
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies</p></li><li><p>
Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems</p></li><li><p>
Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake</p></li><li><p>
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal &amp; external technology communities, and mentoring other members of the engineering community</p></li><li><p>
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment</p></li><li><p>
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance</p></li></ul><p></p><p><b>
Basic Qualifications:</b></p><ul><li><p>
Bachelor&rsquo;s Degree</p></li><li><p>
At least 4 years of experience in application development (Internship experience does not apply)</p></li><li><p>
At least 2 years of experience in big data technologies</p></li><li><p>
At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)</p></li></ul><p></p><p><b>
Preferred Qualifications:</b></p><ul><li><p>
7+ years of experience in application development including Python, SQL, Scala, or Java</p></li><li><p>
4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)</p></li><li><p>
4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)</p></li><li><p>
4+ year experience working on real-time data and streaming applications</p></li><li><p>
4+ years of experience with NoSQL implementation (Mongo, Cassandra)</p></li><li><p>
4+ years of data warehousing experience (Redshift or Snowflake)</p></li><li><p>
4+ years of experience with UNIX/Linux including basic commands and shell scripting</p></li><li><p>
2+ years of experience with Agile engineering practices</p></li></ul><p><b><i><br>
At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer).</i></b></p><p></p><p>
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.</p><p></p>
Chicago, IL: $179,400 - $204,700 for Lead Data Engineer<p></p><p><br>
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate&rsquo;s offer letter.</p><p></p>
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.<p></p><p>
Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.</p><p></p>
This role is expected to accept applications for a minimum of 5 business days.<p></p>
No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City&rsquo;s Fair Chance Act; Philadelphia&rsquo;s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.<p></p><p>
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.</p><p></p><p>
For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com</p><p></p><p>
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.</p><p></p><p>
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).</p></div>

Lead Data Engineer (Java, Snowflake, AWS)

AECOM

<div><b>Company Description</b><p><b><br>
Work with Us. Change the World.</b></p><p>
At AECOM, we're delivering a better world. Whether improving your commute, keeping the lights on, providing access to clean water, or transforming skylines, our work helps people and communities thrive. We are the world's trusted infrastructure consulting firm, partnering with clients to solve the world&rsquo;s most complex challenges and build legacies for future generations.</p><p>
There has never been a better time to be at AECOM. With accelerating infrastructure investment worldwide, our services are in great demand. We invite you to bring your bold ideas and big dreams and become part of a global team of over 50,000 planners, designers, engineers, scientists, digital innovators, program and construction managers and other professionals delivering projects that create a positive and tangible impact around the world.</p><p>
We're one global team driven by our common purpose to deliver a better world. Join us.</p><b><br>
Job Description</b><p><b><br>
AECOM</b> is seeking an <b>Electrical Engineer Technical Lead, Data Center</b> specializing in <b>Hyper-scale Data Centers</b> to act as Data Center Electrical Engineer Lead<b>.</b> The job incumbent will be responsible for designing, implementing, and maintaining electrical systems in large-scale data centers. This position is a remote opportunity and can be based out of any of AECOM's U.S. offices.</p><p>
The Electrical Engineer will play a critical role in ensuring the reliability, efficiency, and safety of our data center infrastructure. The ideal candidate will have a strong background in electrical engineering and experience working with high-density data centers.</p><p><i>
This position offers the flexibility of a remote work schedule and can be based from a variety of locations in the US where AECOM has an office.</i></p><p><b><i>
Although the position is primarily remote periodic travel may be required for client meetings, key project milestones, onsite collaboration sessions, or other business‑critical activities. Travel is expected to be occasional and scheduled in advance</i></b></p><p><b>
AECOM </b>is a leader in the global data center consulting industry with robust teams in the Americas, Europe, Africa, Asia, and Australia. In this role, you will have the opportunity to work with our teams around the world on high-profile, fast-paced data center projects for global clients. This is a hands-on, client-facing role with an opportunity for upward career mobility.</p><p>
Responsibilities:</p><ul><li>
Design and implement electrical systems for hyper-scale data centers, including medium and low-voltage power distribution, backup power systems, and emergency systems</li><li>
Develop and maintain electrical schematics, bills of materials, and installation drawings</li><li>
Ensure compliance with industry standards, codes, and regulations, including National Electric Code (NEC) and International Electrotechnical Commission (IEC) standards</li><li>
Collaborate with other engineers and stakeholders to develop specifications, design criteria, and project budgets</li><li>
Analyze electrical systems to identify and resolve issues, including load balancing, capacity planning, and power consumption optimization</li><li>
Monitor and maintain the electrical systems, including performing preventative maintenance, testing, and repairs</li><li>
Develop and implement electrical safety procedures and training programs for technicians and other staff</li><li>
Stay up-to-date with advancements in electrical engineering and data center technologies, and recommend new technologies to improve the reliability and efficiency of our data center infrastructure</li><li>
Is accountable for project success in the electrical discipline.</li><li>
Provides specialized technical input to supporting staff, acting as a mentor and leader for mid-level engineers</li><li>
Approves and signs off on work, acting as Engineer of Record</li><li>
Provides estimates for the engineering budget and schedule a to meet requirements on large, complex projects</li><li>
Leads technical client relationships and plays a major role in selling</li></ul><br>
<b>
Qualifications</b><p><b><br>
Minimum Qualifications:</b></p><ul><li>
Bachelor&rsquo;s degree in Electrical Engineering plus eight (8) years of relevant experience in electrical design and/or electrical engineering, with a focus on data center infrastructure, or demonstrated equivalency of experience and/or education</li><li>
Professional Engineer License (P.E.) or Professional Engineer Designation (P. Eng) is required</li></ul><p><b>
Preferred Qualifications:</b></p><ul><li>
Bachelor&rsquo;s degree in Electrical Engineering plus ten (10) years of relevant experience in electrical design and/or electrical engineering, with a focus on data center infrastructure, or demonstrated equivalency of experience and/or education</li><li>
Extensive experience in electrical engineering for data centers or other critical facilities.</li><li>
Strong knowledge of NEC (NFPA70)</li><li>
Strong leadership, communication, and interpersonal skills</li><li>
Ability to build and maintain strong relationships with clients</li><li>
Ability to think creatively and identify opportunities to enhance the client experience.</li><li>
Experience working with building information modeling (BIM) software, specifically ACC Cloud.</li><li>
Excellent leadership, communication, and interpersonal skills</li><li>
Experience with data center design and construction, including design criteria and industry standards</li></ul><br>
<b>
Additional Information</b><br>
<ul><li>
Relocation is not available for this position</li><li>
Sponsorship is available for this position</li></ul><div></div><p><b>
About AECOM</b></p><p>
AECOM is proud to offer comprehensive benefits to meet the diverse needs of our employees. Depending on your employment status, AECOM benefits may include medical, dental, vision, life, AD&amp;D, disability benefits, paid time off, leaves of absences, voluntary benefits, perks, flexible work options, well-being resources, employee assistance program, business travel insurance, service recognition awards, retirement savings plan, and employee stock purchase plan.</p><p>
AECOM is the global infrastructure leader, committed to delivering a better world. As a trusted professional services firm powered by deep technical abilities, we solve our clients&rsquo; complex challenges in water, environment, energy, transportation and buildings. Our teams partner with public- and private-sector clients to create innovative, sustainable and resilient solutions throughout the project lifecycle &ndash; from advisory, planning, design and engineering to program and construction management. AECOM is a Fortune 500 firm that had revenue of $16.1 billion in fiscal year 2025. Learn more at aecom.com.</p><p><b>
What makes AECOM a great place to work</b></p><p>
You will be part of a global team that champions your growth and career ambitions. Work on groundbreaking projects - both in your local community and on a global scale - that are transforming our industry and shaping the future. With cutting-edge technology and a network of experts, you&rsquo;ll have the resources to make a real impact. Our award-winning training and development programs are designed to expand your technical expertise and leadership skills, helping you build the career you&rsquo;ve always envisioned. Here, you&rsquo;ll find a welcoming workplace built on respect, collaboration and community&mdash;where you have the freedom to grow in a world of opportunity.</p><p>
As an Equal Opportunity Employer, we believe in your potential and are here to help you achieve it. All your information will be kept confidential according to EEO guidelines.</p></div>

Electrical Engineer Technical Lead, Data Centers - Remote (U.S.)

ASCENT

<div><p><b>Lead Python Engineer, Data Infrastructure</b></p><br>
<p></p>
<p><b>
About AscentAI</b></p>
<p>
AscentAI builds intelligent software to help risk and compliance teams at financial institutions keep pace with ever-evolving global regulation. Our platform transforms complex regulatory information into clear, actionable insights enabling teams to reduce risk, increase efficiency, and stay ahead of change.</p>
<p>
We're a small, mission-driven company pushing the boundaries of machine learning, artificial intelligence, and human-in-the-loop systems to solve some of the hardest problems in regulatory compliance.</p><br>
<p></p>
<p><b>
The Role</b></p>
<p>
We're looking for a Python Engineer to join our growing team. In this role, you'll be responsible for the design and implementation of robust, large-scale web scraping platforms that power AscentAI's data infrastructure. You'll collaborate closely with other engineers and analysts to define data requirements, architect efficient pipelines, and deliver reliable, high-quality data at scale.</p>
<p>
You'll also serve as the technical expert on scraping strategy, anti-bot countermeasures, and data extraction best practices for stakeholders across engineering, data science, and product. This is a high-impact role with real ownership and visibility, offering the opportunity to influence both our technical architecture and business outcomes.</p>
<p><b>
What You'll Do</b></p>
<ul>
<li>Lead the design and implementation of robust, efficient, and large-scale web scraping platforms using Python and associated frameworks.</li>
<li>Mentor junior developers, and provide technical guidance. Conduct code reviews to ensure the delivery of high-quality, maintainable code.</li>
<li>Develop sophisticated strategies to handle and bypass advanced anti-bot countermeasures like CAPTCHAs, Cloudflare, and IP blocking, while ensuring all practices adhere to legal and ethical guidelines and website terms of service.</li>
<li>Collaborate with data analysts and data engineers to define data requirements and ensure seamless integration of scraped data into databases.</li>
<li>Optimize scrapers for speed, performance, and stability; set up real-time monitoring and alerting systems to quickly detect and resolve failures or site changes.</li>
<li>Create clear technical documentation and communicate effectively with cross-functional teams and stakeholders to ensure alignment and manage expectations.</li>
</ul>
<p><b>Experience</b></p>
<ul>
<li>5+ years of experience in Python development, with prior experience in a leadership or senior role.</li>
<li>Strong programming skills and deep knowledge of Python data structures and libraries.</li>
<li>Solid understanding of HTML, CSS, JavaScript, HTTP protocols, cookies, headers, and DOM manipulation.</li>
<li>Experience with data cleaning, processing, and storage in various database systems like PostgreSQL.</li>
<li>Strong problem-solving and analytical skills.</li>
<li>Excellent attention to detail and data accuracy.</li>
<li>Effective communication skills for collaborating with cross-functional teams.</li>
</ul>
<p><b>Preferred</b></p>
<ul>
<li>Experience with web scraping and data extraction.</li>
<li>Experience using frameworks and libraries such as Scrapy, Crawlee, Playwright, etc.</li>
<li>Familiarity with AWS and containerization technologies (Docker, Kubernetes).</li>
</ul>
<p><b>Why Join Us?</b></p>
<ul>
<li>A small, collaborative, and fast-moving team where your contributions will have an outsized impact.</li>
<li>The chance to work on meaningful problems in regulatory technology.</li>
<li>Remote-first culture with flexibility and autonomy.</li>
<li>Recognition in the regtech space for our innovation and customer value.</li></ul></div><p></p>

Lead Python Engineer, Data Infrastructure

American Medical Association (AMA)

<div><div><div><div><b>Sr. Data Engineer (Hybrid)</b></div></div><div><div><b>
Chicago, IL</b></div></div><div><div>
The American Medical Association (AMA) is the nation's largest professional Association of physicians and a non-profit organization. We are a unifying voice and powerful ally for America's physicians, the patients they care for, and the promise of a healthier nation. To be part of the AMA is to be part of our Mission to promote the art and science of medicine and the betterment of public health.</div></div><div></div><div><div><br>
At AMA, our mission to improve the health of the nation starts with our people. We foster an inclusive, people-first culture where every employee is empowered to perform at their best. Together, we advance meaningful change in health care and the communities we serve.</div></div><div></div><div><div><br>
We encourage and support professional development for our employees, and we are dedicated to social responsibility. We invite you to learn more about us and we look forward to getting to know you.</div></div><div></div><div><div><br>
We have an opportunity at our corporate offices in Chicago for a <b>Sr. Data Engineer (Hybrid) </b>on our Information Technology team. This is a hybrid position reporting into our Chicago, IL office, requiring 3 days a week in the office.</div></div><div></div><div><div><br>
As a Sr. Data Engineer, you will play a key role in implementing and maintaining AMA&rsquo;s enterprise data platform to support analytics, interoperability, and responsible AI adoption. This role partners closely with platform engineering, data governance, data science, IT security, and business stakeholders to deliver high‑quality, reliable, and secure data products. This role contributes to AMA&rsquo;s modern lakehouse architecture, optimizing data operations, and embedding governance and quality standards into engineering workflows. This role serves as a senior technical contributor within the team&mdash;providing mentorship to junior engineers and implementing engineering best practices within the data platform function, in alignment with architectural direction set by leadership.</div></div><div></div><div><div><b><br>
RESPONSIBILITIES:</b></div><div><b>
Data Engineering &amp; AI Enablement</b></div><ul><li>
Build and maintain scalable data pipelines and ETL/ELT workflows supporting analytics, operational reporting, and AI/ML use cases.</li><li>
Implement best practice patterns for ingestion, transformation, modeling, and orchestration within a modern lakehouse environment (e.g., Databricks, Delta Lake, Azure Data Lake).</li><li>
Develop high‑performance data models and curated datasets with strong attention to quality, usability, and interoperability; create reusable engineering components and automation.</li><li>
Collaborate with the Architecture Team, the Data Platform Lead, and federated IT teams to optimize storage, compute, and architectural patterns for performance and cost‑efficiency.</li><li>
Build model-ready data sets and feature pipelines to support AI/ ML use cases; serve as a technical coordination point supporting business units&rsquo; AI-related infrastructure needs.</li><li>
Collaborate with data scientists and AI Working Group to operationalize models responsibly and maintain ongoing monitoring signals.</li></ul><div></div><div><b><br>
Governance, Quality &amp; Compliance</b></div><ul><li>
Embed data governance, metadata standards, lineage tracking, and quality controls directly into engineering workflows; ensure technical implementation and alignment within engineering workflows.</li><li>
Work with the Data Governance Lead and business stakeholders to operationalize stewardship, classification, validation, retention, and access standards.</li><li>
Implement privacy‑by‑design and security‑by‑design principles, ensuring compliance with internal policies and regulatory obligations.</li><li>
Maintain documentation for pipelines, datasets, and transformations to support transparency and audit requirements.</li></ul><div></div><div><b><br>
Platform Reliability, Observability &amp; Optimization</b></div><ul><li>
Monitor and troubleshoot pipeline failures, performance bottlenecks, data anomalies, and platform‑level issues.</li><li>
Implement observability tooling, alerts, logging, and dashboards to ensure end‑to‑end reliability.</li><li>
Support cost governance by optimizing compute resources, refining job schedules, and advising on efficient architecture.</li><li>
Collaborate with the Data Platform Lead on scaling, configuration management, CI/CD pipelines, and environment management.</li><li>
Collaborate with business units to understand data needs, translate them into engineering requirements, and deliver fit-for-purpose data solutions; share and apply best practices and emerging technologies within assigned initiatives.</li>
Work with IT Security and Legal/ Compliance to ensure platform and datasets meet risk and regulatory standards.<br>
<li>
</li></ul><div><b>Staff Management</b></div><ul><li>
Lead, mentor, and provide management oversight for staff.</li><li>
Responsible for setting objectives, evaluating employee performance, and fostering a collaborative team environment.</li><li>
Responsible for developing staff knowledge and skills to support career development.</li></ul></div><div></div><div><div><b><br>
May include other responsibilities as assigned</b></div></div><div></div><div><div><b><br>
REQUIREMENTS:</b></div><br>
<div></div><ul><li>
Bachelor's degree in Computer Science, Engineering, Information Systems, or related field preferred or equivalent work experience and HS diploma/equivalent education required.</li><li>
5+ years of experience in data engineering within cloud environments</li><li>
Experience in people management preferred.</li><li>
Demonstrated hands-on experience with modern data platforms (Databricks preferred).</li><li>
Proficiency in Python, SQL, and data transformation frameworks.</li><li>
Experience designing and operationalizing ETL/ELT pipelines, orchestration workflows (Airflow, Databricks Workflows), and CI/CD processes.</li><li>
Solid understanding of data modeling, structured/unstructured data patterns, and schema design.</li><li>
Experience implementing governance and quality controls: metadata, lineage, validation, stewardship workflows.</li><li>
Working knowledge of cloud architecture, IAM, networking, and security best practices.</li><li>
Demonstrated ability to collaborate across technical and business teams.</li><li>
Exposure to AI/ML engineering concepts, feature stores, model monitoring, or MLOps patterns.</li><li>
Experience with infrastructure‑as‑code (Terraform, CloudFormation) or DevOps tooling.</li></ul><div></div><div><br>
 The American Medical Association is located at 330 N. Wabash Avenue, Chicago, IL 60611 and is convenient to all public transportation in Chicago.</div></div></div><div></div><div><div><br>
This role is an exempt position, and the salary range for this position is $115,523.42-$150,972.44. This is the lowest to highest salary we believe we would pay for this role at the time of this posting. An employee&rsquo;s pay within the salary range will be determined by a variety of factors including but not limited to business consideration and geographical location, as well as candidate qualifications, such as skills, education, and experience. Employees are also eligible to participate in an incentive plan. To learn more about the American Medical Association&rsquo;s benefits offerings, please click here.</div></div><div></div><div><div><br>
We are an equal opportunity employer, committed to diversity in our workforce. All qualified applicants will receive consideration for employment. As an EOE/AA employer, the American Medical Association will not discriminate in its employment practices due to an applicant&rsquo;s race, color, religion, sex, age, national origin, sexual orientation, gender identity and veteran or disability status.</div></div><div></div><div><div><b><br>
THE AMA IS COMMITTED TO IMPROVING THE HEALTH OF THE NATION</b></div></div></div>

Sr. Data Engineer (Hybrid)

Artius Solutions

<div>Lead DevOps Engineer
<p><b>Location:</b> Chicago, IL (Hybrid)<br>
<b>Employment Type:</b> Full-Time</p>
Overview
<p>A financial services organization based in Chicago, is seeking a <b>Lead DevOps Engineer</b> to help build and scale a modern DevSecOps platform supporting enterprise software delivery.</p>
<p>This role will partner closely with engineering, infrastructure, and security teams to design and implement automated development pipelines, cloud infrastructure, and deployment frameworks. The Lead DevOps Engineer will play a key role in improving developer productivity, strengthening security controls, and enabling scalable application delivery across cloud environments.</p>
<p>This is a hands-on leadership role that requires strong expertise in cloud infrastructure, CI/CD pipelines, container orchestration, and DevSecOps practices.</p>
Key Responsibilities DevSecOps Platform Engineering
<ul><li><p>Design and implement enterprise-grade <b>CI/CD pipelines</b> supporting automated application deployments across cloud environments.</p>
</li><li><p>Build reusable pipeline templates, infrastructure-as-code standards, and deployment frameworks to support engineering teams.</p>
</li><li><p>Lead migration and modernization initiatives related to DevOps tooling and platform architecture.</p>
</li></ul>Cloud Infrastructure &amp; Automation
<ul><li><p>Implement infrastructure automation using tools such as <b>Terraform, Ansible, or Chef</b>.</p>
</li><li><p>Deploy and manage containerized environments using <b>Docker and Kubernetes</b>.</p>
</li><li><p>Support highly available application platforms across public or hybrid cloud environments.</p>
</li></ul>Security &amp; Compliance Integration
<ul><li><p>Embed security practices directly into the software development lifecycle (DevSecOps).</p>
</li><li><p>Implement automated security scanning including <b>SAST, SCA, DAST, container scanning, and IaC security checks</b>.</p>
</li><li><p>Ensure infrastructure and deployment processes meet enterprise security, availability, and compliance standards.</p>
</li></ul>DevOps Culture &amp; Enablement
<ul><li><p>Mentor engineers and promote DevOps best practices across engineering teams.</p>
</li><li><p>Lead initiatives that improve developer workflows, platform adoption, and operational efficiency.</p>
</li><li><p>Support the establishment of internal engineering standards and platform governance practices.</p>
</li></ul>Observability &amp; Performance Monitoring
<ul><li><p>Implement monitoring and observability solutions using tools such as <b>Datadog or other APM platforms</b>.</p>
</li><li><p>Develop dashboards and metrics to track DevOps platform performance, adoption, and operational health.</p>
</li><li><p>Identify opportunities to improve reliability, scalability, and deployment efficiency.</p>
</li></ul>Cross-Team Collaboration
<ul><li><p>Work closely with development, architecture, infrastructure, and security teams to deliver reliable platforms and services.</p>
</li><li><p>Participate in architecture discussions related to cloud platforms, deployment strategies, and platform reliability.</p>
</li><li><p>Contribute to technical evaluations of new tools, technologies, and vendor solutions.</p>
</li></ul>Qualifications Education
<ul><li><p>Bachelor's degree in <b>Computer Science, Engineering, or a related technical discipline</b>, or equivalent experience</p>
</li></ul>Experience
<ul><li><p><b>7+ years of DevOps, cloud engineering, or platform engineering experience</b></p>
</li><li><p>Experience working in <b>Agile or Scrum software development environments</b></p>
</li><li><p>Experience leading DevOps initiatives or mentoring engineering teams</p>
</li></ul>DevOps &amp; Cloud Technologies
<ul><li><p>Experience with <b>CI/CD tools</b> such as Azure DevOps, Jenkins, TeamCity, Octopus, or Bamboo</p>
</li><li><p>Strong experience with <b>containerization and orchestration (Docker, Kubernetes)</b></p>
</li><li><p>Experience building <b>infrastructure-as-code solutions using Terraform</b></p>
</li><li><p>Experience deploying and managing workloads in <b>AWS and/or Azure environments</b></p>
</li></ul>Programming &amp; Automation
<ul><li><p>Strong scripting and automation experience using <b>Python or similar languages</b></p>
</li><li><p>Experience with build automation tools and package management systems</p>
</li><li><p>Familiarity with structured programming and software engineering principles</p>
</li></ul>Security &amp; Quality Tools
<ul><li><p>Experience implementing <b>static code analysis and security scanning tools</b></p>
</li><li><p>Experience with code quality platforms such as <b>SonarQube</b></p>
</li><li><p>Experience implementing automated testing within CI/CD pipelines</p>
</li></ul>Data &amp; Monitoring Technologies
<ul><li><p>Experience with <b>application performance monitoring tools</b></p>
</li><li><p>Experience with relational and NoSQL databases such as <b>MySQL, PostgreSQL, DynamoDB, MongoDB, or graph databases</b></p>
</li></ul>Additional Skills
<ul><li><p>Strong communication and collaboration skills</p>
</li><li><p>Ability to translate complex technical concepts into actionable solutions</p>
</li><li><p>Experience designing scalable and secure DevOps architectures</p>
</li></ul><p>.</p></div>

Lead DevOps Engineer

Explore 692+ Lead data engineer in Chicago this March. Find roles across top companies and apply now to boost your career.