software engineer

data analyst

senior data engineer

senior data scientist

data scientist

senior data engineer python spark aws

Information Technology Senior Management Forum

<div><div>Posted Date
3/05/2026
</div><div>Description
<div>Senior Data Engineer (Python, Spark, AWS)
Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? 
 
At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you&rsquo;ll have the opportunity to be on the forefront of driving a major transformation within Capital One.
What You&rsquo;ll Do:<ul><li>
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies</li><li>
Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems</li><li>
Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake</li><li>
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal &amp; external technology communities, and mentoring other members of the engineering community</li><li>
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment</li><li>
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance</li></ul>
Basic Qualifications:<ul><li>
Bachelor&rsquo;s Degree</li><li>
At least 3 years of experience in application development (Internship experience does not apply)</li><li>
At least 1 year of experience in big data technologies</li></ul>
Preferred Qualifications:<ul><li>
5+ years of experience in application development including Python, SQL, Scala, or Java</li><li>
2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)</li><li>
3+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)</li><li>
2+ year experience working on real-time data and streaming applications</li><li>
2+ years of experience with NoSQL implementation (Mongo, Cassandra)</li><li>
2+ years of data warehousing experience (Redshift or Snowflake)</li><li>
3+ years of experience with UNIX/Linux including basic commands and shell scripting</li><li>
2+ years of experience with Agile engineering practices</li></ul>
At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer).
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.
New York, NY: $176,500 - $201,400 for Senior Data Engineer 
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate&rsquo;s offer letter.
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.
Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.
This role is expected to accept applications for a minimum of 5 business days.No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City&rsquo;s Fair Chance Act; Philadelphia&rsquo;s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.
For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).
Senior Data Engineer (Python, Spark, AWS)
Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? 
 
At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you&rsquo;ll have the opportunity to be on the forefront of driving a major transformation within Capital One.
What You&rsquo;ll Do:<ul><li>
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies</li><li>
Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems</li><li>
Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake</li><li>
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal &amp; external technology communities, and mentoring other members of the engineering community</li><li>
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment</li><li>
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance</li></ul>
Basic Qualifications:<ul><li>
Bachelor&rsquo;s Degree</li><li>
At least 3 years of experience in application development (Internship experience does not apply)</li><li>
At least 1 year of experience in big data technologies</li></ul>
Preferred Qualifications:<ul><li>
5+ years of experience in application development including Python, SQL, Scala, or Java</li><li>
2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)</li><li>
3+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)</li><li>
2+ year experience working on real-time data and streaming applications</li><li>
2+ years of experience with NoSQL implementation (Mongo, Cassandra)</li><li>
2+ years of data warehousing experience (Redshift or Snowflake)</li><li>
3+ years of experience with UNIX/Linux including basic commands and shell scripting</li><li>
2+ years of experience with Agile engineering practices</li></ul>
At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer).
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.
New York, NY: $176,500 - $201,400 for Senior Data Engineer 
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate&rsquo;s offer letter.
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.
Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.
This role is expected to accept applications for a minimum of 5 business days.No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City&rsquo;s Fair Chance Act; Philadelphia&rsquo;s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.
For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).</div>
</div><div>Salary
176,500.00 - 201,400.00 Annual
</div><div></div><div><div>Type<div>
Full-time</div></div></div></div>

Senior Data Engineer (Python, Spark, AWS)

Capital One

<div>Senior Data Engineer (Python, Spark, AWS)
Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? 
 
At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you&rsquo;ll have the opportunity to be on the forefront of driving a major transformation within Capital One.
What You&rsquo;ll Do:<ul><li>
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies</li><li>
Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems</li><li>
Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake</li><li>
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal &amp; external technology communities, and mentoring other members of the engineering community</li><li>
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment</li><li>
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance</li></ul>
Basic Qualifications:<ul><li>
Bachelor&rsquo;s Degree</li><li>
At least 3 years of experience in application development (Internship experience does not apply)</li><li>
At least 1 year of experience in big data technologies</li></ul>
Preferred Qualifications:<ul><li>
5+ years of experience in application development including Python, SQL, Scala, or Java</li><li>
2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)</li><li>
3+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)</li><li>
2+ year experience working on real-time data and streaming applications</li><li>
2+ years of experience with NoSQL implementation (Mongo, Cassandra)</li><li>
2+ years of data warehousing experience (Redshift or Snowflake)</li><li>
3+ years of experience with UNIX/Linux including basic commands and shell scripting</li><li>
2+ years of experience with Agile engineering practices</li></ul>
At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer).
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.
New York, NY: $176,500 - $201,400 for Senior Data Engineer 
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate&rsquo;s offer letter.
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.
Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.
This role is expected to accept applications for a minimum of 5 business days.
No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City&rsquo;s Fair Chance Act; Philadelphia&rsquo;s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.
For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).</div>

<div><div>Posted Date
3/05/2026
</div><div>Description
<div>Senior Data Engineer (AWS, Spark, Python, SQL)
Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you&rsquo;ll have the opportunity to be on the forefront of driving a major transformation within Capital One.
What You&rsquo;ll Do:<ul><li>
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies</li><li>
Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems</li><li>
Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake</li><li>
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal &amp; external technology communities, and mentoring other members of the engineering community</li><li>
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment</li><li>
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance</li></ul>
Basic Qualifications:<ul><li>
Bachelor&rsquo;s Degree</li><li>
At least 3 years of experience in application development (Internship experience does not apply)</li><li>
At least 1 year of experience in big data technologies</li></ul>
Preferred Qualifications:<ul><li>
5+ years of experience in application development including Python, SQL, Scala, or Java</li><li>
2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)</li><li>
3+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)</li><li>
2+ year experience working on real-time data and streaming applications</li><li>
2+ years of experience with NoSQL implementation (Mongo, Cassandra)</li><li>
2+ years of data warehousing experience (Redshift or Snowflake)</li><li>
3+ years of experience with UNIX/Linux including basic commands and shell scripting</li><li>
2+ years of experience with Agile engineering practices</li></ul>
At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer).
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.
New York, NY: $176,500 - $201,400 for Senior Data Engineer 
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate&rsquo;s offer letter.
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.
Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.
This role is expected to accept applications for a minimum of 5 business days.No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City&rsquo;s Fair Chance Act; Philadelphia&rsquo;s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.
For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).
Senior Data Engineer (AWS, Spark, Python, SQL)
Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you&rsquo;ll have the opportunity to be on the forefront of driving a major transformation within Capital One.
What You&rsquo;ll Do:<ul><li>
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies</li><li>
Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems</li><li>
Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake</li><li>
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal &amp; external technology communities, and mentoring other members of the engineering community</li><li>
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment</li><li>
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance</li></ul>
Basic Qualifications:<ul><li>
Bachelor&rsquo;s Degree</li><li>
At least 3 years of experience in application development (Internship experience does not apply)</li><li>
At least 1 year of experience in big data technologies</li></ul>
Preferred Qualifications:<ul><li>
5+ years of experience in application development including Python, SQL, Scala, or Java</li><li>
2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)</li><li>
3+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)</li><li>
2+ year experience working on real-time data and streaming applications</li><li>
2+ years of experience with NoSQL implementation (Mongo, Cassandra)</li><li>
2+ years of data warehousing experience (Redshift or Snowflake)</li><li>
3+ years of experience with UNIX/Linux including basic commands and shell scripting</li><li>
2+ years of experience with Agile engineering practices</li></ul>
At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer).
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.
New York, NY: $176,500 - $201,400 for Senior Data Engineer 
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate&rsquo;s offer letter.
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.
Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.
This role is expected to accept applications for a minimum of 5 business days.No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City&rsquo;s Fair Chance Act; Philadelphia&rsquo;s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.
For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).</div>
</div><div>Salary
176,500.00 - 201,400.00 Annual
</div><div></div><div><div>Type<div>
Full-time</div></div></div></div>

Senior Data Engineer (AWS, Spark, Python, SQL)

The Cypress Group

<div>
 
 Our client is a growing Fintech software company Headquarted in New York, NY. They have several hundred employees and are in growth mode.
 
 
 
 
 
 They are currently looking for a Senior Data Engineer w/ 6+ years of overall professional experience. Qualified candidates will have hands-on experience with Python (6 years), SQL (6 years), DBT (3 years), AWS (Lambda, Glue), Airflow and Snowflake (3 years). BSCS and good CS fundamentals.
 
 
 
 
 
 The Senior Data Engineer will work in a collaborative team environment and will be responsible for building, optimizing and scaling ETL Data Pipelines, DBT models and Datawarehousing. Excellent communication and organizational skills are expected.
 
 
 
 
 
 This role features competitive base salary, equity, 401(k) with company match and many other attractive perks. Please send your resume to nyjobs@cypressg.com for immediate consideration.
 
</div>

Senior Data Engineer

Affinity Solutions

<div>Affinity Solutions (Affinity) is the leading consumer purchase insights company. We provide a complete view of U.S. and U.K. consumer spending, across and between brands, via exclusive access to fully permissioned data from over 100 million consumers. Our proprietary AI technology, Comet&trade;, transforms these purchase signals into actionable insights for business and marketing leaders to drive optimal outcomes and build lasting customer relationships. Visit www.affinitysolutions.com to discover how we&rsquo;re shaping the future of consumer purchase insights.
About Your Role:
Affinity is seeking a highly skilled and experienced Senior Data and Software Engineer I (API) to join our team. In this role, you will be responsible for architecting, building, and maintaining high-performance RESTful APIs that serve as the backbone of our data integration ecosystem. This position requires deep expertise in API development, data technologies, cloud environments, data clean rooms, and modern software engineering practices.
Your Responsibilities:
<ul><li>Design, develop, and maintain high-performance RESTful APIs that handle large-scale data operations with optimal efficiency and minimal latency</li>
<li>Stay current with emerging API technologies, standards, and best practices, including GraphQL, gRPC, OpenAPI 3.0+, and modern authentication/authorization frameworks</li>
<li>Implement performance optimization strategies for APIs, including caching, rate limiting, pagination, and asynchronous processing, to ensure scalability and reliability</li>
<li>Integrate with third-party API vendors and external systems, managing authentication, data transformation, and error handling, and ensuring seamless interoperability</li>
<li>Develop comprehensive API documentation using industry standards (Swagger/OpenAPI) and implement robust monitoring, logging, and observability solutions</li>
<li>Design and implement data privacy features and services to enable secure multi-party collaboration, including query constraints, data clean room construction, deployment, and monitoring at scale</li>
<li>Uphold data governance standards and practices, ensuring compliance with data quality standards</li>
<li>Implement and enforce data security measures to protect sensitive data, including personally identifiable information (PII) and financial data</li>
<li>Leverage SQL and Python programming proficiency to extract, transform, clean, and interpret large data volumes (200BIL+ records)</li>
<li>Design highly performant data structures to ensure optimal storage and retrieval of data</li>
<li>Utilize advanced database technologies to enhance data storage and processing capabilities</li>
<li>Participate in code reviews to maintain code quality and consistency; collaborate with the infrastructure team to plan and execute deployments</li>
<li>Lead and manage integration projects, including:
<ul><li>LiveRamp XMI Integration and Salesforce integration
</li><li>Additional clean rooms (AWS/AMC) modeling integration</li>
<li>CAPI integrations with walled gardens on behalf of brands</li>
<li>MadConnect integration pipes and buildout</li>
<li>Opening new integration channels based on client demand</li>
</ul></li></ul>Your Qualifications:
<ul><li>Extensive experience building production-grade RESTful APIs with proven expertise in API design patterns, versioning strategies, and backward compatibility</li>
<li>Deep understanding of API performance optimization techniques, including query optimization, connection pooling, request batching, and response compression</li>
<li>Strong knowledge of modern API technologies and standards, including OpenAPI/Swagger specifications, OAuth 2.0, JWT, GraphQL, and API gateway patterns</li>
<li>Demonstrated success integrating with external API vendors and managing complex API ecosystems with multiple third-party dependencies</li>
<li>Experience with API testing frameworks, contract testing, and implementing comprehensive API monitoring and alerting systems</li>
<li>6 or more years of experience as a back-end data/software engineer working on various data technologies, with proficiency in SQL, Python, and Javascript (Node.js)</li>
<li>2 or more years of hands-on experience with Snowflake ecosystem, including expert knowledge of SnowPipes, Streams, Views, performance tuning, data modeling, ELT pipelines, data visualizations, and standard DWH concepts, and experience implementing complex SQL stored procedures</li>
<li>Minimum 3 years' experience with various AWS cloud technologies and data lake management such as S3, Lambda, Airflow, Redshift, Athena, and Glue</li>
<li>Demonstratable knowledge of data clean room technologies (e.g., creating secure data shares using RBAC). Knowledge of Snowflake Native apps (v6+) preferred</li>
<li>Knowledge of all aspects of the SDLC as well as experience with Jenkins and setting up CI/CD processes</li>
<li>Experience with security concepts such as CCPA, GDPR, SSO, and JWT</li>
<li>Proficiency in data access controls, including aggregation constraints, projection policies, row access policies, column masking, and differential privacy; knowledge of data controls including semantic models, dbt, honeydew, Iceberg tables, various catalogs (glue, rest, nessie, hadoop etc), and catalog syncing concepts</li>
<li>Experience with cloud environments such as SNOWFLAKE, AWS, DATABRICKS, LIVERAMP, and GCP</li>
<li>Familiarity with BI tools such as Thoughtspot, Sigma, Domo, Looker, Quicksights, Tableau; detailed knowledge of AI concepts such as Generative AI chatbots, cortex analyst, agent training, various LLMs, and prompt engineering</li>
<li>Experience in modeling: Snowpark ML, TensorFlow</li>
<li>Expert-level experience building, maintaining, and scaling APIs using Node.js, Express, Fastify, or similar frameworks; proficiency with Swagger/OpenAPI specifications, API documentation tools, Next.js, and modern API development practices</li>
</ul>
Salary Range: $145,000 &ndash; $160,000 
Office hours: 9am &ndash; 5:30pm
Benefits for full-time employees of Affinity Solutions begin on the first of the month following your date of hire with a generous employer contribution for medical, dental, and vision. In addition to company paid holidays, wellness time off, other wellness benefits, and employee discounts, you will also get employer paid life insurance and have the option to enroll into an employer-matched 401K Plan. We strongly encourage work/life balance by providing unlimited vacation days, available starting 90 days from your hire date as a team member.</div>

Senior Data and Software Engineer I (API) (32_2026.1)

<div>Affinity Solutions is the leading consumer purchase insights company. We provide a complete view of U.S. and U.K. consumer spending, across and between brands, via exclusive access to fully permissioned transaction data from over 100 million consumers. Our proprietary AI technology, Comet&trade;, transforms these purchase signals into actionable insights for business and marketing leaders to drive optimal outcomes and build lasting customer relationships. Visit www.affinitysolutions.com to discover how we're shaping the future of consumer purchase insights.
About Your Role:
Affinity is seeking an accomplished Sr. Data Quality Engineer I to ensure the quality, reliability, and accuracy of data pipelines, APIs, integrations, and data products built by our software engineering teams. In this critical role, you will design and implement comprehensive quality testing frameworks, validate data integrity across complex systems, and partner with data engineers and software engineers to deliver trusted, high-performance solutions.
Your Responsibilities:
<ul><li>Quality Testing and Validation
<ul><li>Design, develop, and execute comprehensive test strategies for data pipelines, APIs, integrations, and data products built by software engineering teams
</li><li>Develop and maintain automated testing frameworks for API validation, data quality checks, integration testing, and end-to-end pipeline testing</li>
<li>Perform thorough testing of RESTful APIs, including functional testing, performance testing, security testing, contract testing, and integration testing with third-party vendors</li>
<li>Validate data accuracy, completeness, consistency, and timeliness across ETL/ELT pipelines, data warehouses, and data lake environments</li>
<li>Test data clean room implementations, privacy controls, query constraints, and secure data-sharing mechanisms to ensure compliance with security standards</li>
<li>Create and maintain comprehensive test cases, test data sets, and testing documentation for all quality assurance activities 
</li></ul></li><li>Data Pipeline and Integration Testing
<ul><li>Validate data transformations, aggregations, and calculations across Snowflake, AWS, and other cloud data platforms</li>
<li>Test integration pipelines, including LiveRamp XMI, Salesforce, AWS/AMC clean rooms, CAPI integrations, and MadConnect to ensure seamless data flow and accuracy</li>
<li>Perform regression testing on data pipelines to ensure changes do not introduce data quality issues or break existing functionality</li>
<li>Validate data lineage and metadata accuracy and ensure proper implementation of data governance controls</li>
<li>Test database performance, query optimization, and data structure implementations to identify bottlenecks and ensure optimal performance at scale (200BIL+ records) 
</li></ul></li><li>Automation and Monitoring
<ul><li>Build and maintain CI/CD test automation pipelines using Jenkins and other DevOps tools to enable continuous quality validation</li>
<li>Implement automated data quality monitoring, anomaly detection, and alerting systems to proactively identify issues</li>
<li>Develop test harnesses and mock services for isolated component testing and integration validation</li>
<li>Create performance benchmarks and load testing scenarios to validate system scalability and reliability</li>
<li>Establish and track quality metrics, test coverage, defect rates, and SLAs to measure and improve testing effectiveness 
</li></ul></li><li>Compliance and Security Testing
<ul><li>Validate implementation of data privacy regulations (GDPR, CCPA, HIPAA) and ensure compliance across all data products</li>
<li>Test security measures, including data encryption, masking, tokenization, role-based access controls (RBAC), and authentication mechanisms (OAuth, JWT, SSO)</li>
<li>Verify proper implementation of data access controls including aggregation constraints, projection policies, row access policies, column masking, and differential privacy</li>
<li>Conduct security testing on APIs and integrations to identify vulnerabilities and ensure adherence to security best practices 
</li></ul></li><li>Collaboration and Documentation
<ul><li>Collaborate closely with senior data and software engineers (API and integrations) to understand requirements, identify test scenarios, and provide quality feedback early in the development cycle</li>
<li>Participate in code reviews, design discussions, and sprint planning to ensure quality is built into solutions from the start</li>
<li>Document test plans, test results, defects, and quality reports with clear, actionable insights for engineering teams</li>
<li>Provide technical mentorship to junior QA engineers and promote testing best practices across the organization</li>
<li>Partner with infrastructure teams to coordinate test environment setup and deployment validation 
</li></ul></li><li>Continuous Improvement
<ul><li>Stay current with emerging testing technologies, tools, and methodologies in data quality, API testing, and test automation
</li><li>Identify opportunities to improve testing efficiency, reduce testing cycles, and enhance overall quality processes</li>
<li>Lead proof-of-concept initiatives to evaluate new testing tools and frameworks (Great Expectations, Soda Core, Postman, REST Assured, etc.)</li>
<li>Drive strategic recommendations to enhance data quality validation, testing coverage, and organizational quality maturity</li>
</ul></li></ul>Your Qualifications:
<ul><li>Bachelor's degree in Computer Science, Information Systems, Data Engineering, Software Engineering, or related technical field; Master's degree preferred</li>
<li>5+ years of progressive experience in data quality engineering, QA engineering, or test automation with focus on data systems and APIs</li>
<li>Demonstrated track record of implementing comprehensive testing frameworks for enterprise-scale data platforms and APIs</li>
<li>Proven experience testing complex data pipelines, integrations, and RESTful APIs in production environments</li>
<li>Core Testing Competencies:
<ul><li>Expert-level experience with API testing tools and frameworks (Postman, REST Assured, SoapUI, JMeter, Swagger/OpenAPI)</li>
<li>Strong proficiency in SQL for data validation, query testing, and database verification across large datasets</li>
<li>Advanced Python programming skills for test automation, data validation scripts, and custom testing tools (pytest, unittest)</li>
<li>Experience with data quality testing tools (Great Expectations, Soda Core, dbt tests, or similar)</li>
<li>Strong understanding of ETL/ELT testing methodologies and data pipeline validation techniques</li>
<li>Knowledge of test automation frameworks and CI/CD integration (Selenium, Jenkins, GitLab CI, GitHub Actions)</li>
<li>Experience with performance testing and load testing tools for APIs and data systems (JMeter, Gatling, Locust)</li>
</ul></li><li>Platform and Technology Experience:
<ul><li>Hands-on experience testing in cloud platforms (AWS, Google Cloud Platform, or Azure)</li>
<li>2+ years of experience with Snowflake ecosystem, including testing SnowPipes, Streams, Views, stored procedures, and data models</li>
<li>Experience with AWS services testing (S3, Lambda, Airflow, Redshift, Athena, Glue)</li>
<li>Familiarity with data warehouses (Amazon Redshift, Google BigQuery, Snowflake) and testing data at scale</li>
<li>Knowledge of data clean room technologies and testing secure data shares using RBAC</li>
<li>Experience with version control systems (Git) and testing in CI/CD environments</li>
<li>Understanding of workflow orchestration tools (Apache Airflow, Prefect, Dagster) for pipeline testing</li>
</ul></li><li>API and Integration Testing:
<ul><li>Extensive experience with RESTful API testing, including functional, integration, contract, security, and performance testing</li>
<li>Knowledge of API standards (OpenAPI/Swagger, OAuth 2.0, JWT, GraphQL); able to validate implementations</li>
<li>Experience testing third-party API integrations (LiveRamp, Salesforce, AWS/AMC, CAPI, MadConnect)</li>
<li>Understanding of API monitoring, logging, and observability solutions for quality validation</li>
</ul></li><li>Data Governance and Compliance Testing:
<ul><li>Working knowledge of data privacy regulations (GDPR, CCPA, HIPAA); able to validate compliance</li>
<li>Experience testing data security implementations including encryption, masking, tokenization, and access controls</li>
<li>Understanding of data access controls testing (aggregation constraints, projection policies, row access policies, column masking, differential privacy)</li>
<li>Experience validating metadata management, data lineage, and data cataloging implementations</li>
</ul></li></ul>Additional Preferred Qualifications:
<ul><li>Experience with distributed computing frameworks (Apache Spark, Hadoop) and testing data at scale (200BIL+ records)</li>
<li>Familiarity with BI tools (Thoughtspot, Sigma, Looker, Tableau) for validating data visualizations and reports</li>
<li>Knowledge of data modeling methodologies (dimensional modeling, data vault, 3NF) to inform testing strategies</li>
<li>Understanding of JavaScript/Node.js for API testing and test automation</li>
<li>Experience with data cataloging and governance platforms (Datahub, Openmetadata, Alation)</li>
</ul>
Salary Range: $130,000 &ndash; $145,000 
Office Hours: 9am &ndash; 5:30pm
Benefits for full-time employees of Affinity Solutions begin on the first of the month following your date of hire with a generous employer contribution for medical, dental, and vision. In addition to company paid holidays, wellness time off, other wellness benefits, and employee discounts, you will also get employer paid life insurance and have the option to enroll into an employer-matched 401K Plan. We strongly encourage work/life balance by providing unlimited vacation days, available starting 90 days from your hire date as a team member.</div>

Sr. Data Quality Engineer I (37_2026.1)

CVS Health

<div>We&rsquo;re building a world of health around every individual &mdash; shaping a more connected, convenient and compassionate health experience. At CVS Health&reg;, you&rsquo;ll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger &ndash; helping to simplify health care one person, one family and one community at a time.
Position Summary
If you&rsquo;re eager to make a real impact in the health care industry through your own meaningful contributions, explore a role in technology with CVS Health. Our journey calls for technical innovators and data visionaries: come help us pave the way.
At CVS Health, we possess an extensive repository of healthcare data that spans over 150 million individuals, providing an unparalleled foundation for ambitious Data Engineers. In this role, you will engage with complex business challenges, harnessing modern tools and technologies to securely store, process, transform, and enrich terabyte to petabyte scale healthcare data. Your work will underpin data-driven business decisions and contribute to our mission of delivering industry-best data products / software with a customer-first mindset and team-oriented approach.
As a Senior Data Engineer, you will be instrumental in designing, developing, and maintaining optimal data pipelines to assemble large and intricate datasets, catering to the business requirements of various CVS lines of business. Collaborating closely with teams, you will craft tools to provide actionable insights and integrate them with consumer touchpoints.
In this role, you will:<ul><li>
Architect and develop robust, scalable ETL/ELT pipelines using Cloud Dataflow, Cloud composer (Airflow), and Pub/Sub for both batch and streaming use cases. Leverage BigQuery as the central data warehouse and design integrations with other GCP services (e.g., Cloud storage, Cloud functions).</li><li>
Build and optimize analytical data models in BigQuery. Implement partitioning, clustering, and materialized views for performance and cost efficiency. Ensure compliance with data governance, access controls, and IAM best practices.</li><li>
Develop integrations with external systems (APIs, flat files etc.) using GCP-native or hybrid approaches. Utiilize tools like Dataflow or custom Python/Java services on Cloud Functions or Cloud Run to handle transformations and ingestion logic.</li><li>
Build automated CI/CD pipeline using Cloud Build, GitHub Actions, or Jenkins for deploying data pipeline code and workflows. Set up observability using Cloud Monitoring, Cloud Logging, and Error Reporting to ensure pipeline reliability.</li><li>
Lead architectural decisions for data platforms and mentor junior engineers on cloud-native data engineering patterns. Promote best practices for code quality, version control, cost optimization, and data security in a GCP environment. Drive initiatives around data democratization, including building reusable datasets and data catalogs via Datapelx or Data Catalog.</li></ul>
As leaders in healthcare, our analytics and engineering teams deliver innovative solutions to business problems by collaborating with cross-functional teams in a dynamic and agile environment. You will be part of a team that values collaboration and encourages innovative thinking at all levels. You will be intellectually challenged to solve problems associated with large scale complex, structured and unstructured data, that will allow you to grow your technical skills and engineering expertise.
This role may work onsite 2 days a week in one of CVS Health's core hubs in: NYC, Hartford, CT or Wellesley, MA. Full-time Remote candidates will also be considered.
Required Qualifications<ul><li>
3+ years of experience with SQL, NoSQL</li><li>
3+ years of experience with Python (or a comparable scripting language)</li><li>
3+ years of experience with Data warehouses (such as data modeling and technical architectures) and infrastructure components</li><li>
3+ years of experience with ETL/ELT, and building high-volume data pipelines</li><li>
3+ years of experience with reporting/analytic tools</li><li>
3+ years of experience with Query optimization, data structures, transformation, metadata, dependency, and workload management</li><li>
3+ years of experience with Big data and cloud architecture</li><li>
3+ years of hands-on experience building modern data pipelines within a major cloud platform (GCP, AWS, Azure)</li><li>
3+ years of experience with deployment/scaling of apps on containerized environment (i.e. Kubernetes, AKS)</li><li>
3+ years of experience with real-time and streaming technology (i.e. Azure Event Hubs, Azure Functions, Kafka, Spark Streaming)</li><li>
1+ year(s) of soliciting complex requirements and managing relationships with key stakeholders</li><li>
1+ year(s) of experience independently managing deliverables</li></ul>
Preferred Qualifications<ul><li>
Experience in designing and building data engineering solutions in cloud environments (preferably GCP)</li><li>
Experience with Git, CI/CD pipeline, and other DevOps principles/best practices</li><li>
Experience with bash shell scripts, UNIX utilities &amp; UNIX Commands</li><li>
Ability to leverage multiple tools and programming languages to analyze and manipulate data sets from disparate data sources</li><li>
Knowledge of API development</li><li>
Experience with complex systems and solving challenging analytical problems</li><li>
Strong collaboration and communication skills within and across teams</li><li>
Knowledge of data visualization and reporting</li><li>
Experience with schema design and dimensional data modeling</li><li>
Google Professional Data Engineer Certification</li><li>
Knowledge of microservices and SOA</li><li>
Formal SAFe and/or agile experience. Previous healthcare experience and domain knowledge</li><li>
Experience designing, building, and maintaining data processing systems</li><li>
Experience architecting and building data warehouse and data lakes</li></ul>
Education<ul><li>
Bachelor&rsquo;s Degree or equivalent work experience in Computer Science, Information Systems, Data Engineering, Data Analytics, Machine Learning, or related field required</li><li>
Master&rsquo;s Degree preferred</li></ul>
Anticipated Weekly Hours
40
Time Type
Full time
Pay Range
The typical pay range for this role is:
$83,430.00 - $222,480.00
This pay range represents the base hourly rate or base annual full-time salary for all positions in the job grade within which this position falls. The actual base salary offer will depend on a variety of factors including experience, education, geography and other relevant factors. This position is eligible for a CVS Health bonus, commission or short-term incentive program in addition to the base pay range listed above. 
Our people fuel our future. Our teams reflect the customers, patients, members and communities we serve and we are committed to fostering a workplace where every colleague feels valued and that they belong.
Great benefits for great people
We take pride in our comprehensive and competitive mix of pay and benefits &ndash; investing in the physical, emotional and financial wellness of our colleagues and their families to help them be the healthiest they can be. In addition to our competitive wages, our great benefits include:<ul><li>
Affordable medical plan options, a 401(k) plan (including matching company contributions), and an employee stock purchase plan.</li><li>
No-cost programs for all colleagues including wellness screenings, tobacco cessation and weight management programs, confidential counseling and financial coaching.</li><li>
Benefit solutions that address the different needs and preferences of our colleagues including paid time off, flexible work schedules, family leave, dependent care resources, colleague assistance programs, tuition assistance, retiree medical access and many other benefits depending on eligibility.</li></ul>
For more information, visit https://jobs.cvshealth.com/us/en/benefits
We anticipate the application window for this opening will close on: 03/30/2026
Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state and local laws.</div>

Explore 799+ Senior data engineer python spark aws in New York this March. Find roles across top companies and apply now to boost your career.

799 senior data engineer python spark aws jobs In New York

Senior Data Engineer (Python, Spark, AWS)

Senior Data Engineer (Python, Spark, AWS)

Senior Data Engineer (AWS, Spark, Python, SQL)

Senior Data Engineer

Senior Data and Software Engineer I (API) (32_2026.1)

Sr. Data Quality Engineer I (37_2026.1)

Senior Data Engineer