senior data engineer

software engineer

senior data engineer (aws, spark, python, sql) Jobs in New York

senior data engineer (python, spark, aws) Jobs in New York

senior designer

senior python developer

Capital One

<div>Senior Data Engineer (Python, Spark, AWS)
Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? 
 
At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you&rsquo;ll have the opportunity to be on the forefront of driving a major transformation within Capital One.
What You&rsquo;ll Do:<ul><li>
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies</li><li>
Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems</li><li>
Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake</li><li>
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal &amp; external technology communities, and mentoring other members of the engineering community</li><li>
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment</li><li>
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance</li></ul>
Basic Qualifications:<ul><li>
Bachelor&rsquo;s Degree</li><li>
At least 3 years of experience in application development (Internship experience does not apply)</li><li>
At least 1 year of experience in big data technologies</li></ul>
Preferred Qualifications:<ul><li>
5+ years of experience in application development including Python, SQL, Scala, or Java</li><li>
2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)</li><li>
3+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)</li><li>
2+ year experience working on real-time data and streaming applications</li><li>
2+ years of experience with NoSQL implementation (Mongo, Cassandra)</li><li>
2+ years of data warehousing experience (Redshift or Snowflake)</li><li>
3+ years of experience with UNIX/Linux including basic commands and shell scripting</li><li>
2+ years of experience with Agile engineering practices</li></ul>
At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer).
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.
New York, NY: $176,500 - $201,400 for Senior Data Engineer 
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate&rsquo;s offer letter.
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.
Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.
This role is expected to accept applications for a minimum of 5 business days.
No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City&rsquo;s Fair Chance Act; Philadelphia&rsquo;s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.
For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).</div>

Senior Data Engineer (Python, Spark, AWS)

Information Technology Senior Management Forum

<div><div>Posted Date
3/05/2026
</div><div>Description
<div>Senior Data Engineer (Python, Spark, AWS)
Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? 
 
At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you&rsquo;ll have the opportunity to be on the forefront of driving a major transformation within Capital One.
What You&rsquo;ll Do:<ul><li>
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies</li><li>
Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems</li><li>
Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake</li><li>
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal &amp; external technology communities, and mentoring other members of the engineering community</li><li>
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment</li><li>
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance</li></ul>
Basic Qualifications:<ul><li>
Bachelor&rsquo;s Degree</li><li>
At least 3 years of experience in application development (Internship experience does not apply)</li><li>
At least 1 year of experience in big data technologies</li></ul>
Preferred Qualifications:<ul><li>
5+ years of experience in application development including Python, SQL, Scala, or Java</li><li>
2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)</li><li>
3+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)</li><li>
2+ year experience working on real-time data and streaming applications</li><li>
2+ years of experience with NoSQL implementation (Mongo, Cassandra)</li><li>
2+ years of data warehousing experience (Redshift or Snowflake)</li><li>
3+ years of experience with UNIX/Linux including basic commands and shell scripting</li><li>
2+ years of experience with Agile engineering practices</li></ul>
At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer).
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.
New York, NY: $176,500 - $201,400 for Senior Data Engineer 
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate&rsquo;s offer letter.
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.
Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.
This role is expected to accept applications for a minimum of 5 business days.No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City&rsquo;s Fair Chance Act; Philadelphia&rsquo;s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.
For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).
Senior Data Engineer (Python, Spark, AWS)
Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? 
 
At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you&rsquo;ll have the opportunity to be on the forefront of driving a major transformation within Capital One.
What You&rsquo;ll Do:<ul><li>
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies</li><li>
Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems</li><li>
Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake</li><li>
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal &amp; external technology communities, and mentoring other members of the engineering community</li><li>
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment</li><li>
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance</li></ul>
Basic Qualifications:<ul><li>
Bachelor&rsquo;s Degree</li><li>
At least 3 years of experience in application development (Internship experience does not apply)</li><li>
At least 1 year of experience in big data technologies</li></ul>
Preferred Qualifications:<ul><li>
5+ years of experience in application development including Python, SQL, Scala, or Java</li><li>
2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)</li><li>
3+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)</li><li>
2+ year experience working on real-time data and streaming applications</li><li>
2+ years of experience with NoSQL implementation (Mongo, Cassandra)</li><li>
2+ years of data warehousing experience (Redshift or Snowflake)</li><li>
3+ years of experience with UNIX/Linux including basic commands and shell scripting</li><li>
2+ years of experience with Agile engineering practices</li></ul>
At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer).
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.
New York, NY: $176,500 - $201,400 for Senior Data Engineer 
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate&rsquo;s offer letter.
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.
Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.
This role is expected to accept applications for a minimum of 5 business days.No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City&rsquo;s Fair Chance Act; Philadelphia&rsquo;s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.
For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).</div>
</div><div>Salary
176,500.00 - 201,400.00 Annual
</div><div></div><div><div>Type<div>
Full-time</div></div></div></div>

Mindrift

<div>
 
 
 Please submit your CV in English and indicate your level of English proficiency.
 
 
 
 
 Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.
 
 Participation is project-based, not permanent employment.
 
 
 
 
 What This Opportunity Involves
 
 
 
 While each project involves unique tasks, contributors may:
 
 
 <ul>
 <li>
 Design rigorous physics problems reflecting professional practice;
 </li>
 <li>
 Evaluate AI solutions for correctness, assumptions, and constraints;
 </li>
 <li>
 Validate calculations or simulations using Python (NumPy, Pandas, SciPy);
 </li>
 <li>
 Improve AI reasoning to align with industry-standard logic;
 </li>
 <li>
 Apply structured scoring criteria to multi-step problems
 
 
 </li>
 </ul>
 
 What We Look For
 
 
 
 This opportunity is a good fit for physicists with an experience in python open to part-time, non-permanent projects. Ideally, contributors will have:
 
 
 <ul>
 <li>
 Degree in Physics or related fields, e.g. Engineering Physics, Thermodynamics, Statistical Mechanics, Optics and Acoustics, etc.
 </li>
 <li>
 3+ years of professional physics experience
 </li>
 <li>
 Strong written English (C1/C2)
 </li>
 <li>
 Strong Python proficiency for numerical validation
 </li>
 <li>
 Stable internet connection
 
 
 </li>
 </ul>
 Professional certifications (e.g., CPhys, EurPhys, MInstP) and experience in international or applied projects are an advantage.
 
 
 
 How It Works
 
 
 
 Apply &rarr; Pass qualification(s) &rarr; Join a project &rarr; Complete tasks &rarr; Get paid
 
 
 
 Project time expectations
 
 
 
 For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active.
 
 
 
 Compensation
 
 
 
 On this project, contributors can earn up to
 
 $55 per hour equivalent
 
 , depending on their level and pace of contribution.
 
 
 Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements.
</div>

Physics Researcher (Python) - Freelance AI Trainer

<div>
 
 
 Please submit your CV in English and indicate your level of English proficiency.
 
 
 
 
 Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.
 
 Participation isproject-based, not permanent employment.
 
 
 
 
 What This Opportunity Involves
 
 
 
 While each project involves unique tasks, contributors may:
 
 
 <ul>
 <li>
 Design graduate- and industry-level mechanical engineering problems grounded in real practice
 </li>
 <li>
 Evaluate AI-generated solutions for correctness, assumptions, and engineering logic
 </li>
 <li>
 Validate analytical or numerical results using Python (NumPy, SciPy, Pandas)
 </li>
 <li>
 Improve AI reasoning to align with first principles and accepted engineering standards
 </li>
 <li>
 Apply structured scoring criteria to assess multi-step problem solving.
 
 
 </li>
 </ul>
 
 What We Look For
 
 
 
 This opportunity is a good fit for mechanical engineers with an experience in python open to part-time, non-permanent projects. Ideally, contributors will have:
 
 
 <ul>
 <li>
 Degree in Mechanical Engineering or related fields, e.g. Thermodynamics, Fluid Mechanics, Mechanical Design, Computational Mechanics, etc.
 </li>
 <li>
 3+ years of professional mechanical engineering experience
 </li>
 <li>
 Strong written English (C1/C2)
 </li>
 <li>
 Strong Python proficiency for numerical validation
 </li>
 <li>
 Stable internet connection
 
 
 </li>
 </ul>
 Professional certifications (e.g., PE, CEng, PMP) and experience in international or applied projects are an advantage.
 
 
 
 How It Works
 
 
 
 Apply &rarr; Pass qualification(s) &rarr; Join a project &rarr; Complete tasks &rarr; Get paid
 
 
 
 Project time expectations
 
 
 
 For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active.
 
 
 
 Payment
 
 
 
 <ul>
 <li>
 Paid contributions, with rates up to $55/hour*
 </li>
 <li>
 Fixed project rate or individual rates, depending on the project
 </li>
 <li>
 Some projects include incentive payments
 </li>
 <li>
 Note: Rates vary based on expertise, skills assessment, location, project needs, and other factors. Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or non-core project phases. Payment details are shared per project
 </li>
 </ul>
</div>

Mechanical Engineer & Python Expert - Freelance AI Trainer

<div>Lead Data Engineer (Python, Spark, AWS)
Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? 
 
At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you&rsquo;ll have the opportunity to be on the forefront of driving a major transformation within Capital One.
What You&rsquo;ll Do:<ul><li>
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies</li><li>
Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems</li><li>
Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake</li><li>
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal &amp; external technology communities, and mentoring other members of the engineering community</li><li>
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment</li><li>
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance</li></ul>
Basic Qualifications:<ul><li>
Bachelor&rsquo;s Degree</li><li>
At least 4 years of experience in application development (Internship experience does not apply)</li><li>
At least 2 years of experience in big data technologies</li><li>
At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)</li></ul>
Preferred Qualifications:<ul><li>
7+ years of experience in application development including Python, SQL, Scala, or Java</li><li>
4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)</li><li>
4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)</li><li>
4+ year experience working on real-time data and streaming applications</li><li>
4+ years of experience with NoSQL implementation (Mongo, Cassandra)</li><li>
4+ years of data warehousing experience (Redshift or Snowflake)</li><li>
4+ years of experience with UNIX/Linux including basic commands and shell scripting</li><li>
2+ years of experience with Agile engineering practices</li></ul> 
At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer).
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.
New York, NY: $215,200 - $245,600 for Lead Data Engineer 
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate&rsquo;s offer letter.
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.
Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.
This role is expected to accept applications for a minimum of 5 business days.
No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City&rsquo;s Fair Chance Act; Philadelphia&rsquo;s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.
For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).</div>

Lead Data Engineer (Python, Spark, AWS)

PJT Partners

<div>PJT Partners is a global advisory-focused investment bank. Our team of senior professionals delivers a wide array of strategic advisory, shareholder advisory, restructuring and special situations and private fund advisory and placement services to corporations, financial sponsors, institutional investors and governments around the world. We offer a unique portfolio of advisory services designed to help our clients achieve their strategic objectives. We also provide, through PJT Park Hill, private fund advisory and fundraising services for alternative investment managers, including private equity funds, real estate funds and hedge funds.
From the beginning, PJT Partners has firmly believed that having the best people is key to building an enduring franchise. Our perspective was, and remains, that a great team brings in both top tier clients and appeals to a wide-range of diverse, talented colleagues. Fostering an inclusive culture, which welcomes differing perspectives and beliefs, enables us to provide the best advice and insights to our clients.
To learn more about PJT Partners, please visit our website at www.pjtpartners.com .
<h1 class="jobSectionHeader">Responsibilities
</h1>The PJT Partners Technology team is responsible for creating and continuously improving a robust and secure technology foundation that supports the firm&rsquo;s business activities. Our Technology team is seeking a Data and AI Infrastructure Engineer to build secure, scalable platforms and pipelines that power the firm&rsquo;s AI initiatives. This is a platform engineering role &mdash; the focus is building the infrastructure and developer tooling that enables teams to rapidly develop and deploy AI-powered Python applications using Azure AI Foundry and the Claude API (Anthropic), not training custom models. You will work with data engineers, application developers, architects, and business stakeholders to deliver AI-ready infrastructure that meets the firm&rsquo;s security and compliance requirements.
Responsibilities include:
AI Platform &amp; Developer Infrastructure
<ul><li>Design, build, and operate the firm&rsquo;s AI platform, enabling developers to build and deploy Python-based AI applications;
</li><li>Implement and manage Azure AI Foundry environments: model deployments, AI hubs, project workspaces, and access controls;
</li><li>Integrate and operationalize third-party AI APIs (Anthropic Claude API, Azure OpenAI) with secure access patterns, API gateway controls, rate limiting, and cost monitoring;
</li><li>Build internal developer tooling and SDK scaffolding to accelerate AI application development across the firm.
</li></ul>Data Infrastructure &amp; Pipelines
<ul><li>Build and maintain data pipelines using Azure Data Factory and Azure Databricks to serve AI application data needs;
</li><li>Implement vector search and document retrieval infrastructure (Azure AI Search) to support RAG-based applications;
</li><li>Manage structured and unstructured data stores including Azure Data Lake, Azure SQL, and Cosmos DB.
</li></ul>Cloud Infrastructure &amp; DevOps
<ul><li>Provision and maintain secure, scalable infrastructure on Azure (primary) and AWS using Infrastructure-as-Code (Terraform or Bicep);
</li><li>Build and maintain CI/CD pipelines for AI application deployment via Azure DevOps or GitHub Actions;
</li><li>Manage containerized workloads using Docker and Kubernetes (AKS) for AI application hosting and API services;
</li><li>Drive Secure DevOps practices including secrets management, dependency scanning, and policy enforcement.
</li></ul>Security, Governance &amp; Compliance
<ul><li>Implement data access controls, encryption, and audit logging aligned with SEC and FINRA requirements;
</li><li>Design MNPI data segregation controls and enforce AI governance guardrails including content filtering and usage logging for all AI API integrations;
</li><li>Manage identity and access for AI platforms using Azure Entra ID, RBAC, and managed identities;
</li><li>Collaborate with Compliance and Legal to ensure AI usage policies are enforced at the infrastructure level.
</li></ul>Collaboration &amp; Documentation
<ul><li>Produce architecture designs, runbooks, and technical documentation for all platform components;
</li><li>Support application developers building AI-powered applications with platform guidance and troubleshooting;
</li><li>Partner with solution architects, data engineers, and business stakeholders to translate requirements into infrastructure.
</li></ul><h1 class="jobSectionHeader">Qualifications
</h1>PJT Partners seeks to hire individuals who are highly motivated, intelligent and have demonstrated excellence in prior endeavors. In addition, qualified candidates will possess the following:
<ul><li>Bachelor&rsquo;s degree in computer science, Computer Engineering, or related field (Master&rsquo;s degree is a plus);
</li><li>8+ years in infrastructure engineering, cloud platform engineering, or data engineering;
</li><li>Demonstrated experience building shared platforms or developer services in an enterprise environment;
</li><li>Azure expertise: Azure AI Foundry, Azure Data Factory, Azure Databricks, AKS, Azure API Management, Azure Key Vault, Azure Entra ID;
</li><li>Strong Python skills: backend services, REST APIs (FastAPI or Flask), and automation scripting; PowerShell for infrastructure tasks;
</li><li>Infrastructure-as-Code: Terraform and/or Bicep; container orchestration with Docker and Kubernetes;
</li><li>Experience integrating LLM APIs (Anthropic Claude, Azure OpenAI) in production including token cost management and observability;
</li><li>RAG pipeline experience: vector search (Azure AI Search or pgvector), document processing, and retrieval patterns;
</li><li>Familiarity with LLM application frameworks such as LangChain or Semantic Kernel;
</li><li>Cloud security fundamentals: RBAC, managed identities, private endpoints, Key Vault, and network segmentation;
</li><li>DevSecOps practices: secrets management, SAST tooling, and secure CI/CD pipeline design;
</li><li>Familiarity with AWS (Bedrock, S3, IAM) and agentic application frameworks (AutoGen, LangGraph);
</li><li>Experience with Microsoft Fabric, Databricks Unity Catalog, or Azure Synapse;
</li><li>Azure certifications: AI-102, DP-203, or AZ-305;
</li><li>Prior experience in investment banking or regulated financial services environments.
</li></ul>Expected annualized base salary of $175,000 to $215,000.
This range represents the low and high ends of the expected annualized base salary for this position. The specific base salary received by any employee will be informed by a number of factors, including but not limited to, role level and scope, location, candidate&rsquo;s relevant qualifications, skills and experience.
Base salary is one component of PJT Partners&rsquo; compensation structure. In addition to base salary, PJT Partners&rsquo; compensation structure may include additional rewards, incentives and benefits, including but not limited to, a discretionary bonus component.
PJT is an equal opportunity employer. We do not discriminate on the basis of, and will consider all qualified applicants for employment without regard to race, color, religious creed, religion, sex, pregnancy, national origin, ancestry, citizenship status, age, marital or partnership status, sexual orientation, gender identity expression, disability, medical condition, genetic information or predisposition, veteran or military status, status as a victim of domestic violence, a sex offense or stalking, or any other category protected by law. PJT Partners also complies with all applicable laws with regard to providing reasonable accommodation of disabilities to applicants. For more information or to request an accommodation, please contact Human Resources.
California Applicants: PJT Partners will consider for employment qualified applicants with arrest and/or conviction records in a manner consistent with applicable law including, but not limited to, the San Francisco Fair Chance Ordinance and/or Los Angeles Fair Chance Initiative for Hiring Ordinance.
Applicant Privacy Notice:
View our Applicant Privacy Notice https://info.pjtpartners.com/PJT_Global_Applicant_Privacy_Notice here. If you are a California resident, please refer to our California Applicant Privacy Notice https://info.pjtpartners.com/California_Applicant_Privacy_Notice for further information. 
 
*In order to be considered, please ensure your resume/CV is submitted in PDF format.</div>

Vice President - Technology (Data & AI Infrastructure Engineer)

Realign

<div>New York, New York 10001 Posted March 12th, 2026
 <div></div>Looking for more job opportunities? Click here!</div>
 <div>Job Type: Full Time
Job Category: IT
Job Description
<div>Role: Java Full Stack Developer/Architect</div><div>
Location: New York, NY / Irving, TX / Edison, NJ</div><div>
FTE</div><div></div><div> 
Job Description</div><div>
Must Have Technical/Functional Skills</div><ul><li>Angular, React, NodeJS, Python, JavaScript</li><li>Familiarity with UI/UX Design and any database</li><li>Architect exp in designing the new applications/solutions</li></ul><div></div><div> 
Roles &amp; Responsibilities</div><div></div><div> 
1. Architecture Ownership and Vision</div><ul><li>Oversee the complete architecture across front end, back end, APIs, data, and integrations.</li><li>Define reference architectures, technology standards, and design principles.</li><li>Make long-term decisions balancing scalability, security, cost, and speed while anticipating future needs and designing for extensibility.</li></ul><div></div><div> 
2. Deep Full-Stack Technical Expertise</div><ul><li>Front End: Possess a strong command of modern frameworks like React and Typescript. Design performance, accessible, and secure UI architectures with Material UI components, setting standards for complex state management, authentication flows, and UX consistency.</li><li>Back End: Architect scalable services using Node.js or Python, design REST and event-driven APIs, and apply microservices patterns, resiliency, and fault tolerance.</li><li>Data Layer: Model relational and NoSQL databases using MongoDB or Postgres, and design data access, caching strategies, and data consistency models.</li></ul><div></div><div> 
3. Cloud, DevOps, and Platform Design</div><ul><li>Architect cloud-native solutions on AWS, Azure, or GCP.</li><li>Design CI/CD pipelines, infrastructure as code, and deployment strategies while building for high availability, disaster recovery, and cost optimization.</li><li>Embed observability, logging, and monitoring by design.</li></ul><div></div><div> 
4. Security and Compliance by Design</div><ul><li>Apply secure coding and architecture principles.</li><li>Design authentication, authorization, and data protection models.</li><li>Ensure compliance with enterprise and regulatory standards.</li></ul><div></div><div> 
5. AI Integration &amp; Next-Gen Technologies</div><ul><li>Proficient with AI coding assistants, knowledgeable in AI workflow automation and intelligent data processing, and experienced with real-time technologies and message queues.</li></ul>
Coordinate with teams, stakeholders to develop insightful dashboards and interactive tools
Required Skills
CLOUD DEVELOPER</div>

Java Full Stack Developer/Architect-6

Explore 837+ Senior python developer in New York this March. Find roles across top companies and apply now to boost your career.

837 senior python developer jobs In New York

Senior Data Engineer (Python, Spark, AWS)

Senior Data Engineer (Python, Spark, AWS)

Physics Researcher (Python) - Freelance AI Trainer

Mechanical Engineer & Python Expert - Freelance AI Trainer

Lead Data Engineer (Python, Spark, AWS)

Vice President - Technology (Data & AI Infrastructure Engineer)

Java Full Stack Developer/Architect-6