data analyst

senior executive assistant Jobs in New York

senior executive assistant

data engineer

software engineer

data scientist

senior data engineer aws spark python sql

Capital One

<div>Senior Data Engineer (AWS, Spark, Python, SQL)<p></p><p>
Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking <b>Data Engineers</b> who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you&rsquo;ll have the opportunity to be on the forefront of driving a major transformation within Capital One.</p><p></p><p><b>
What You&rsquo;ll Do:</b></p><ul><li><p>
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies</p></li><li><p>
Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems</p></li><li><p>
Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake</p></li><li><p>
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal &amp; external technology communities, and mentoring other members of the engineering community</p></li><li><p>
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment</p></li><li><p>
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance</p></li></ul><p></p><p><b>
Basic Qualifications:</b></p><ul><li><p>
Bachelor&rsquo;s Degree</p></li><li><p>
At least 3 years of experience in application development (Internship experience does not apply)</p></li><li><p>
At least 1 year of experience in big data technologies</p></li></ul><p></p><p><b>
Preferred Qualifications:</b></p><ul><li><p>
5+ years of experience in application development including Python, SQL, Scala, or Java</p></li><li><p>
2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)</p></li><li><p>
3+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)</p></li><li><p>
2+ year experience working on real-time data and streaming applications</p></li><li><p>
2+ years of experience with NoSQL implementation (Mongo, Cassandra)</p></li><li><p>
2+ years of data warehousing experience (Redshift or Snowflake)</p></li><li><p>
3+ years of experience with UNIX/Linux including basic commands and shell scripting</p></li><li><p>
2+ years of experience with Agile engineering practices</p></li></ul><p></p><p><i>
At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer).</i></p><p></p><p>
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.</p><p></p>
New York, NY: $176,500 - $201,400 for Senior Data Engineer<p></p><p><br>
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate&rsquo;s offer letter.</p><p></p>
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.<p></p><p>
Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.</p><p></p>
This role is expected to accept applications for a minimum of 5 business days.<p></p>
No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City&rsquo;s Fair Chance Act; Philadelphia&rsquo;s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.<p></p><p>
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.</p><p></p><p>
For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com</p><p></p><p>
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.</p><p></p><p>
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).</p></div>

Senior Data Engineer (AWS, Spark, Python, SQL)

Information Technology Senior Management Forum

<div><div><p>Posted Date</p>
<p>3/05/2026</p>
</div><div><p>Description</p>
<div>Senior Data Engineer (AWS, Spark, Python, SQL)<p>
Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking <b>Data Engineers</b> who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you&rsquo;ll have the opportunity to be on the forefront of driving a major transformation within Capital One.</p><p><b>
What You&rsquo;ll Do:</b></p><ul><li>
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies</li><li>
Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems</li><li>
Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake</li><li>
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal &amp; external technology communities, and mentoring other members of the engineering community</li><li>
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment</li><li>
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance</li></ul><p><b>
Basic Qualifications:</b></p><ul><li>
Bachelor&rsquo;s Degree</li><li>
At least 3 years of experience in application development (Internship experience does not apply)</li><li>
At least 1 year of experience in big data technologies</li></ul><p><b>
Preferred Qualifications:</b></p><ul><li>
5+ years of experience in application development including Python, SQL, Scala, or Java</li><li>
2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)</li><li>
3+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)</li><li>
2+ year experience working on real-time data and streaming applications</li><li>
2+ years of experience with NoSQL implementation (Mongo, Cassandra)</li><li>
2+ years of data warehousing experience (Redshift or Snowflake)</li><li>
3+ years of experience with UNIX/Linux including basic commands and shell scripting</li><li>
2+ years of experience with Agile engineering practices</li></ul><p><i>
At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer).</i></p><p>
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.</p>
New York, NY: $176,500 - $201,400 for Senior Data Engineer<p></p><p><br>
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate&rsquo;s offer letter.</p>
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.<p>
Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.</p>
This role is expected to accept applications for a minimum of 5 business days.No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City&rsquo;s Fair Chance Act; Philadelphia&rsquo;s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.<p>
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.</p><p>
For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com</p><p>
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.</p><p>
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).</p>
Senior Data Engineer (AWS, Spark, Python, SQL)<p>
Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking <b>Data Engineers</b> who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you&rsquo;ll have the opportunity to be on the forefront of driving a major transformation within Capital One.</p><p><b>
What You&rsquo;ll Do:</b></p><ul><li>
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies</li><li>
Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems</li><li>
Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake</li><li>
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal &amp; external technology communities, and mentoring other members of the engineering community</li><li>
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment</li><li>
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance</li></ul><p><b>
Basic Qualifications:</b></p><ul><li>
Bachelor&rsquo;s Degree</li><li>
At least 3 years of experience in application development (Internship experience does not apply)</li><li>
At least 1 year of experience in big data technologies</li></ul><p><b>
Preferred Qualifications:</b></p><ul><li>
5+ years of experience in application development including Python, SQL, Scala, or Java</li><li>
2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)</li><li>
3+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)</li><li>
2+ year experience working on real-time data and streaming applications</li><li>
2+ years of experience with NoSQL implementation (Mongo, Cassandra)</li><li>
2+ years of data warehousing experience (Redshift or Snowflake)</li><li>
3+ years of experience with UNIX/Linux including basic commands and shell scripting</li><li>
2+ years of experience with Agile engineering practices</li></ul><p><i>
At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer).</i></p><p>
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.</p>
New York, NY: $176,500 - $201,400 for Senior Data Engineer<p></p><p><br>
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate&rsquo;s offer letter.</p>
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.<p>
Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.</p>
This role is expected to accept applications for a minimum of 5 business days.No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City&rsquo;s Fair Chance Act; Philadelphia&rsquo;s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.<p>
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.</p><p>
For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com</p><p>
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.</p><p>
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).</p></div>
</div><div><p>Salary</p><p>
176,500.00 - 201,400.00 Annual</p>
</div><div></div><div><div><p>Type</p><div><p>
Full-time</p></div></div></div></div>

Realign

<div>Remote, New York 10048 Posted March 12th, 2026
 <div></div><p>Looking for more job opportunities? Click here!</p></div>
<br><div><p>Job Type: Contract</p>
<p>Job Category: IT</p>
<p>Job Description</p>
<p></p><div><b>Role</b> : Databricks Data Engineer(Azure + Python)<br>
<b>Location</b> : Remote<br>
<b>Contract</b></div><div></div><div><b><br>
Job Description</b></div><p><b>
Must Have Technical/Functional Skills:</b></p><ul><li> Exp. in Apache SPARK development, Kubenetes, CI-CD Pipeline, Jenkins, Dockers, Kubernetes, PL SQL, Python</li><li> Writing SQL queries and procedures</li><li> Writing Python code to automate and develop small functionalities</li><li> Creating CI/CD pipelines</li><li> Writing Jenkins jobs</li><li> Managing applications in Kubernetes environments, including deployment, configuration, and triaging</li><li> Hands-on experience with Apache Spark</li></ul><p><b>
Roles &amp; Responsibilities:</b></p><p>
The candidate will provide technical leadership for the team(s) they are associated with and participate in key technical decisions. They will engage with customers on escalations and ensure that there is continuous improvement in all areas. Participate in technical discussions within the team and with other groups within Business Units associated with specified projects</p><ul><li> You design, develop, and maintain our real time data processing, data Lakehouse infrastructure.</li><li> You have experience with Python writing data pipelines and data processing layers.</li><li> You develop and maintain Ansible playbooks for infrastructure configuration and management</li><li> You develop and maintain Kubernetes manifests, Helm charts, and other deployment artifacts</li><li> You have hands-on experience on Docker and containerization and how to manage/prune the images in private registries.</li><li> You have hands-on experience on access control in K8S cluster</li><li> You have hands-on experience on SPARK and maintaining SPARK CLUSTER</li><li> You monitor and troubleshoot issues related to Kubernetes clusters and containerized applications</li><li> You drive initiatives to containerize standalone apps to be containerized i n Kubernetes.</li><li> You develop and maintain infrastructure as code (IaC) and collaborate with other teams to ensure consistent infrastructure management across the organization</li><li> You use observability tools to do &ldquo;capacity management&rdquo; of our services and infrastructure resources.</li><li> You are for guiding the development and testing activities of other engineers that involve several inter-dependencies</li><li> Experience in AWS ECS and EKS is added advantage</li><li> Experience in Dremio is added advantage</li><li> Experience in Dynatrace or any tracing, infrastructure, or real time monitoring tool is added advantage</li></ul><p></p>
<p>Required Skills</p>
<p>DEVOPS ENGINEER</p> <p>SENIOR EMAIL SECURITY ENGINEER</p></div>

Databricks Data Engineer(Azure + Python)

DS Technologies Inc

<div><div><div><b>Job Title: Engineer II &ndash; Big Data / Apptio / ETL</b><br>
<b>Location: New York, NY (Onsite)</b><br>
<b>Position Type: Contract</b><br>
<b>Only W2</b><br>
</div><div><b>Job Description:</b></div>
<div>We are seeking a highly motivated <b>Engineer II (Big Data Engineer)</b> with strong technical expertise in <b>Apptio, Big Data, MS SQL, Oracle PL/SQL, Python, PySpark, and ETL/Data Warehousing</b>. The ideal candidate will support data engineering, analytics, reporting, and financial/IT cost transparency initiatives leveraging Apptio and enterprise data platforms.<br>
</div><div><b>Key Responsibilities:</b></div>
<ul><li>Develop and maintain <b>Big Data pipelines</b> using <b>PySpark, Python</b>, and other data engineering tools.</li>
<li>Work with <b>Apptio</b> for IT financial management, cost modeling, and reporting.</li>
<li>Perform <b>ETL development</b> for large-scale <b>Data Warehousing</b> and analytics systems.</li>
<li>Develop and optimize <b>MS SQL Server</b> objects (queries, stored procedures, SSIS packages, SSRS reports).</li>
<li>Write efficient <b>Oracle PL/SQL</b> code for RDBMS-based applications.</li>
<li>Analyze, transform, and process structured/unstructured data for reporting and insights.</li>
<li>Collaborate with business teams to gather requirements and deliver analytical solutions.</li>
<li>Troubleshoot data issues, improve data quality, and ensure system performance.</li>
<li>Document data flows, technical specs, and operational processes.</li>
</ul><div><b>Required Skills:</b></div>
<ul><li>Hands-on experience with <b>Apptio</b> (cost transparency, reporting, ITFM tools).</li>
<li>Strong knowledge of <b>Big Data technologies</b> (Hadoop, Spark, PySpark).</li>
<li>Proficiency in <b>MS SQL Server</b>, including <b>SSIS</b> and <b>SSRS</b>.</li>
<li>Strong SQL coding with <b>RDBMS</b> (MS SQL, Oracle).</li>
<li>Experience with <b>Oracle PL/SQL</b> programming.</li>
<li>Good command of <b>Python</b> for scripting and automation.</li>
<li>Strong understanding of <b>ETL processes</b> and <b>Data Warehousing</b> concepts.</li>
<li>Experience working in <b>Data Analytics</b> environments.</li>
</ul><div><b>Preferred Skills:</b></div>
<ul><li>Experience with cloud platforms (AWS, Azure, GCP).</li>
<li>Knowledge of visualization tools (Tableau, Power BI).</li>
<li>Familiarity with IT cost modeling and financial analytics.</li>
<li>Understanding of Agile methodologies and CI/CD workflows.</li></ul></div></div>

Engineer II – Big Data / Apptio / ETL

The Value Maximizer

<div>
 <strong>
  Job Summary
 </strong>
 We are looking for a Senior Data Engineer with strong experience in real-time data streaming using Apache Kafka. The ideal candidate will design and build scalable data pipelines, streaming architectures, and data platforms to support real-time analytics and data-driven applications.
 <br/>
 <br/>
 <strong>
  Key Responsibilities
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Design, develop, and maintain real-time data pipelines using Apache Kafka
  </li>
  <li>
   Build scalable stream processing solutions using Kafka Streams, Spark Streaming, or Flink
  </li>
  <li>
   Develop and optimize ETL/ELT pipelines for large-scale data processing
  </li>
  <li>
   Integrate streaming pipelines with data lakes, data warehouses, and analytics platforms
  </li>
  <li>
   Work with cross-functional teams including Data Scientists, Product Managers, and Analysts
  </li>
  <li>
   Ensure data reliability, scalability, and performance optimization
  </li>
  <li>
   Implement data governance, monitoring, and alerting for streaming systems
  </li>
  <li>
   Troubleshoot production issues and optimize streaming architecture. Required Skills
  </li>
  <li>
   8+ years of experience in Data Engineering
  </li>
  <li>
   Strong hands-on experience with Apache Kafka / Kafka Streaming
  </li>
  <li>
   Experience with Python, Java, or Scala
  </li>
  <li>
   Strong knowledge of real-time streaming architectures
  </li>
  <li>
   Experience with Spark, Flink, or Kafka Streams
  </li>
  <li>
   Strong SQL and data modeling skills
  </li>
  <li>
   Experience working with cloud platforms (AWS, GCP, or Azure)
  </li>
  <li>
   Familiarity with data lake technologies (S3, Delta Lake, Snowflake, etc.). Preferred Skills
  </li>
  <li>
   Experience with Databricks or Snowflake
  </li>
  <li>
   Experience with containerization (Docker, Kubernetes)
  </li>
  <li>
   Knowledge of CI/CD pipelines and DevOps practices
  </li>
  <li>
   Experience with monitoring tools like Prometheus, Grafana, or Splunk. Nice to Have
  </li>
  <li>
   Experience with event-driven architecture
  </li>
  <li>
   Experience building high-throughput, low-latency data systems
  </li>
 </ul>
</div>


Senior Data Engineer

Intuit

<div><h2 class="jobSectionHeader"><b>Overview</b></h2><div>
Come join the Trust &amp; Safety Data Engineering Team in New York as a Staff Software Data Engineer. We are leveraging big data technologies to develop solutions to detect and combat fraudulent activities initiated by external users across all Intuit&rsquo;s products. Some of the technologies we are leveraging include Apache Spark, Athena, Redshift, Kafka, Hive, S3, EMR, AWS, and GCP. We foster an open team environment where we value direct interactions and working code above working in a cave.</div><p></p><div><br>
You will lead the entire product lifecycle for multiple big data solutions that are broad in scope and complexity, applying a full understanding of software engineering methodologies and industry best practices for data products. Work with Industry Experts; Senior, Staff and Principal Engineers, utilize specialized knowledge to develop, and maintain Intuit&rsquo;s data solutions.</div><p><b><br>
Responsibilities</b></p><p></p><div><br>
RESPONSIBILITIES</div><ul><li><div>
Own the tech vision and strategy for multiple domains or capabilities</div></li><li><div>
Drive Strategic Impact. Focus on the direct and strategic application of data to deliver measurable business outcomes, even if it means working with imperfect data to capture significant value.</div></li><li><div>
Hands-on development in all phases of the software life cycle.</div></li><li><div>
Build batch and real-time/streaming data pipelines that are able to handle large volumes of data</div></li><li><div>
Design data models</div></li><li><div>
Gather data needs from internal customers like product and analysts and translate</div></li></ul><div>
those requirements into a working big data solution design.</div><ul><li><div>
Partner with product managers, fraud analysts, data scientists, data architects, software engineers, and other data engineers from around the world.</div></li><li><div>
Participate in design and code reviews</div></li><li><div>
Designing/developing ETL jobs across multiple big data platforms and tools including S3, EMR, Hive, Spark SQL, PYSpark.</div></li><li><div>
Rapidly fix bugs and solve problems; effectively remediate defects</div></li><li><div>
Clean, transform and validate data for use in analytics and reporting</div></li><li><div>
Proactively monitor data quality and pipeline performance, troubleshoot and resolve data issues</div></li><li><div>
Collaborate effectively with senior engineers and architects to solve problems spanning their respective areas to deliver end-to-end quality in our technology and customer experience.</div></li><li><div>
Helps to align to overall strategies and reconcile competing priorities across the organization.</div></li><li><div>
Contribute to the design and architecture of projects across the data landscape.</div></li><li><div>
Actively stay abreast of industry best practices, share learnings, and experiment and apply cutting edge technologies while proactively identifying opportunities to enhance software applications with AI technology</div></li><li><div>
Participate in a scheduled on-call rotation to handle production incidents outside of business hours</div></li><li><div>
Mentor other team members and contribute to the growth of the team</div></li><li><div>
Be available to work in a hybrid mode (3 days in the office and 2 days remote per week)</div></li></ul><p><b><br>
Qualifications</b></p><div></div><ul><li><div><br>
8+ years of hand-on experience building big data solutions and ETL data pipelines using Apache Spark or similar technologies</div></li><li><div>
BS or MS in Computer Science, Data Engineering or related field</div></li><li><div>
Hands-on experience developing data solutions on the AWS platform (preferred), GCP, or Azure</div></li><li><div>
Experience with Agile Development, SCRUM, and/or Extreme Programming methodologies</div></li><li><div>
Expert in SQL, Python and Linux, and strong working knowledge of XML, JSON, YAML.</div></li><li><div>
Knowledgeable with tools and frameworks Docker, Spark, Jupiter Notebook, Databricks Notebook, Kubernetes, Feature Management Platforms, SageMaker</div></li><li><div>
Advanced experience with scripting language &ndash; Python or Shell is a must have</div></li><li><div>
Expert knowledge of software development methodologies and practices</div></li><li><div>
Experience with cloud platforms such as AWS, Azure or GCP - Amazon web services: EC2, S3, EMR, and Redshift or equivalent cloud computing approaches</div></li><li><div>
Strong expertise in Data Warehousing and analytic architecture</div></li><li><div>
Experience working with large data volumes, data visualization</div></li><li><div>
Experience with low-latency NoSQL datastores (such as DynamoDB, HBase, Redshift) is a plus</div></li><li><div>
Experience with building stream-processing applications using Spark Streaming, Flink, etc. is a plus</div></li><li><div>
Hands on experience in AI</div></li><li><div>
Solid communication skills</div></li><li><div>
Demonstrated expertise in Software design and architecture process.</div></li><li><div>
Experience with unit testing and data quality automation checks</div></li><li><div>
Should be results oriented, self-motivated, accountable and work under minimal supervision.</div></li></ul><p><br>
Intuit provides a competitive compensation package with a strong pay for performance rewards approach. This position will be eligible for a cash bonus, equity rewards and benefits, in accordance with our applicable plans and programs (see more about our compensation and benefits at Intuit&reg;: Careers | Benefits). Pay offered is based on factors such as job-related knowledge, skills, experience, and work location. To drive ongoing fair pay for employees, Intuit conducts regular comparisons across categories of ethnicity and gender. The expected base pay range for this position is:</p><p>
New York $ 197,000- $266,500</p></div><p></p>

Staff Data Engineer - Trust and Safety

<div><div><p>Posted Date</p>
<p>3/05/2026</p>
</div><div><p>Description</p>
<div>Senior Data Engineer (Python, Spark, AWS)<p>
Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment?<br>
<br>
At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you&rsquo;ll have the opportunity to be on the forefront of driving a major transformation within Capital One.</p><p><b>
What You&rsquo;ll Do:</b></p><ul><li>
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies</li><li>
Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems</li><li>
Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake</li><li>
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal &amp; external technology communities, and mentoring other members of the engineering community</li><li>
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment</li><li>
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance</li></ul><p><b>
Basic Qualifications:</b></p><ul><li>
Bachelor&rsquo;s Degree</li><li>
At least 3 years of experience in application development (Internship experience does not apply)</li><li>
At least 1 year of experience in big data technologies</li></ul><p><b>
Preferred Qualifications:</b></p><ul><li>
5+ years of experience in application development including Python, SQL, Scala, or Java</li><li>
2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)</li><li>
3+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)</li><li>
2+ year experience working on real-time data and streaming applications</li><li>
2+ years of experience with NoSQL implementation (Mongo, Cassandra)</li><li>
2+ years of data warehousing experience (Redshift or Snowflake)</li><li>
3+ years of experience with UNIX/Linux including basic commands and shell scripting</li><li>
2+ years of experience with Agile engineering practices</li></ul><p><b><i>
At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer).</i></b></p><p>
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.</p>
New York, NY: $176,500 - $201,400 for Senior Data Engineer<p></p><p><br>
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate&rsquo;s offer letter.</p>
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.<p>
Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.</p>
This role is expected to accept applications for a minimum of 5 business days.No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City&rsquo;s Fair Chance Act; Philadelphia&rsquo;s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.<p>
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.</p><p>
For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com</p><p>
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.</p><p>
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).</p>
Senior Data Engineer (Python, Spark, AWS)<p>
Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment?<br>
<br>
At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you&rsquo;ll have the opportunity to be on the forefront of driving a major transformation within Capital One.</p><p><b>
What You&rsquo;ll Do:</b></p><ul><li>
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies</li><li>
Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems</li><li>
Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake</li><li>
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal &amp; external technology communities, and mentoring other members of the engineering community</li><li>
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment</li><li>
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance</li></ul><p><b>
Basic Qualifications:</b></p><ul><li>
Bachelor&rsquo;s Degree</li><li>
At least 3 years of experience in application development (Internship experience does not apply)</li><li>
At least 1 year of experience in big data technologies</li></ul><p><b>
Preferred Qualifications:</b></p><ul><li>
5+ years of experience in application development including Python, SQL, Scala, or Java</li><li>
2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)</li><li>
3+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)</li><li>
2+ year experience working on real-time data and streaming applications</li><li>
2+ years of experience with NoSQL implementation (Mongo, Cassandra)</li><li>
2+ years of data warehousing experience (Redshift or Snowflake)</li><li>
3+ years of experience with UNIX/Linux including basic commands and shell scripting</li><li>
2+ years of experience with Agile engineering practices</li></ul><p><b><i>
At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer).</i></b></p><p>
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.</p>
New York, NY: $176,500 - $201,400 for Senior Data Engineer<p></p><p><br>
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate&rsquo;s offer letter.</p>
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.<p>
Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.</p>
This role is expected to accept applications for a minimum of 5 business days.No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City&rsquo;s Fair Chance Act; Philadelphia&rsquo;s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.<p>
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.</p><p>
For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com</p><p>
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.</p><p>
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).</p></div>
</div><div><p>Salary</p><p>
176,500.00 - 201,400.00 Annual</p>
</div><div></div><div><div><p>Type</p><div><p>
Full-time</p></div></div></div></div>

Senior Data Engineer (Python, Spark, AWS)

Explore 1277+ Senior data engineer aws spark python sql in New York this March. Find roles across top companies and apply now to boost your career.

1277 senior data engineer aws spark python sql jobs In New York

Senior Data Engineer (AWS, Spark, Python, SQL)

Senior Data Engineer (AWS, Spark, Python, SQL)

Databricks Data Engineer(Azure + Python)

Engineer II – Big Data / Apptio / ETL

Senior Data Engineer

Staff Data Engineer - Trust and Safety

Senior Data Engineer (Python, Spark, AWS)