4698 Senior Data Engineer Python Spark jobs near me

About this role:

• Wells Fargo is seeking a Senior Data Engineer.
• We are seeking a Senior Data Engineer to build and modernize scalable data platforms on GCP while enabling AI/GenAI-driven data solutions.
• The ideal candidate will have strong expertise in cloud data engineering, large-scale data processing, and modern AI-enabled data architectures

In this role, you will:

• Lead moderately complex initiatives within Technology and contribute to large scale data processing framework initiatives related to enterprise strategy deliverables
• Build and maintain optimized and highly available data pipelines that facilitate deeper analysis and reporting
• Review and analyse moderately complex business, operational or technical challenges that require an in-depth evaluation of variable factors
• Oversee the data integration work, including developing a data model, maintaining a data warehouse and analytics environment, and writing scripts for data integration and analysis
• Resolve moderately complex issues and lead teams to meet data engineering deliverables while leveraging solid understanding of data information policies, procedures and compliance requirements
• Collaborate and consult with colleagues and managers to resolve data engineering issues and achieve strategic goals

Required Qualifications:

• 4+ years of Data Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education

Job Expectations

• Design, build, and optimize scalable data pipelines using Python, SQL, Spark, and GCP services.
• Develop batch and streaming solutions using BigQuery, Dataproc, Cloud Composer, Kafka, and Pub/Sub.
• Lead cloud migration, data transformation, reconciliation, and data quality initiatives.
  Implement metadata, lineage, governance, and observability using Dataplex and Data Catalog.
• Build data products that support AI use cases including semantic search, RAG, embeddings, and knowledge graphs.
• Develop APIs and data services to support AI agents and intelligent workflows.
  Collaborate with product, platform, security, and business teams to deliver reliable, scalable solutions.
• Drive engineering excellence through automation, CI/CD, monitoring, and reusable frameworks.

Additional Required Skills

• Strong experience in Python, SQL, Spark, and Data Engineering.
• Hands-on experience with GCP (BigQuery, Dataproc, Composer, Pub/Sub).
• Experience building enterprise-scale ETL/ELT and streaming solutions.
• Understanding of data modeling, governance, and cloud architecture.
  Familiarity with LLMs, prompt engineering, vector search, or AI-powered applications.
• Experience with REST APIs, Git, and CI/CD practices.

Desired Skills:

• Neo4j or Graph Databases.
• Vector Databases, RAG, and Semantic Search.
• LangChain, LlamaIndex, Semantic Kernel, or similar frameworks.
• Docker, Kubernetes, and MLOps concepts.
• AI Governance and Responsible AI practices.
• Key Technologies: GCP, BigQuery, Dataproc, Spark, Python, SQL, Kafka, Pub/Sub, Dataplex, Airflow, LLMs, Neo4j, Vector Databases, RAG, LangChai

Posting End Date:

6 Sep 2026

• Job posting may come down early due to volume of applicants.

We Value Equal Opportunity

Wells Fargo is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other legally protected characteristic.

Employees support our focus on building strong customer relationships balanced with a strong risk mitigating and compliance-driven culture which firmly establishes those disciplines as critical to the success of our customers and company. They are accountable for execution of all applicable risk programs (Credit, Market, Financial Crimes, Operational, Regulatory Compliance), which includes effectively following and adhering to applicable Wells Fargo policies and procedures, appropriately fulfilling risk and compliance obligations, timely and effective escalation and remediation of issues, and making sound risk decisions. There is emphasis on proactive monitoring, governance, risk identification and escalation, as well as making sound risk decisions commensurate with the business unit’s risk appetite and all risk and compliance program requirements.

Candidates applying to job openings posted in Canada: Applications for employment are encouraged from all qualified candidates, including women, persons with disabilities, aboriginal peoples and visible minorities. Accommodation for applicants with disabilities is available upon request in connection with the recruitment process.

Applicants with Disabilities

To request a medical accommodation during the application or interview process, visit Disability Inclusion at Wells Fargo.

Drug and Alcohol Policy

Wells Fargo maintains a drug free workplace. Please see our Drug and Alcohol Policy to learn more.

Wells Fargo Recruitment and Hiring Requirements:

a. Third-Party recordings are prohibited unless authorized by Wells Fargo.

b. Wells Fargo requires you to directly represent your own experiences during the recruiting and hiring process.