principal data engineer

Fidelity TalentSource

<div><h3 class="jobSectionHeader"><b>Principal Data Engineer</b></h3>
<p>Fidelity TalentSource is your destination for discovering your next temporary role at Fidelity Investments. We are currently sourcing for a Data Engineer to work in Merrimack, NH!</p>
<h3 class="jobSectionHeader"><b>The Role</b></h3>
<p>The Brokerage Recordkeeping Technology, R4 Test Environment Modernization team, requires a highly competent and highly motivated Software Engineer to enhance our test data solutions. Our mission is to support and improve the non-prod stability through innovative test data management solutions. As part of this effort, you will engage collaboratively with systems and business partners to identify use cases and work through requirements.</p>
<p>As a Principal Software Engineer, you will apply your skills in all aspects of various projects including design, development, and implementation. You should have a desire to gain an understanding of our systems and business, as well as providing leadership, guidance, and mentoring as needed to other team members.</p>
<h3 class="jobSectionHeader"><b>The Expertise and Skills You Bring</b></h3>
<ul><li>10+ years of software development experience with a focus on data engineering/analysis.
</li><li>BS/BA or advanced degree, or equivalent experience preferred.
</li><li>Strong experience with Unix shell scripting (bash, ksh) and scheduling / orchestration tools (Control-M)
</li><li>Strong proficiency in Python, with experience developing data pipelines, automation scripts, and reusable data transformation logic.
</li><li>Experience developing APIs
</li><li>Experience working in the cloud preferably AWS
</li><li>Experience with Data Masking solutions (Delphix, Optim)
</li><li>Proficiency with DB2.
</li><li>Extensive experience in SQL language.
</li><li>Proven data analysis skills; not afraid to work in a complex data ecosystem
</li><li>Knowledge of native stored procedures is a plus.
</li><li>Efficient in developing data management solutions using RDBMS, Oracle, DB2, Cockroach DB, Postgres.
</li><li>Experience with data quality frameworks, including automated testing, validation, and monitoring to ensure trusted data.
</li><li>Any experience in mainframe languages and technologies is a plus. (Cobol, CICS, VSAM, JCL, utilities, FileAid, Endevor, debuggers, schedulers, etc.).
</li></ul><h3 class="jobSectionHeader"><b>The Value You Deliver</b></h3>
<ul><li>Ability to work with partners to help define requirements and solutions.
</li><li>Proven and strong interpersonal and organizational skills coupled with effective written communication skills.
</li><li>Confidence to think and act strategically, share innovative insights, and offer creative solutions to deliver exceptional user experiences.
</li><li>Embrace flexibility and shift focus to meet the most pressing customer/client needs.
</li><li>You bring a growth mentality to work every day as you continue to learn new applications and technologies and are willing to share that knowledge with your fellow squad members.
</li><li>Collaborative mindset with a willingness to share knowledge and mentor team members
</li></ul><h3 class="jobSectionHeader"><b>The Team</b></h3>
<p>This dynamic team is part of Brokerage Recordkeeping Technology with a focus on improving the value of test data across the environments and enabling modernization. As a leader on the BRT TDM team, you will help support an agile team with dedicated data engineers working in partnership with Engineering leaders and Developers in resolving the data challenges.</p>
<h3 class="jobSectionHeader"><b>Dynamic Working
</b></h3><p>Fidelity&rsquo;s hybrid working model blends the best of both onsite and offsite work experiences. Working onsite is important for our business strategy and our culture. We also value the benefits that working offsite offers associates. Most hybrid roles require associates to work onsite all business days of every other week in a Fidelity office.</p>
<p>Most roles at Fidelity are Hybrid, requiring associates to work onsite every other week (all business days, M-F) in a Fidelity office. This does not apply to Remote or fully Onsite roles. Some roles may have unique onsite requirements. Please consult with your recruiter for the specific expectations for this position.</p>
<p>Please be advised that Fidelity&rsquo;s business is governed by the provisions of the Securities Exchange Act of 1934, the Investment Advisers Act of 1940, the Investment Company Act of 1940, ERISA, numerous state laws governing securities, investment and retirement-related financial activities and the rules and regulations of numerous self-regulatory organizations, including FINRA, among others. Those laws and regulations may restrict Fidelity from hiring and/or associating with individuals with certain Criminal Histories.</p>
<h3 class="jobSectionHeader"><b>Company Overview</b></h3>
<p>At Fidelity, we are passionate about making our financial expertise broadly accessible and effective in helping people live the lives they want! We are a privately held company that places a high degree of value in creating and nurturing a work environment that attracts the best talent and reflects our commitment to our associates. We are proud of our diverse and inclusive workplace where we respect and value our associates for their unique perspectives and experiences. For information about working at Fidelity, visit FidelityCareers.com. Fidelity Investments is an equal opportunity employer. Fidelity will reasonably accommodate applicants with disabilities who need adjustments to complete the application or interview process.</p>
<p>Fidelity TalentSource, is the in-house temporary staffing provider for Fidelity Investments. Unlike traditional staffing agencies, we are an internal business unit within Fidelity&rsquo;s Talent Acquisition team, dedicated to recruiting talent from various backgrounds for roles in Fidelity&rsquo;s regional and investor center locations. Our mission is to help you experience Fidelity&rsquo;s diverse and inclusive workplace while expanding your skill set and professional network, with the ultimate goal of conversion to full-time employment as part of Fidelity&rsquo;s long-term strategy.</p>
<p>For information about working at Fidelity TalentSource, visit FTSJobs.com.</p>
<p>Fidelity TalentSource will reasonably accommodate applicants with disabilities who need adjustments in order to complete the application or interview process. Please email us at HR@ftsjobs.com if you would like to request an accommodation.</p></div>

Principal Data Engineer

Integrant

<div><p>We're on the lookout for exceptional individuals to join our team as <b>Principal Data Engineers</b>. As a part of our team, you'll be driving change and making a significant impact in the gaming industry.</p><ul>
<li>Lead the design, development, and maintenance of end-to-end data analytical solutions using Microsoft on-premises and cloud technologies.</li>
<li>Engage in collaborative requirement elicitation activities with our valued clientele.</li>
<li>Mentor and guide junior team members in the field of data engineering.</li>
<li>Showcase your expertise by delivering innovative analytical solutions to our clients and contributing to knowledge transfer within the organization.</li><br>
</ul><br>
<br>
<b>Requirements</b><br>
<ul><li>
6+ years of experience as a data engineer.</li><li>
Familiarity with analytical architectures including Data Warehouses, Data Lakes and Data Lakehouses.</li><li>
Knowledge of Microsoft relational engines available &ndash; both on-premises (MS SQL Server) and on the cloud (Azure SQL, Azure Synapse Analytics Dedicated Pools).</li><li>
Knowledge of query and workload optimization.</li><li>
Knowledge of administrating and managing analytical solutions both on premises and on the cloud.</li><li>
Knowledge of NoSQL offerings on Azure (e.g. CosmosDB).</li><li>
Knowledge of setting up Data Lakes on ADLS gen 2 and Azure Synapse Analytics.</li><li>
Knowledge of using SSIS and Azure Data Factory to set up ETL jobs.</li><li>
Knowledge of setting up OLAP solutions using SSAS.</li><li>
Familiarity with Azure Data Catalog to manage data lake metadata.</li><li>
Knowledge of governance over Azure based analytical solutions including using tools such as Purview, Active Directory, Key Vault, Azure DevOps, etc.</li><li>
Knowledge of using Azure Stream Analytics to capture and analyze data in real time.</li><li>
Knowledge of setting up data warehouse solutions both on-premises (using MS SQL Server) and on the cloud (using Azure Synapse Analytics).</li><li>
Knowledge of Dimensional Modeling (Dimensions, Facts, Slowly Changing Dimensions, Outriggers, Role Playing Dimensions, Junk Dimensions, Degenerate Dimensions, Multi-valued Dimensions, Transactional Facts, Periodic Snapshot Facts and Accumulating Snapshot Facts).</li><li>
Knowledge of implementing common ETL patterns to support data warehouse workloads.</li><li>
Knowledge of using U-SQL, PolyBase and Azure Data Lake Analytics to perform federated querying.</li><li>
Knowledge of PowerBI.</li><li>
Familiarity with SSRS.</li><li>
<b>Snowflake Experience:</b> Experience with Snowflake is required.</li></ul><p>
Nice to Have:</p><ul><li>
An MSc in Computer Science or other relevant field.</li><li>
Familiarity with Azure Databricks.</li><li>
Familiarity with DataOps</li><li>
Familiarity with Azure Cognitive Services.</li><li>
Familiarity with Azure ML.</li><li>
Familiarity with MLOps.</li><li>
Familiarity of containerization tools and frameworks (Docker, Kubernetes, etc.)</li><li>
Familiarity with Azure HD Insight.</li><li>
Familiarity with the Hadoop ecosystems, including tools like Hive, Spark and Kafka.</li><li>
Familiarity with Azure Functions to perform lightweight transformations.</li></ul><br>
<b>
Benefits</b><br>
<ul>
<li>Salary paid in USD</li>
<li>Six-month career advancing opportunities</li>
<li>Supportive and friendly work environment</li>
<li>Premium medical insurance [employee +family]</li>
<li>English language development courses</li>
<li>Interest-free loans paid over 2.5 years</li>
<li>Technical development courses</li>
<li>Planned overtime program (POP)</li>
<li>Employment referral program</li>
<li>Premium location in Maadi</li>
<li>Social insurance</li></ul></div>

Integrant, Inc.

<div>
 <p>
  We're on the lookout for exceptional individuals to join our team as
  <strong>
   Principal Data Engineers
  </strong>
  . As a part of our team, you'll be driving change and making a significant impact in the gaming industry.
 </p>
 <ul>
  <li>
   Lead the design, development, and maintenance of end-to-end data analytical solutions using Microsoft on-premises and cloud technologies.
  </li>
  <li>
   Engage in collaborative requirement elicitation activities with our valued clientele.
  </li>
  <li>
   Mentor and guide junior team members in the field of data engineering.
  </li>
  <li>
   Showcase your expertise by delivering innovative analytical solutions to our clients and contributing to knowledge transfer within the organization.
  </li>
  <br/>
  <br/>
 </ul>
 <strong>
  Requirements
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   6+ years of experience as a data engineer.
  </li>
  <li>
   Familiarity with analytical architectures including Data Warehouses, Data Lakes and Data Lakehouses.
  </li>
  <li>
   Knowledge of Microsoft relational engines available - both on-premises (MS SQL Server) and on the cloud (Azure SQL, Azure Synapse Analytics Dedicated Pools).
  </li>
  <li>
   Knowledge of query and workload optimization.
  </li>
  <li>
   Knowledge of administrating and managing analytical solutions both on premises and on the cloud.
  </li>
  <li>
   Knowledge of NoSQL offerings on Azure (e.g. CosmosDB).
  </li>
  <li>
   Knowledge of setting up Data Lakes on ADLS gen 2 and Azure Synapse Analytics.
  </li>
  <li>
   Knowledge of using SSIS and Azure Data Factory to set up ETL jobs.
  </li>
  <li>
   Knowledge of setting up OLAP solutions using SSAS.
  </li>
  <li>
   Familiarity with Azure Data Catalog to manage data lake metadata.
  </li>
  <li>
   Knowledge of governance over Azure based analytical solutions including using tools such as Purview, Active Directory, Key Vault, Azure DevOps, etc.
  </li>
  <li>
   Knowledge of using Azure Stream Analytics to capture and analyze data in real time.
  </li>
  <li>
   Knowledge of setting up data warehouse solutions both on-premises (using MS SQL Server) and on the cloud (using Azure Synapse Analytics).
  </li>
  <li>
   Knowledge of Dimensional Modeling (Dimensions, Facts, Slowly Changing Dimensions, Outriggers, Role Playing Dimensions, Junk Dimensions, Degenerate Dimensions, Multi-valued Dimensions, Transactional Facts, Periodic Snapshot Facts and Accumulating Snapshot Facts).
  </li>
  <li>
   Knowledge of implementing common ETL patterns to support data warehouse workloads.
  </li>
  <li>
   Knowledge of using U-SQL, PolyBase and Azure Data Lake Analytics to perform federated querying.
  </li>
  <li>
   Knowledge of PowerBI.
  </li>
  <li>
   Familiarity with SSRS.
  </li>
  <li>
   <strong>
    Snowflake Experience:
   </strong>
   Experience with Snowflake is required.
  </li>
 </ul>
 <p>
  Nice to Have:
 </p>
 <ul>
  <li>
   An MSc in Computer Science or other relevant field.
  </li>
  <li>
   Familiarity with Azure Databricks.
  </li>
  <li>
   Familiarity with DataOps
  </li>
  <li>
   Familiarity with Azure Cognitive Services.
  </li>
  <li>
   Familiarity with Azure ML.
  </li>
  <li>
   Familiarity with MLOps.
  </li>
  <li>
   Familiarity of containerization tools and frameworks (Docker, Kubernetes, etc.)
  </li>
  <li>
   Familiarity with Azure HD Insight.
  </li>
  <li>
   Familiarity with the Hadoop ecosystems, including tools like Hive, Spark and Kafka.
  </li>
  <li>
   Familiarity with Azure Functions to perform lightweight transformations.
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Benefits
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Salary paid in USD
  </li>
  <li>
   Six-month career advancing opportunities
  </li>
  <li>
   Supportive and friendly work environment
  </li>
  <li>
   Premium medical insurance [employee +family]
  </li>
  <li>
   English language development courses
  </li>
  <li>
   Interest-free loans paid over 2.5 years
  </li>
  <li>
   Technical development courses
  </li>
  <li>
   Planned overtime program (POP)
  </li>
  <li>
   Employment referral program
  </li>
  <li>
   Premium location in Maadi
  </li>
  <li>
   Social insurance
  </li>
 </ul>
</div>


Clarity Innovations, LLC

<div><div><p>Clarity Innovations is a trusted national security partner, dedicated to safeguarding our nation&rsquo;s interests and delivering innovative solutions that empower the Intelligence Community (IC) and Department of Defense (DoD) to transform data into actionable intelligence, ensuring mission success in an evolving world.</p>
<p>
Our mission-first software and data engineering platform modernizes data operations, utilizing advanced workflows, CI/CD, and secure DevSecOps practices. We focus on challenges in Information Warfare, Cyber Operations, Operational Security, and Data Structuring, enabling end-to-end solutions that drive operational impact.</p>
<p>
We are committed to delivering cutting-edge tools and capabilities that address the most complex national security challenges, empowering our partners to stay ahead of emerging threats and ensuring the success of their critical missions. At Clarity, we are people-focused and set on being a destination employer for top talent, offering an environment where innovation thrives, careers grow, and individuals are valued. Join us as we continue to lead innovation and tackle the most pressing challenges in national security.</p></div><div><h1 class="jobSectionHeader"><b>
Position Overview</b></h1>
<p>
The Data Transport Engineer II is responsible for the design, implementation, and validation of secure data movement within the Unified Data Model (UDM) team. This role focuses on integration between UDM, Apache NiFi, and external stakeholder systems in constrained and classified environments where data flow correctness, schema integrity, and transport reliability are mission-critical. The position is delivery and compliance-oriented rather than availability or on-call focused.</p>
<h1 class="jobSectionHeader"><b>
Position Details</b></h1>
<p><b>
Clearance Required: </b>Active TS/SCI with CI poly</p>
<p><b>
Employment Type: </b>Full-Time</p>
<p><b>
Location: </b>On-Site Maryland/DC</p>
<h1 class="jobSectionHeader"><b>
Key Responsibilities</b></h1>
<ul><li>Design, implement, and validate secure data movement between Apache NiFi and external stakeholder components.</li>
<li>Support ingestion pipelines, data transfer reliability, and format validation in constrained and classified environments.</li>
<li>Troubleshoot data flow issues, schema alignment failures, and transport-layer integration problems across system boundaries.</li>
<li>Partner with platform and infrastructure teams to ensure data movement architecture aligns with enterprise standards and security controls.</li>
<li>Develop and maintain documentation for data transport patterns, pipeline configurations, and integration test results.</li>
<li>Contribute to delivery timelines by meeting enterprise compliance requirements and integration milestones.</li>
<li>Participate in peer reviews of pipeline configurations, data schemas, and transport layer designs.</li>
<li>Support sprint-based delivery within an Agile/Scrum environment, reporting progress to program leadership.</li>
</ul><h1 class="jobSectionHeader"><b>Required Qualifications</b></h1>
<p><b>
Clearance &amp; Compliance</b></p>
<ul>
<li>Active TS/SCI w/ CI Poly security clearance (required prior to start).</li>
<li>Ability to operate in classified environments and comply with all applicable government and program security protocols.</li>
</ul>
<p><b>Technical Skills</b></p>
<ul>
<li>Hands-on experience with Apache NiFi for data flow design, pipeline configuration, and processor development.</li>
<li>Working knowledge of data format conversion and schema validation (JSON, XML, Avro, Protobuf, or similar).</li>
<li>Familiarity with data modeling concepts and structured data interchange patterns.</li>
<li>Experience with REST APIs and integration patterns for data transport between distributed systems.</li>
<li>Proficiency in at least one scripting or programming language (Python, Groovy, Java) for pipeline customization.</li>
<li>Understanding of data transport security requirements including encryption in transit and access control.</li>
</ul>
<p><b>Experience</b></p>
<ul>
<li>5-10 years of experience in data engineering, integration engineering, or a directly related role.</li>
<li>Experience working in government, defense, or other regulated/classified environments preferred.</li>
<li>Demonstrated ability to troubleshoot integration failures and resolve data consistency issues in production pipelines.</li>
</ul><h1 class="jobSectionHeader"><b>Preferred Qualifications</b></h1>
<ul><li>Experience with Kubernetes-based deployment environments and containerized data pipelines.</li>
<li>Familiarity with document/data ingestion workflows.</li>
<li>Experience with CI/CD pipelines and DevSecOps practices in a government contracting context.</li>
<li>Familiarity with Agile/Scrum delivery and working in cross-functional product teams.</li>
</ul></div><p></p><div>
<div><div><div><div><div><div><div><div>We are an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.</div></div></div></div></div></div></div></div></div></div>

Fidelity Investments

<div><h3 class="jobSectionHeader"><b>Job Description:</b></h3><p><b>
Principal Data Science Engineer - Financial Crimes</b></p><p><b>
The Role</b>
</p><p><b>Financial Crimes Models &amp; Analytics </b>is seeking a <b>Principal Data Science Engineer </b>to lead the design, development, and optimization of our transaction monitoring surveillance models.
</p><p>You will partner with our Data Scientists, Business Intelligence analysts, Investigators, and Compliance professionals to translate regulatory requirements into scalable, rules based &amp; machine learning detection models. <b>This role requires a unique blend of banking, brokerage, anti-money laundering (AML) &amp; fraud knowledge, as well as data analysis, data engineering, and AI/ML expertise.
</b></p><p>If you&rsquo;re passionate about feature engineering, analytics, and machine learning to help fight financial crime, this is an excellent opportunity for you!
</p><p><b>The responsibilities of this role:</b></p><ul><li>
Collaborate with team members and compliance partners to understand<b> AML typologies</b> and <b>red flags</b> we must detect
</li><li>Assist in building detection models and features using <b>SQL, Python, DBT</b> (Data Build Tool), and <b>Snowflake</b>
</li><li>Develop detection models using both rules-based and machine learning algorithms on customer, account, and transaction data
</li><li>Apply machine learning and AI techniques to enhance suspicious activity detection by analyzing and identifying appropriate target data.
</li><li>Monitor and optimize model performance using proper ML Operations tools
</li><li>Help drive AI use cases for investigative workflows including integration in alert management systems, narrative generation, and straight through SAR filing
</li><li>Champion best practices for CI/CD, robust automated testing, model performance, and production monitoring
</li><li>Provide technical leadership, mentoring and training to other team members through code reviews, collaboration, and educational presentations
</li><li>Explore new technologies (e.g., anomaly detection, graph analytics, predictive modeling) and determine their applicability to the team&rsquo;s use cases; orchestrate the adoption of such technologies and trends where appropriate
</li></ul><p><b>The Expertise and Skills You Bring</b></p><p><b>
Required Qualifications</b>
</p><ul><li><b>Bachelor&rsquo;s degree in Computer Science </b>or equivalent technical discipline.
</li><li><b>6+ years</b> of experience in software or data engineering, including leading and delivering complex projects.
</li><li><b>Strong proficiency in Python </b>or at least one object-oriented programming language (e.g., Java) with a focus on writing clean, modular, and testable code.
</li><li>Strong experience querying <b>relational databases</b> (e.g., Oracle, Snowflake) and working with non-relational databases (e.g., MongoDB).
</li><li>Hands-on experience with <b>machine learning algorithms</b>, including decision trees, neural networks, regression models, clustering, and anomaly detection.
</li></ul><p><b>Preferred Skills</b>
</p><ul><li><b>Domain expertise</b>: Prior experience working with customer and transactional data in the fraud or AML space.
</li><li><b>Digital assets knowledge</b>: Understanding blockchain technologies; prior experience in cryptocurrency monitoring is a plus.
</li><li>Experience with <b>dbt (data build tool)</b> for data transformation and pipeline development.
</li><li>Prior experience developing solutions using <b>large language models (LLMs)</b>, including <b>Retrieval-Augmented Generation (RAG)</b> for information retrieval and workflow automation.
</li><li>Certifications such as CAMS (Certified Anti-money Laundering Specialist) or CFE (Certified Fraud Examiner) are desirable
</li></ul><p><b>The Team</b>
</p><p>Financial Crimes Models &amp; Analytics is made up of Data Scientists, Data Engineers, Business Intelligence, and Data Visualization analysts. Our team has broad responsibility for Fidelity Investments transaction monitoring across multiple business units, including Brokerage and Digital Assets. We leverage data to detect potential suspicious activity, customer behavior changes, and more.
</p><p>Coverage areas include insider trading, high risk money movement, customer behavior &amp; potentially suspicious transactional patterns, elder financial exploitation, low-priced securities, emerging risks, cryptocurrency transactions and many more.
</p>The base salary range for this position is $107,000-216,000 USD per year.
<p>Placement in the range will vary based on job responsibilities and scope, geographic location, candidate&rsquo;s relevant experience, and other factors.</p><p>
Base salary is only part of the total compensation package. Depending on the position and eligibility requirements, the offer package may also include bonus or other variable compensation.
</p><p>We offer a wide range of benefits to meet your evolving needs and help you live your best life at work and at home. These benefits include comprehensive health care coverage and emotional well-being support, market-leading retirement, generous paid time off and parental leave, charitable giving employee match program, and educational assistance including student loan repayment, tuition reimbursement, and learning resources to develop your career. Note, the application window closes when the position is filled or unposted.</p><p>
Please be advised that Fidelity&rsquo;s business is governed by the provisions of the Securities Exchange Act of 1934, the Investment Advisers Act of 1940, the Investment Company Act of 1940, ERISA, numerous state laws governing securities, investment and retirement-related financial activities and the rules and regulations of numerous self-regulatory organizations, including FINRA, among others. Those laws and regulations may restrict Fidelity from hiring and/or associating with individuals with certain Criminal Histories.</p><p>
Most roles at Fidelity are Hybrid, requiring associates to work onsite every other week (all business days, M-F) in a Fidelity office. This does not apply to Remote or fully Onsite roles. Please consult with your recruiter for the specific expectations for this position.</p><h3 class="jobSectionHeader"><b>
Certifications:</b></h3><h3 class="jobSectionHeader"><b>
Category:</b></h3>
Data Analytics and Insights</div>

Principal Data Science Engineer - Financial Crimes

Torq

<div><p>Are you driven by the challenge of turning complex data into actionable insights? Do you thrive on building scalable data systems that power better decisions and real business impact? If you're ready to lead with purpose and bring data to life, Torq is the place for you.</p>
<p>
We are looking for data engineers and technical leaders who don't just build pipelines and create dashboards&mdash;they design systems that solve real business challenges and influence key strategic decisions for our clients.</p>
<p>
At<b> </b>Torq, you'll join a collaborative team that takes on complex, high-impact projects. You'll guide clients through the full data lifecycle&mdash;from raw ingestion to advanced analytics&mdash;and help them unlock the full potential of their data ecosystem.</p>
<p><b>
What You Could Be Doing</b></p>
<p>
While every project we work on is different, below is a high-level overview of some of the responsibilities/hats you may wear:</p>
<ul>
<li>Build strong relationships with data consumers to understand usage patterns and design intuitive, scalable data models.</li>
<li>Design, develop, and deliver high-quality data pipelines that align with privacy, governance, and performance best practices.</li>
<li>Build both real-time and batch data integrations from a variety of source systems into cloud-based data lakes and warehouses.</li>
<li>Develop and maintain ETL/ELT processes and tools to support both streaming and offline analytics.</li>
<li>Define and implement key performance indicators (KPIs) to measure the efficiency, quality, and reliability of data engineering processes.</li>
<li>Participate in code reviews, promoting clean, maintainable, and well-documented code aligned with engineering best practices.</li>
<li>Create and maintain data definitions and metadata consistent with data management standards.</li>
<li>Provide operational support for data integration and transformation workflows in production environments.</li>
</ul>
<p><b>What You Bring to the Table</b></p>
<p>
When you join our team, you're a consultant first. This means there are core skills we expect out of each of our team members. These include:</p>
<ul>
<li>Bachelor's degree in Data Science, Computer Science, Information Systems, Engineering, or a related field</li>
<li>8+ years of hands-on experience in data warehousing, ETL development, and data modeling (both conceptual and physical) or other related technical &amp; analytical work</li>
<li>Willingness to work a hybrid schedule (2-3 days per-week onsite)</li>
<li>Data acquisition &amp; sourcing: APIs, flat files, event streams</li>
<li>Solid experience with ETL/ELT pipeline development, scripting automation, including performance optimization &amp; data quality assurance
<ul><li>Tools like: Python, SQL, Apache Airflow, dbt, Kafka, Terraform, etc.</li>
</ul></li><li>Strong understanding of data architecture, schema design, normalization/denormalization, and data lifecycle management
<ul><li>Cloud data platforms: Azure Data Services (preferred), AWS, or Google Cloud Platform</li>
<li>Data Warehousing: Synapse, Snowflake, BigQuery, Redshift, etc.</li>
</ul></li><li>Proficient in Reporting Platforms to query large data sets
<ul><li>Ex: PowerBI, Tableau, Looker, or similar tools</li>
</ul></li><li>Familiarity with data governance security, and compliance best practices (Collibra, Unity Catalog, Purview)</li>
<li>Strong Snowflake and Python data engineering experience with hands-on pipeline development</li>
<li>Proficient in SQL and experienced in designing efficient queries for large-scale data sets</li>
<li>Strong communication skills and the ability to collaborate with both technical and non-technical stakeholders</li>
</ul>
<p><b>In addition, each one of our consultants brings a unique and valuable toolbox of skills with them specific to their practice. Below are some examples of skills we are always looking to add to the team (don't worry &ndash; we don't expect you to have all of them, but they are always a plus!):</b></p>
<ul>
<li>Experience with CI/CD pipelines for data solutions using tools like GitHub Actions, Azure DevOps, or Jenkins</li>
<li>Exposure to Power BI or other BI tools for data visualization and reporting</li>
<li>Experience with Delta Lake, Data Mesh, or Lakehouse architectures</li>
<li>Familiarity with Databricks on Azure</li>
</ul>
<p><b>Benefits and Other Fun Stuff:</b><br>
<br>
We ask our consultants to be superstars, so we treat them like it. Even better, our perks are designed for employees by our employees. We do this because we believe in delivering a compelling benefits package that puts you at the heart of our rewards.</p>
<ul>
<li>Competitive Salary &ndash; your bank account will be smiling</li>
<li>Unlimited PTO &ndash; we're serious about that work-life balance thing</li>
<li>Best-in-class health/vision/dental benefits &ndash; your health is our priority</li>
<li>Generous 401K options &ndash; take care of your future with us</li>
<li>Paid Parental Leave - supporting you during life's biggest milestones</li>
<li>Opportunity to be a key player at a highly reputable, fast-growing consulting firm</li>
<li>High degree of internal mobility and diverse project opportunities</li>
</ul>
<p><i>The salary range for this position considers multiple factors influencing compensation decisions, such as skillset, previous experience, certifications, and various business &amp; organizational requirements. Being hired at or near the top of the range for this role is uncommon, as compensation determinations rely on individual circumstances. Currently, the base salary range is estimated to be between $130,000 and $170,000.</i></p><div><p><i>
Torq is an Equal Opportunity Employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, national origin, genetic information, age, disability, veteran status, or any other legally protected basis.</i></p>
<ul><li><i>Note: No visa sponsorship is available for this position, all applicants must be currently authorized to work in the United States for any employer.</i></li></ul></div></div><p></p>

Principal Consultant - Data Engineer

Palo Alto Networks

<div><div>Santa Clara, California, United States IT Ref ID: JR-015318</div><p></p><div><br>
</div><div><p><b>Our Mission</b></p><p></p><p>
At Palo Alto Networks&reg;, we&rsquo;re united by a shared mission&mdash;to protect our digital way of life. We thrive at the intersection of innovation and impact, solving real-world problems with cutting-edge technology and bold thinking. Here, everyone has a voice, and every idea counts. If you&rsquo;re ready to do the most meaningful work of your career alongside people who are just as passionate as you are, you&rsquo;re in the right place.</p><p></p><p><b>
Who We Are</b></p><p></p><p>
In order to be the cybersecurity partner of choice, we must trailblaze the path and shape the future of our industry. This is something our employees work at each day and is defined by our values: Disruption, Collaboration, Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do and use it to augment the impact every individual can have. If you are passionate about solving real-world problems and ideating beside the best and the brightest, we invite you to join us!</p><p></p>
We believe collaboration thrives in person. That&rsquo;s why most of our teams work from the office full time, with flexibility when it&rsquo;s needed. This model supports real-time problem-solving, stronger relationships, and the kind of precision that drives great outcomes.<p></p><p><b>
Job Summary</b></p><p></p><div><p>
Our Data &amp; Analytics group is responsible for working with various business owners/stakeholders from Sales, Marketing, People, GCS, Infosec, Operations, and Finance to solve complex business problems which will have a direct impact on the metrics defined to showcase the progress of Palo Alto Networks. We leverage the latest technologies from the Cloud &amp; Big Data ecosystem to improve business outcomes and create through prototyping, Proof-of-Concept projects and application development. We are looking for a Principal IT Data Engineer with extensive experience in Data engineering, SQL, Cloud engineering and business intelligence (BI) tools. The ideal candidate will be responsible for architecting, designing, implementing, and maintaining scalable data transformations and analytical solutions that support our business objectives. This role requires a strong understanding of data engineering principles, as well as the ability to collaborate with cross-functional teams to deliver high-quality data solutions.</p></div><div><div><div><p><b>
Key Responsibilities</b></p></div></div><div></div><ul><li><p>
Design, develop, and maintain data pipelines to extract, transform, and load (ETL) data from various sources into our data warehouse or data lake environment.</p></li><li><p>
Aptitude for proactively identifying and implementing GenAI-driven solutions to achieve measurable improvements in the reliability and performance of data pipelines or to optimize key processes like data quality validation and root cause analysis for data issues, is a nice-to-have.</p></li><li><p>
Collaborate with stakeholders to gather requirements and translate business needs into technical solutions.</p></li><li><p>
Optimize and tune existing data pipelines and transformations for performance, reliability, and scalability.</p></li><li><p>
Implement data quality and governance processes to ensure data accuracy, consistency, and compliance with regulatory standards.</p></li><li><p>
Work closely with the BI team to design and develop dashboards, reports, and analytical tools that provide actionable insights to stakeholders.</p></li><li><p>
Mentor junior members of the team and provide guidance on best practices for data engineering and BI development.</p></li><li><p>
Drive new and improved processes to increase engineer productivity.</p></li><li><p>
Good to have a trusted technical advisor / thought leader, identifying and integrating emerging technologies (e.g., AI/ML, agentic frameworks, AI-first architectures, cloud-native platforms) and guiding teams to adopt innovative best practices that ensure systems remain adaptable and future-ready.</p></li></ul></div><p></p><p><b>
Qualifications
</b></p><div><div><div><p><b>Required Qualifications</b></p></div></div><div></div><ul><li><p>
Minimum of 12 years of related experience with a Bachelor&rsquo;s degree in Computer Science, Engineering, or a related field or 8 years and a Master&rsquo;s degree; or a PhD with 5 years experience.</p></li><li><p>
5+ years of experience in data engineering, with a focus on building and maintaining data pipelines and analytical solutions.</p></li><li><p>
Expertise in SQL programming and database management systems.</p></li><li><p>
Hands-on experience with ETL tools and technologies such as Apache Spark and Apache Airflow.</p></li><li><p>
Experience with cloud platforms (preferably GCP) and services like Dataflow, DataProc, BigQuery, and Cloud Composer.</p></li><li><p>
Experience in AI Tools and good understanding of implementing AI in development lifecycle is mandatory</p></li><li><p>
Demonstrated readiness to leverage GenAI tools to enhance efficiency within the typical stages of the data engineering lifecycle, for example by generating complex SQL queries, creating initial Python/Spark script structures, or auto-generating pipeline documentation, is a nice-to-have.</p></li></ul></div><p></p><div><div><p><b>
Preferred Qualifications</b></p></div><div></div><ul><li><p>
Experience with Big Data tools like Kafka.</p></li><li><p>
Proficiency in object-oriented or object-functional scripting languages such as Python or Scala.</p></li><li><p>
Experience with BI visualization platforms like Tableau.</p></li><li><p>
Familiarity with SFDC Data Objects (e.g., Opportunity, Quote, Accounts).</p></li><li><p>
Aptitude for leveraging GenAI tools to enhance efficiency in the data engineering lifecycle.</p></li></ul></div><p></p><p><b>
Compensation Disclosure</b></p><p></p><p>
The compensation offered for this position will depend on qualifications, experience, and work location. For candidates who receive an offer at the posted level, the starting base salary (for non-sales roles) or base salary + commission target (for sales/com-missioned roles) is expected to be the annual range listed below. The offered compensation may also include restricted stock units and a bonus. A description of our employee benefits may be found here.</p><p></p>
$167,000.00 - $270,500.00/yr<p></p><p><b>
Our Commitment
</b></p><p></p><p>We&rsquo;re trailblazers that dream big, take risks, and challenge cybersecurity&rsquo;s status quo. It&rsquo;s simple: we can&rsquo;t accomplish our mission without diverse teams innovating, together.</p><p></p><p>
We are committed to providing reasonable accommodations for all qualified individuals with a disability. If you require assistance or accommodation due to a disability or special need, please contact us at accommodations@paloaltonetworks.com.</p><p></p><p>
Palo Alto Networks is an equal opportunity employer. We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected characteristics.</p><p></p><p>
All your information will be kept confidential according to EEO guidelines.</p><p></p>
Is role eligible for Immigration Sponsorship? No. Please note that we will not sponsor applicants for work visas for this position.</div></div><p></p>

Principal IT Data Engineer - Data & Analytics

Search 10000+ Principal data engineer jobs near you this March. New roles added regularly across leading industries. Apply today.

10000 principal data engineer jobs Near Me

Principal Data Engineer

Principal Data Engineer

Principal Data Engineer

Principal Data Engineer

Principal Data Science Engineer - Financial Crimes

Principal Consultant - Data Engineer

Principal IT Data Engineer - Data & Analytics