data engineer

Buzzency LLC

Job Title: Data Engineer Location: Princeton, NJ (Hybrid) Experience Required: 8+ YearsStatus: W2: USC, GC, GC EADJob Overview:We are seeking an experienced and skilled Data Engineer to join our team in Princeton, NJ. This role requires strong expertise in Azure cloud data platforms and BI technologies. The ideal candidate will possess in-depth experience in designing and implementing end-to-end data pipelines and solutions using Microsoft and Azure BI tools, with a strong preference for candidates familiar with the insurance or actuarial domain.Key Responsibilities:<ul><li>Design, develop, and maintain data pipelines using Azure Data Factory (ADF), Azure Databricks, Azure Data Lake, and Azure SQL.</li><li>Develop and manage staging, bronze, silver, and gold layers of data architecture.</li><li>Build robust and scalable ETL/ELT solutions to support business intelligence and analytics platforms.</li><li>Create and deploy Azure Analysis Services tabular models and schedule updates using Azure Automation Runbooks.</li><li>Develop and maintain SSAS (tabular/multidimensional) cubes, KPIs, partitions, aggregations, and data mining models.</li><li>Write efficient PySpark and DBT scripts for data transformation tasks in Azure Databricks.</li><li>Work with unstructured and structured data from multiple sources including flat files, relational databases, and NoSQL (e.g., MongoDB).</li><li>Collaborate with cross-functional teams and business stakeholders to understand data needs and translate them into scalable solutions.</li><li>Support and maintain existing BI solutions while identifying opportunities for performance optimization.</li></ul>Technical Skills Required:Cloud &amp; BI Tools:<ul><li>Azure Data Factory (ADF)</li><li>Azure Databricks</li><li>Azure Analysis Services (SSAS)</li><li>Azure Data Lake Analytics &amp; Store (ADLS)</li><li>Azure Integration Runtime</li><li>Azure Event Hubs</li><li>Azure Stream Analytics</li><li>DBT (Data Build Tool)</li></ul>Databases &amp; Languages:<ul><li>Azure SQL</li><li>MongoDB</li><li>PySpark</li></ul>Other Tools:<ul><li>SQL Server Integration Services (SSIS)</li><li>SQL Server Reporting Services (SSRS)</li></ul>Preferred Domain Knowledge:<ul><li>Experience with insurance or reinsurance data, especially in areas like treaty structures, placements, and renewal workflows.</li><li>Familiarity with actuarial rating data (exposure, experience data, tags, and program structures).</li><li>Experience supporting actuarial analytics, pricing tools, and client-facing reporting pipelines.</li></ul>Soft Skills &amp; Team Collaboration:<ul><li>Strong interpersonal and analytical skills.</li><li>Proficient in SDLC and Agile/Scrum methodologies.</li><li>Self-motivated, proactive, and able to work independently or as part of a team.</li><li>Strong communication skills with the ability to explain technical concepts to non-technical stakeholders.</li><li>Capable of decision-making in high-pressure, complex project scenarios.</li></ul>Job Types: Full-time, ContractPay: $80.00 per hourSchedule:<ul><li>Day shift</li></ul>Work Location: Hybrid remote in Princeton, NJ 08540 <div id='job-id'>Job Id: 8DGqJdO6DGoTFGwKGWsNQADJ4TVao3DLmqD358rz6WTPBqki3TE72npOyVWT6FCJegfRuTuvxjLEuFROR+datlDfsiMXl0aHZhST/9QSTL3prryf</div>

Data Engineer

Accenture

Project Role : Data Engineer 
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
 
Must have skills : Microsoft Azure Databricks 
Good to have skills : NA 
Minimum 5 year(s) of experience is required 
Educational Qualification : 15 years full time education 
 
Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to effectively migrate and deploy data across various systems, contributing to the overall efficiency and reliability of data management within the organization. Roles &amp; Responsibilities: - Expected to be an SME. - Collaborate and manage the team to perform. - Responsible for team decisions. - Engage with multiple teams and contribute on key decisions. - Provide solutions to problems for their immediate team and across multiple teams. - Mentor junior team members to enhance their skills and knowledge. - Continuously evaluate and improve data processes to optimize performance. Professional &amp; Technical Skills: - Must To Have Skills: Proficiency in Microsoft Azure Databricks. - Good To Have Skills: Experience with data warehousing solutions. - Strong understanding of data modeling and database design principles. - Familiarity with data governance and data quality frameworks. - Experience in programming languages such as Python or Scala for data processing. Additional Information: - The candidate should have minimum 7.5 years of experience in Microsoft Azure Databricks. - This position is based at our Bengaluru office. - A 15 years full time education is required.
 
15 years full time education <div id='job-id'>Job Id: r4a52jlWthopEvbeqmgVRjlRENG6oExbRJrLgby1IR4brx+1sMrZ0vvGKloZOfd8LuAOrVGFjoUOzstyFA1aQinMb936eoF8U/YbkKqR9cteXfCBOf5fA+kPdbU30Ycae1pt/BLA</div>

Project Role : Data Engineer 
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
 
Must have skills : PySpark 
Good to have skills : NA 
Minimum 7.5 year(s) of experience is required 
Educational Qualification : 15 years full time education 
 
Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across various systems. You will collaborate with cross-functional teams to understand their data needs and provide effective solutions, ensuring that the data infrastructure is robust and scalable to meet the demands of the organization. Roles &amp; Responsibilities: - Expected to be an SME. - Collaborate and manage the team to perform. - Responsible for team decisions. - Engage with multiple teams and contribute on key decisions. - Provide solutions to problems for their immediate team and across multiple teams. - Mentor junior team members to enhance their skills and knowledge in data engineering. - Continuously evaluate and improve data processes to enhance efficiency and effectiveness. Professional &amp; Technical Skills: - Must To Have Skills: Proficiency in PySpark. - Strong understanding of data pipeline architecture and design. - Experience with ETL processes and data integration techniques. - Familiarity with data quality frameworks and best practices. - Knowledge of cloud platforms and services related to data storage and processing. Additional Information: - The candidate should have minimum 5 years of experience in PySpark. - This position is based at our Bengaluru office. - A 15 years full time education is required.
 
15 years full time education <div id='job-id'>Job Id: d3aiLeDMZ2Lj1SWrJqljHdD3JUWLNIvUBiL0wyOxYagFJy4UcsoS1bc2EjNAIMHlfcPLPBSK9uUy9832UwyHwjP555FPmsPnWMzUR1Hl8d6YrMLNM14TL5e4XMtb/iNe/zEWWNfd</div>

S2S Soft

Under general supervision, combines strong technical skills with knowledge of the database administration. Works on one or more projects of high complexity.Seeking a highly skilled and proactive Data Engineer to join our dynamic team and support the modernization of our data estate. This role is integral to the migration from legacy systems and the development of scalable, secure, and efficient data solutions using modern technologies, particularly Microsoft Fabric and Azure-based platforms. The successful candidate will contribute to data infrastructure design, data modeling, pipeline development, and visualization delivery to enable data-driven decision-making across the enterprise.Work Location &amp; Attendance Requirements:<ul><li>Must be physically located in metro Atlanta.</li></ul><ul><li>On-site: Tuesday to Thursday, per manager&rsquo;s discretion</li></ul><ul><li>Mandatory in-person meetings:</li></ul>o All Handso Enterprise Applicationso On-site meetingso DECAL All Staff<ul><li>Work arrangements subject to management&rsquo;s discretion</li></ul>Experience Required: 5+ yearsKey Responsibilities:<ul><li>Design, build, and maintain scalable ETL/ELT data pipelines using Microsoft Fabric and Azure Databricks.</li></ul><ul><li>Implement medallion architecture (Bronze, Silver, Gold) to support data lifecycle and data quality.</li></ul><ul><li>Support the sunsetting of legacy SQL-based infrastructure and SSRS, ensuring data continuity and stakeholder readiness.</li></ul><ul><li>Create and manage notebooks (e.g., Fabric Notebooks, Databricks) for data transformation using Python, SQL, and Spark.</li></ul><ul><li>Build and deliver curated datasets and analytics models to support Power BI dashboards and reports.</li></ul><ul><li>Develop dimensional and real-time data models for analytics use cases.</li></ul><ul><li>Collaborate with data analysts, stewards, and business stakeholders to deliver fit-for-purpose data assets.</li></ul><ul><li>Apply data governance policies including row-level security, data masking, and classification in line with Microsoft Purview or Unity Catalog.</li></ul><ul><li>Ensure monitoring, logging, and CI/CD automation using Azure DevOps for data workflows.</li></ul><ul><li>Provide support during data migration and cutover events, ensuring minimal disruption.</li></ul>Technical Stack:<ul><li>Microsoft Fabric</li></ul><ul><li>Azure Databricks</li></ul><ul><li>SQL Server / SQL Managed Instances</li></ul><ul><li>Power BI (including semantic models and datasets)</li></ul><ul><li>SSRS (for legacy support and decommissioning)</li></ul>Qualifications:<ul><li>Bachelor&rsquo;s degree in Computer Science, Information Systems, or related field</li></ul><ul><li>5+ years of experience in data engineering roles, preferably in government or regulated environments</li></ul><ul><li>Proficiency in SQL, Python, Spark.</li></ul><ul><li>Hands-on experience with Microsoft Fabric (Dataflows, Pipelines, Notebooks, OneLake)</li></ul><ul><li>Experience with Power BI data modeling and dashboard development</li></ul><ul><li>Familiarity with data governance tools (Microsoft Purview, Unity Catalog)</li></ul><ul><li>Solid understanding of ETL/ELT pipelines, data warehousing concepts, and schema design</li></ul><ul><li>Strong communication and collaboration skills.</li></ul>Preferred Qualifications:<ul><li>Certifications such as Microsoft Certified: Fabric Analytics Engineer or Azure Data Engineer Associate</li></ul><ul><li>Knowledge of CI/CD automation with Azure DevOps</li></ul><ul><li>Familiarity with data security and compliance (e.g., FIPS 199, NIST)</li></ul><ul><li>Experience managing sunset and modernization of legacy reporting systems like SSRS</li></ul>Soft Skills:<ul><li>Strong analytical thinking and problem-solving abilities</li></ul><ul><li>Ability to collaborate across multidisciplinary teams</li></ul><ul><li>Comfort in fast-paced and evolving technology environments</li></ul>This role is critical to our shift toward a modern data platform and offers the opportunity to influence our architectural decisions and technical roadmap.Job Type: ContractPay: $62.00 - $70.00 per hourExpected hours: 40 per weekApplication Question(s):<ul><li>Do you have experience in data engineering roles, preferably in government or regulated environments?</li><li>Do you have hands-on experience with Microsoft Fabric (Dataflows, Pipelines, Notebooks, OneLake)?</li><li>Do you have experience with Power BI data modeling and dashboard development?</li><li>Do you have familiarity with data governance tools (Microsoft Purview, Unity Catalog)?</li><li>Do you have solid understanding of ETL/ELT pipelines, data warehousing concepts, and schema design?</li><li>Bachelor&rsquo;s degree in Computer Science, Information Systems, or related field ?</li><li>What is your expected hourly pay rate?</li><li>What is your current location?</li></ul>Ability to Commute:<ul><li>Atlanta, GA 30334 (Required)</li></ul>Work Location: In person <div id='job-id'>Job Id: VYisiEL59HBkdn6PTNYC+XQzKVanFeO+FlZeEwI3HvenMWtoWtaerkVM1EW31O1/kr4XOs8cpA119IJNJira6HL3P3Q2K+cK+J0+gBpHuLE1HpiT</div>

Carter Logistics, LLC

<div><div>Carter Express/Carter Logistics</div><div>
Job Description</div>
Data Engineer
Department: IT Job Status: Full-Time Reports to: Manager of Systems Engineering<div>
POSITION SUMMARY</div><div>
We are seeking a Data Engineer to support and optimize our data pipelines, integrations, and reporting infrastructure. This role will work across systems and teams to ensure reliable data exchange, including managing EDI workflows, scripting API connections, and building SQL-based solutions. Ideal candidates will have strong technical skills and a passion for clean, automated data movement.</div><div></div> 
ESSENTIAL DUTIES and RESPONSIBILITIES:<ul><li>
Design, build, and maintain data pipelines that connect internal systems, EDI vendors, and external APIs</li><li>
Develop and optimize SQL stored procedures, views, and reports to support business operations</li><li>
Write PowerShell and/or Python scripts to extract and send data via REST APIs</li><li>
Manage and troubleshoot EDI transactions with external partners</li><li>
Ensure data quality, integrity, and security throughout all integration workflows</li><li>
Maintain documentation of data processes, mappings, and automation logic</li><li>
Collaborate with business and IT teams to deliver data solutions that align with operational needs</li></ul><div>
EDUCATION:</div>
High School Diploma or GED required. 2+ years working with some of the technologies<div>
EXPERIENCE:</div><ul><li>
1+ years of experience in data engineering, systems integration, or similar roles</li><li>
Advanced proficiency in SQL (preferably T-SQL) and relational database development</li><li>
Experience with PowerShell and/or Python scripting for automation and integration</li><li>
Familiarity with REST APIs and common authentication standards (OAuth, API tokens, etc.)</li><li>
Strong troubleshooting and problem-solving skills</li></ul><div> 
SUPERVISORY RESPONSIBILITIES:</div>
None
OTHER REQUIREMENTS:<ul><li>
Background in logistics, supply chain, or manufacturing environments</li><li>
Experience working with cloud platforms (Azure) and on-prem environments</li><li>
Experience working with PowerShell Universal</li></ul><div><ul><li>
Exposure to EDI formats (e.g., X12, EDIFACT) and working with EDI vendors</li></ul></div><div></div><div> 
 WORK ENVIRONMENT:</div><div>
This position is remote with the option to work on-site if you choose. Exceptions are one week on-site each quarter for team building and any potential meetings that would require in person interaction.</div><div></div><div> 
At Carter Express, INC/Carter Logistics LLC, we provide a fair and equal employment opportunity for all Team Members and candidates regardless of race, color, religion, national origin, gender, pregnancy, sexual orientation, gender identity/expression, age, marital status, disability, or any other legally protected characteristic. Carter Express, INC/Carter Logistics LLC hires and promotes individuals solely based on qualifications for the position to be filled and business needs.</div></div><div></div> <div id='job-id'>Job Id: bWZrsFbLPov2E2+7wuLzw6XH7wuTb/EcKqucamE25VIEtxu/rxwWmPMMx9LRcwvAUYwbHZt39lW3HiXw7Kvo2RTDyQUSMoM9mDdZSHmdxDWQzM/adBhjtDhOckNPWfd7KRjGw72cTN0XVPFQ7FqIf/qGGW16Q7LR7YbRQYo9B4MARgzPQUbjSMhZS3hbADs1lRUot57Ht3HkoISioA1Q0LGWVBsX44YiiJdQee0u+eoa9J3CMjDDPFgJrn7WsTRdCTdZnHzUJng=</div>

Paladin Drones

<div>Location: Houston, TX (Hybrid) 
Department: Engineering 
About Paladin Drones: 
Paladin is revolutionizing public safety with autonomous drone technology. Our mission? To be on the frontline of emergencies within 90 seconds. When someone dials 911, our drones take flight, providing first responders with a real-time overhead view of the situation, amplifying their situational awareness and hastening response times. Leveraging LTE for unlimited range and control, our drones currently answer the call of duty over 1000 times weekly across multiple cities and states.
Our vision is ambitious: within the next decade, our technology will be an essential tool for first responders in every city worldwide. As a tight-knit, passionate, and forward-thinking team, we are committed to pushing the boundaries of UAV tech and making a monumental difference in a rapidly advancing domain.
Position Overview: 
As a Data Engineer at Paladin Drones, you'll play a crucial role in designing, building, and optimizing robust data pipelines that power our drone platform and analytics systems. You will leverage AWS Glue, PostgreSQL, and advanced cloud technologies to turn complex data from drone logs, telemetry, and other IoT sources into actionable insights.<h3 class="jobSectionHeader">
Responsibilities:</h3><ul><li>
Data Pipeline Development: Design, build, and maintain scalable ETL pipelines using AWS Glue, PostgreSQL, and AWS S3 for structured and semi-structured data, especially drone telemetry logs.</li><li>
Data Integration: Extract, integrate, and transform data from various sources, including drone logs, APIs, and third-party systems.</li><li>
Advanced Data Modeling: Develop and maintain comprehensive data models, schema designs, and geospatial databases using PostgreSQL and PostGIS.</li><li>
ETL Optimization: Continuously optimize Glue ETL processes, classifiers, and Grok patterns for performance and reliability.</li><li>
Data Quality Management: Implement automated checks and monitoring to ensure data accuracy, consistency, and integrity across all systems.</li><li>
Collaboration and Support: Partner closely with data science, DevOps, and product teams to align data solutions with business needs and innovation.</li><li>
Performance Tuning: Optimize databases, queries, and Glue jobs to handle large-scale, high-frequency IoT datasets.</li><li>
Documentation: Maintain detailed documentation for pipelines, processes, data dictionaries, and architecture diagrams.</li><li>
Security and Compliance: Implement best practices to ensure data security and privacy compliance (SOC2, GDPR, NIST standards).</li></ul><h3 class="jobSectionHeader"> 
Qualifications:</h3>
Required:<ul><li>
3+ years of experience in data engineering, with a strong focus on ETL development.</li><li>
Proven hands-on experience with AWS Glue for ETL and data workflows.</li><li>
Expertise in PostgreSQL, including database design, optimization, query performance tuning, and familiarity with PostGIS.</li><li>
Strong Python scripting skills for data processing, automation, and Glue scripts.</li><li>
Experience with AWS ecosystem (S3, Lambda, CloudWatch, IAM).</li><li>
Familiarity with Infrastructure as Code (IaC) practices, especially Terraform.</li><li>
Version control and CI/CD experience (GitHub).</li></ul> 
Preferred:<ul><li>
Experience with real-time IoT data processing, telemetry logs, and geospatial datasets.</li><li>
Familiarity with Google Cloud Platform (GCP) or other cloud providers.</li><li>
Data visualization experience (Tableau, Power BI, QuickSight).</li></ul><h3 class="jobSectionHeader"> 
What We Offer:</h3><ul><li>
Competitive salary and equity packages</li><li>
Health, dental, and vision insurance</li><li>
Unlimited PTO and paid holidays</li><li>
Opportunity to grow with a mission-driven, innovative company</li><li>
A collaborative and fast-paced work environment</li></ul> 
Join Paladin Drones and contribute to the future of autonomous emergency response technology. Apply today to be part of an innovative team making a real-world impact!
Paladin Drones is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
ehTY5mCiO7</div> <div id='job-id'>Job Id: 3YhhKjfcaW5yps13e0cv3kry759pIGXwk9I0HZf4dodXPaBU+uuU0iz0BgvX8CZDXVNL5iemITNBA9sAlN8zs/qyglSJrgNjFVUN4upVnRWLT+37qpr2tkz6jTmqHlbxFcuhCV2VJIiERuupQw==</div>

ECF Data

<div>We Are: 
 
 
At Data Society, we provide bespoke, leading-edge data and AI solutions for Fortune 1,000 companies and federal, state, and local governmental organizations. We partner with our clients to educate, equip, and empower their workforces with the skills they need to achieve their goals and expand their impact. We are empowering the workforces of the future, from data literacy for all employees to support for data engineers and data scientists to train up on the most complex AI solutions and Machine Learning skills. 
 
 
Job Summary: 
 
 
The Data Engineer is responsible for building scalable, performant data pipelines that power critical operational and analytical applications. The engineer must be able to work closely with our data science teams to run ML/AI models on top of enterprise-scale data and build the supporting data scaffolding to orchestrate, test, and monitor data systems. This is a customer-facing role within a cross-functional team so the ability to manage timelines, work both autonomously and collaboratively, and communicate effectively are a must. As this position will help to support federal contracts with security requirements, you must be a US Citizen to qualify. 
 
 
Responsibilities: 
 
<ul><li>Ability to build a full data pipeline from data ingestion to processing/transformation to load to visualization and analysis.</li>
<li>Design and manage large-scale data warehouses, lakehouses, and/or data marts</li>
<li>Build and optimize data transformation pipelines using tools like dbt to support data flow from ingestion through analytics</li>
<li>Champion data governance principles and quality standards, ensuring data lineage, documentation, and metadata are maintained</li>
<li>Create efficient, performant SQL-based data queries and Python-based data processing jobs</li>
<li>Demonstrate ability to balance computational load, performance, and cost</li>
</ul>
 
Skills you bring: 
 
<ul><li>Advanced Degree in Statistics, Applied Mathematics, Data Science, Computer Science, Operations Research or other closely related other quantitative or mathematical disciplines.</li>
<li>5+ years of data and analytics engineering in cloud environments</li>
<li>Expertise in SQL, Python, and schema design with experience in data cataloging and governance tools</li>
<li>Experienced with data transformation and ETL best practices</li>
<li>Experienced with data orchestration tools like Airflow, transformation frameworks like dbt, and cloud deployment tools like Terraform.</li>
<li>Demonstrated exceptional oral and written communication skills.</li>
<li>The ability to work independently and in a team environment.</li>
<li>The ability to work effectively across functions, levels and disciplines.</li>
<li>Strong problem solving and critical thinking skills.</li>
<li>Superior team-working skills, and a desire to learn, contribute, and explore.</li>
<li>Experience with Snowflake, Databricks, Kafka, Flume, Spark, or Flink is a plus</li>
</ul>
 
Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice. 
 
 
This position will be remote though based out of the Washington, DC area with travel to client sites in DC if needed. 
Flexible work from home options available.</div> <div id='job-id'>Job Id: 0bwLBT5QKBOq7hjre3ArL/2Z5bCk/ok1p1gEtEf2yeQd2JccUjWQ6698I67WorE9aENrZmMsKXDHtw9n6QjeiPCPju/mbfGoiw==</div>

Search 8989+ Data engineer jobs near you this August. New roles added regularly across leading industries. Apply today.

8989 data engineer jobs NEAR_ME

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer