senior etl developer

Optum

<div><p>Optum Insight is improving the flow of health data and information to create a more connected system. We remove friction and drive alignment between care providers and payers, and ultimately consumers. Our deep expertise in the industry and innovative technology empower us to help organizations reduce costs while improving risk management, quality and revenue growth. Ready to help us deliver results that improve lives? Join us to start <b>Caring. Connecting. Growing together.</b></p><p></p><p><br>
We are seeking a skilled and motivated Senior ETL / Data Integration Developer to join our team. This role is responsible for designing, developing, and delivering scalable ETL frameworks and components within a multi terabyte Oracle Exadata environment that integrates encounter and enrollment data from New York State (NYS) healthcare plans.</p><p></p><p><br>
In this role, you will synthesize and integrate large, complex datasets to support the management, evaluation, and analysis of the NYS healthcare system, including the New York All Payer Database (APD). This is a hands on technical role requiring deep expertise in data integration, transformation, data quality, and performance optimization using enterprise ETL and data integration platforms. Exposure to modern or cloud based data platforms is desirable.</p><p></p><p><br>
You'll enjoy the flexibility to work remotely * from anywhere within the U.S. as you take on some tough challenges. For all hires in the Minneapolis or Washington, D.C. area, you will be required to work in the office a minimum of four days per week.</p><p></p><p><b><br>
Primary Responsibilities:</b></p><ul><li>
Design, develop, and maintain ETL workflows, pipelines, and mappings to load healthcare data into NY APD reporting structures</li><li>
Apply ETL development best practices, including parameterization, reusable components, modular design, and avoidance of hard coded logic</li><li>
Build reusable frameworks and automation to reduce manual operational activities and improve reliability</li><li>
Perform optimization, troubleshooting, and debugging of ETL processes across development, test, and production environments</li><li>
Develop and execute unit, system, and integration testing for ETL pipelines</li><li>
Tune and optimize ETL jobs for performance, scalability, and throughput; collaborate with data modelers and DBAs on architecture and data model optimization</li><li>
Provide development support and conduct code reviews and walkthroughs to ensure adherence to standards and best practices</li><li>
Enforce secure coding principles and data protection standards in accordance with State of New York policies</li><li>
Document and maintain technical designs, ETL specifications, and operational procedures</li><li>
Troubleshoot pre production and production ETL job failures and data quality issues</li><li>
Perform data profiling, validation, reconciliation, and balancing checks to ensure data accuracy and completeness</li><li>
Design and implement data quality checks and controls across ingestion, transformation, and load phases</li></ul><p></p><p><br>
You'll be rewarded and recognized for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed in your role as well as provide development for other roles you may be interested in.</p><p><b><br>
Required Qualifications:</b></p><ul><li>
5+ years of hands on experience designing, developing, and supporting ETL / data integration solutions using any enterprise grade ETL or data integration tool (on prem, hybrid, or cloud)</li><li>
5+ years of experience with Oracle databases and PL/SQL, including solid SQL development and performance tuning skills</li><li>
2+ years of experience with scripting or programming languages (eg, Python, Shell, or similar)</li><li>
2+ years of experience in data analysis, validation, and reconciliation</li><li>
2+ years of healthcare data experience, including Medicaid, Medicare, Exchange, or commercial payer data</li><li>
Experience with data modeling techniques for data warehouse and analytical environments</li><li>
Proven experience supporting large scale, high volume data processing environments</li><li>
Solid understanding of data warehouse architecture, database design principles, and ETL patterns</li><li>
Proven excellent problem solving skills, attention to detail, and ability to work independently and collaboratively</li><li>
Proven solid communication and documentation skills</li></ul><p></p><p><b><br>
Preferred Qualifications:</b></p><ul><li>
Experience with Informatica ETL suite</li><li>
Experience or familiarity with modern or cloud based data platforms and ETL technologies (eg, Snowflake, Databricks, Azure, AWS, or similar)</li><li>
Experience working with EDI healthcare transactions, including 834, 837, and NCPDP</li><li>
Advanced experience working in large Oracle Exadata or high performance database environments</li><li>
Experience implementing data quality frameworks, auditability, and reconciliation controls in regulated data environments</li><li>
Experience using AI/LLM models to support data engineering (eg, accelerating SQL/ETL development, automating documentation, enabling data quality anomaly detection, or generating data pipeline templates) in a secure and compliant manner</li><li>
Exposure to modern data engineering patterns, such as ELT, scalable batch processing, or hybrid architectures</li><li>
Knowledge of HIPAA and healthcare regulatory security requirements</li></ul><p></p><ul><li><br>
All employees working remotely will be required to adhere to UnitedHealth Group's Telecommuter Policy</li></ul><p></p><p><br>
Pay is based on several factors including but not limited to local labor markets, education, work experience, certifications, etc. In addition to your salary, we offer benefits such as, a comprehensive benefits package, incentive and recognition programs, equity stock purchase and 401k contribution (all benefits are subject to eligibility requirements). No matter where or when you begin a career with us, you'll find a far-reaching choice of benefits and incentives. The salary for this role will range from $91,700 to $163,700 annually based on full-time employment. We comply with all minimum wage laws as applicable.</p><p></p><p><b><br>
Application Deadline: </b>This will be posted for a minimum of 2 business days or until a sufficient candidate pool has been collected. Job posting may come down early due to volume of applicants.</p><p></p><p><i><br>
At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.</i></p><p></p><p><i><br>
UnitedHealth Group is an Equal Employment Opportunity employer under applicable law and qualified applicants will receive consideration for employment without regard to race, national origin, religion, age, color, sex, sexual orientation, gender identity, disability, or protected veteran status, or any other characteristic protected by local, state, or federal laws, rules, or regulations.</i></p><p></p><p><i><br>
UnitedHealth Group is a drug - free workplace. Candidates are required to pass a drug test before beginning employment.</i></p></div>

Senior Data Engineer - Remote

Matrix Systems & Technologies

<div><div><div><b>Benefits:</b></div>
<ul><li>Health insurance</li>
<li>Paid time off</li>
<li>Training &amp; development</li>
</ul></div><div><div>The scope of the proposed services will include the following:<br>
<ul><li>Design, develop, and maintain ETL processes and systems.</li><li>Create and implement ETL strategies to meet LDWF and OTS requirements.</li><li>Collect, clean, and integrate data from various sources, including structured and unstructured data.</li><li>Develop and maintain data models and data mappings.</li><li>Ensure data quality and integrity by implementing data validation and error handling processes.</li><li>Collaborate with LDWF stakeholders and OTS technical teams to define and prioritize requirements.</li><li>Provide technical knowledge transfer, training, and documentation to OTS and LDWF Agency staff for all requested work.</li><li>Participate by providing feedback and detailed design and implementation approaches in all necessary team meetings and design sessions in accordance with Scrum ceremonies.</li><li>Cooperation with LDWF&rsquo;s Technical Architect and other OTS technical teams to ensure compliance with OTS standards of State applications.</li><li>Perform all other tasks, special projects, analysis, studies, and plans as directed.</li></ul><br>
Expertise and/or relevant experience in the following areas are mandatory:<br>
<ul><li>Two (2) plus years advanced SQL experience writing complex queries, joins, and stored procedures to identify anomalies and transform data types.</li><li>Four (4) plus years experience working on data migration or data integration projects with specific experience in building automated, repeatable workflows; performance tuning; data cleansing; API integration; audit logging and exception handling.</li></ul><br>
Expertise and/or relevant experience in the following areas are desirable:<br>
<ul><li>Completion of two or more full-scale data migration projects (legacy to cloud or legacy to modern ERP/CRM).</li><li>Experience with enterprise ETL tools such as Informatica, Talend, AWS Glue, Azure Data Factory, or SSIS.</li><li>Experience with scripting languages such as Python, PowerShell, Java.</li><li>Experience working on a development team.</li><li>Experience with client engagements on design, delivery, deployment and on-going maintenance.</li><li>Previous experience working in an Agile/Scrum environment.</li></ul></div>
</div>
<p>This is a remote position.</p></div>

ETL Developer

WorldStrides

<div><div><h2 class="jobSectionHeader"><b>Company Introduction</b></h2>
<p>
WorldStrides is the global leader in educational travel and experiential learning. The company was founded in 1967 to provide middle school travel programs to Washington, D.C. and has grown to provide a wide range of programs for more than half a million students annually to over 100 countries around the world. WorldStrides offers experiential learning programs in educational travel, performing arts, language immersion, career exploration, service-learning, study abroad, and sports. Each of these experiences helps students to see beyond the classroom and to see the world &ndash; and themselves &ndash; in new ways.</p></div><p><b>
Job Description:</b><br>
The ETL Engineer develops, deploys, and maintains data stores for access by business users including marketing campaign specialists and business data analysts. The ETL Engineer is responsible for supporting and maintaining the data warehouse environment including SQL databases, scheduled jobs, and Python-based ETL processes. The ETL Engineer will be responsible for creating and maintaining data pipelines to support reporting needs and will ensure the quality and integrity of reporting data. The role requires attention to detail and quality. Key customers for the ETL Engineer will include data scientists, analysts, and marketing campaign specialists working in the domains of marketing, operations, customer insights, and finance.</p>
<p><b>
Responsibilities:</b></p>
<ul>
<li>Manage the structuring and maintenance of data sets for production of reporting and analytics</li>
<li>Build and optimize data pipelines to facilitate the extraction of data from multiple sources and delivery to multiple applications and teams</li>
<li>Reduce waste and improve data flow. This involves continually striving to reduce wasted effort, identify gaps and correct them and improve data development and deployment processes.</li>
<li>Acquire and update data from internal and external data providers</li>
<li>Execute automated testing at every stage of a pipeline to increase productivity while reducing errors</li>
<li>Create queries that allow data to be extracted and to streamline the data retrieval process</li>
<li>Monitor processes to quickly identify and resolve or elevate issues, and identify areas for improvement</li>
<li>Use automation to streamline data processing, automate manual processes, such as data extraction and testing.</li>
<li>Adopt new solutions to produce data more efficiently and with fewer errors. This includes testing and adopting solutions and tools that adhere to the DataOps best practices.</li>
<li>Correspond with team members and customers to understand business concepts, data requirements, and prioritization of development tasks</li>
<li>Communicate, document, and collaborate with other data and BI team members to enhance the quality of data products.</li>
<li>Ensure data security standards are applied across the data pipelines.</li>
</ul>
<p><b>Qualifications:</b></p>
<ul>
<li>Experience in SQL, Excel, relational databases, database concepts, and database design.</li>
<li>2+ years' experience with Python</li>
<li>Strong interpersonal, oral and written communication and presentation skills</li>
<li>Ability to work on multiple projects simultaneously and to provide regular status updates proactively</li>
<li>3+ years' experience in BI development, data analysis, or data engineering</li>
<li>BS/BA degree (preferably in a technical or research field)</li></ul><br>
<p></p>
<h3 class="jobSectionHeader"><b>
Work Perks:</b></h3>
<ul><li>Fun &amp; driven environment.</li>
<li>Excellent medical, dental, and vision coverage, life, accidental death and dismemberment, accident, critical illness, and disability insurance, FSA healthcare, FSA dependent care, HAS with employer contribution, and generous 401k match.</li>
<li>10 paid floating corporate holidays, 1 paid volunteer day &amp; 25 PTO days to start &ndash; accrue up to 28 over 3 years, 4 mental health days, and 5 bereavement days.</li>
<li>Tuition reimbursement up to five thousand, two hundred fifty dollars annually or one thousand dollars towards professional certification annually.</li>
<li>Opportunities for paid and discounted travel.</li>
<li>Flexible work schedule providing on-site, remote, and virtual office opportunities.</li>
<li>Encouraged participation in our Employee Resource Groups and Diversity, Equity, &amp; Inclusion council.</li>
<li>Fitness Center and caf&eacute; onsite at select locations.</li>
<li>Employee Assistance Program (EAP)</li>
<li>Paid Parental, Caregiver, and Disability leave.</li>
<li>Team Member Discount Program.</li></ul><p></p><div><br>
<div>
<div><p><i>WorldStrides, a global organization, is committed to</i><i> educate and serve communities worldwide. Our commitment is fueled by the passion of our team members and partners to make experiential learning accessible, while also being socially, environmentally, and ethically responsible. Together, we accomplish this by investing in initiatives to promote inclusion, diversity, and sustainability.</i></p>
<p><i>
As an Equal Opportunity Employer, WorldStrides is committed to building a diverse workforce, supported by an environment that promotes inclusion and belonging. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.</i></p>
<p><i>
WorldStrides will only employ those who are legally authorized to work in the United States. This is not a position for which sponsorship will be provided. Individuals with temporary visas such as E, F-1, J-1, H-1, H-2, L, B, J or TN, or who need sponsorship for work authorization now or in the future, are not eligible for hire. Select seasonal roles may consider students on J-1 or F-1 visas.</i></p></div></div></div></div><p></p>

ETL Engineer

MA'ADEN

<div><p><b>Job Purpose
</b></p><p>The Principal Specialist, Engineering and ETL (OT) provides enterprise leadership for OT data engineering, enabling reliable ingestion, transformation, and availability of operational data for analytics, operations, and performance management. The role defines OT pipeline standards and assures that OT data is delivered with quality, lineage, security, and appropriate latency across sites.
</p><p>This position is responsible for defining scalable patterns for integrating historians and industrial systems into enterprise platforms, guiding teams through complex OT constraints, and ensuring operational data products are sustainable and governed.
 </p><p><b>Key Accountabilities
</b></p><div><ul><li>Define OT data engineering and ETL standards, patterns, and reference architectures covering batch, streaming, and near-real-time ingestion needs.
</li></ul><ul><li>Establish ingestion patterns for historians and OT source systems, including normalization, unit standardization, quality flags, and tag mapping processes.
</li></ul><ul><li>Design and assure robust pipeline reliability (idempotency, backfill, late-arriving data handling, reconciliation, alerting) appropriate for OT contexts.
</li></ul><ul><li>Ensure OT pipelines comply with security and segmentation requirements; partner with OT cyber and platform security teams for governance-by-design.
</li></ul><ul><li>Oversee and guide OT data transformation logic to produce curated OT data products aligned to enterprise models and governance requirements.
</li></ul><ul><li>Provide architectural oversight for site onboarding, handling variability across plants and ensuring consistent delivery standards across implementations.
</li></ul><ul><li>Review and assure vendor and internal deliverables; provide technical direction and quality gates for complex OT engineering initiatives.
</li></ul>Drive continuous improvement through performance tuning, cost optimization, observability, and operational resilience improvements for OT workloads.<br>
<ul><li>
</li></ul></div><p></p><p><b>Minimum Qualification, Experience and Competencies
</b></p><p><b>Minimum Qualification
</b></p><ul><li><p>Bachelor&rsquo;s degree in Computer Science/Engineering, Data Engineering, Industrial Engineering, or related field.
</p></li><li><p>Master&rsquo;s degree preferred; OT systems exposure is an advantage.<br>
</p></li></ul><p></p><p><b>Minimum Experience
</b></p><ul><li>10&ndash;15 years of experience in data engineering/ETL with demonstrated exposure to OT/industrial data environments.
</li><li>Experience designing ingestion from historians/OT systems and delivering analytics-ready OT datasets at enterprise scale.
</li></ul><p><b>Skills:
</b></p><ul><li>Strong OT data engineering expertise including ingestion from historians, handling time-series characteristics, and ensuring data quality.
</li><li>Ability to design scalable, secure OT-to-IT data pipelines with governance, lineage, and auditability.
</li><li>Advanced pipeline engineering practices (reliability, observability, orchestration, performance tuning).
</li><li>Stakeholder leadership across plant operations, OT engineering, IT, and analytics consumers.
</li><li>Vendor assurance and technical governance for complex multi-site delivery programs.</li></ul></div>

Principal Specialist, Engineering and ETL (OT)

WasteHero

<div>
 <p>
  <strong>
   Location:
  </strong>
  From Cairo
 </p>
 <p>
  <strong>
   Employment:
  </strong>
  Full-time
 </p>
 <p>
  <br/>
 </p>
 <p>
  🚀 About WasteHero
 </p>
 <p>
  At WasteHero, we&rsquo;re revolutionizing municipal waste management through cutting-edge software. Our
  <strong>
   cloud-native SaaS platform
  </strong>
  helps cities and private operators optimize routes, automate billing, ensure compliance, and build greener communities.
 </p>
 <p>
  We&rsquo;re already working with municipalities and waste companies across Europe &mdash; including one of the largest public-sector transformation projects all of Europe &mdash; and we&rsquo;re just getting started.
 </p>
 <p>
  <br/>
 </p>
 <p>
  WasteHero is a mission-driven scaleup with strong product-market fit, backed by institutional investors and public contracts. Our HQ is in Aarhus, Denmark, where product and engineering
 </p>
 <p>
  sit at the heart of the business.
 </p>
 <p>
  <br/>
 </p>
 <p>
  🎯 The Role: Senior Backend Developer
 </p>
 <p>
  We&rsquo;re looking for a
  <strong>
   senior backend engineer
  </strong>
  who will strengthen our distributed engineering team and help deliver mission-critical features in the coming 12&ndash;18 months.
 </p>
 <p>
  <br/>
 </p>
 <p>
  As Senior Backend Developer, you will:
 </p>
 <ul>
  <li>
   Build and maintain
   <strong>
    Python/Django + FastAPI services
   </strong>
   powering our SaaS ERP platform
  </li>
  <li>
   Design and implement scalable
   <strong>
    REST &amp; GraphQL APIs
   </strong>
   for integrations with municipal ERP systems
  </li>
  <li>
   Develop
   <strong>
    ETL pipelines and migration scripts
   </strong>
   (Python/SQL) to handle complex datasets from multiple sources
  </li>
  <li>
   Ensure system reliability, security, and GDPR/NIS2 compliance through robust logging, rollback, and error handling
  </li>
  <li>
   Collaborate daily with colleagues in Aarhus HQ and Finland, UK, Germany, working in an agile delivery setup
  </li>
  <li>
   Contribute to architectural decisions for performance, fault-tolerance, and long-term maintainability
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  🛠 Our Tech Stack
 </p>
 <ul>
  <li>
   <strong>
    Python 3, Django, FastAPI
   </strong>
  </li>
  <li>
   <strong>
    PostgreSQL, Redis, Celery
   </strong>
  </li>
  <li>
   <strong>
    GraphQL (Graphene), REST APIs
   </strong>
  </li>
  <li>
   <strong>
    Docker, gunicorn
   </strong>
  </li>
  <li>
   <strong>
    Bitbucket Pipelines (CI/CD)
   </strong>
  </li>
  <li>
   Hosted on
   <strong>
    Hetzner
   </strong>
   with private networking &amp; load balancing
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  ✅ You Bring
 </p>
 <ul>
  <li>
   5+ years of backend development experience (Python/Django preferred)
  </li>
  <li>
   Strong experience with relational databases (
   <strong>
    PostgreSQL/SQL
   </strong>
   )
  </li>
  <li>
   Track record of building
   <strong>
    production APIs
   </strong>
   and backend services at scale
  </li>
  <li>
   Experience with
   <strong>
    ETL, migrations, or integration-heavy environments
   </strong>
  </li>
  <li>
   Familiarity with Docker, CI/CD, and modern development pipelines
  </li>
  <li>
   Excellent English communication skills (Polish native a plus)
  </li>
  <li>
   Bonus: FastAPI, GraphQL, SaaS platform background, or public-sector software
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  🌟 Why Join WasteHero?
 </p>
 <ul>
  <li>
   <strong>
    High-impact role
   </strong>
   : Your work directly supports public-sector digitalisation across Europe
  </li>
  <li>
   <strong>
    Ownership
   </strong>
   : Work on complex, integration-heavy challenges with real autonomy
  </li>
  <li>
   <strong>
    Growth
   </strong>
   : Be part of a fast-scaling SaaS company with ARR-focused expansion in the Nordics
  </li>
  <li>
   <strong>
    Upside
   </strong>
   : Competitive salary + stock options
  </li>
  <li>
   <strong>
    Culture
   </strong>
   : International, mission-driven team with a focus on clarity, fairness, and execution
  </li>
  <li>
   <strong>
    Purpose
   </strong>
   : Real-world environmental impact at scale
  </li>
 </ul>
</div>


Senior Backend Developer (Python)

natural life

<div><div><b>SENIOR BI DEVELOPER</b></div>
<div></div><div><b>Job Summary:</b></div>
<div>The Senior Business Intelligence (BI) Developer creates and maintains data analytics and reporting solutions, transforming complex business requirements into clear, actionable dashboards and reports. This role partners with stakeholders to deliver impactful, data-driven insights while ensuring data accuracy and adherence to governance standards.</div>
<div></div><div><b>Duties and Responsibilities:</b></div>
<ul><li>Build and optimize Looker dashboards and reports based on business requirements.</li>
<li>Perform ad-hoc data analysis and validate data integrity post-ETL processes.</li>
<li>Manage BI metadata, documentation, and data governance standards.</li>
<li>Collaborate with business units to refine visualizations and enhance user adoption.</li>
<li>Design Looker Explores, Views, and Dashboards; write clean, reusable LookML (dimensions, measures, refinements, access filters).</li>
<li>Develop KPI definitions and shared metric layers used across teams (single source of truth).Monitor content performance; maintain dashboard load times and data freshness SLAs.</li>
<li>Apply role-based access, user attributes, and content validator to maintain a healthy BI ecosystem.</li>
<li>Facilitate requirements workshops; translate business needs into technical specifications and acceptance criteria.</li>
<li>Drive adoption through training, documentation, and weekly BI office hours; iterate based on feedback.</li>
</ul><div><i>The above citied duties and responsibilities describe the general nature and level of work performed by people assigned to the job. They are not intended to be an exhaustive list of all the duties and responsibilities that an incumbent may be expected or asked to perform.</i></div>
<div></div><div><b>Required Skills and Abilities:</b></div>
<ul><li>3&ndash;5 years of experience in BI development, with expertise in Looker or similar BI tools (Tableau, Power BI).</li>
<li>Advanced SQL skills for querying and analyzing large datasets.</li>
<li>Strong understanding of ETL processes and data validation techniques.</li>
<li>Familiarity with machine learning concepts and Generative AI technologies used in analytics workflows.</li>
<li>Understanding of how AI and ML can enhance BI reporting, including automated insights, forecasting, and natural language querying.</li>
<li>Proven ability to translate business needs into technical solutions.</li>
<li>Excellent communication skills for engaging with non-technical stakeholders.</li>
<li>Familiarity with data governance and metadata management best practices.</li>
</ul><div><b>Experience and Qualifications:</b></div>
<ul><li>Bachelor&rsquo;s degree in Computer Science, Data Science, or related field (preferred).</li>
<li>Experience working with eCommerce and marketing analytics data, including customer behavior, campaign performance, and digital channel attribution.</li>
<li>Experience working with Google Cloud AI/ML tools such as Vertex AI for data exploration, predictive modeling, or AI-assisted analytics.</li>
<li>Experience in industries with complex data environments (finance, healthcare, tech preferred).</li>
<li>Knowledge of cloud-based data platforms (e.g., Snowflake, BigQuery).</li>
</ul><div><b>Supervisory Responsibilities:</b></div>
<ul><li>This position does not have direct supervisory responsibilities.</li>
<li>Expected to operate independently on BI projects with moderate oversight.</li>
</ul><div><div><b>Why You&rsquo;ll Love It Here!</b></div>
<ul><li>Creative and inspiring workspace at our Jacksonville Beach office</li>
<li>A dedicated, purpose-driven team that lives the Natural Life mission</li>
<li>Casual, colorful environment with good vibes and dog-friendly energy</li>
<li>Competitive pay and a thoughtful benefits package designed to support your health, time off, and well-being</li>
<li>A generous employee discount on Natural Life products</li>
<li>A chance to grow with a fast-paced, female-founded brand with heart!</li></ul></div></div>

Senior BI Developer

Intellibee Inc

<p></p><div><div><div><p><b>Role summary: </b>Design, build, and operate reliable archiving and purging solutions on Microsoft SQL Server for datasets stored/represented in EBCDIC format, using SQL Server stored procedures and Python automation. Own batch execution and scheduling via Control‑M, ensuring performance, auditability, retention compliance, and safe deletion practices.</p><p><b>
Required Skills:
</b></p><ul><li>Build and maintain SQL Server stored procedures for data archiving, purge eligibility determination, and purge execution (soft/hard deletes as required).
</li>Handle EBCDIC data processing requirements (e.g., EBCDIC<li> ASCII/Unicode conversion, fixed-length records, packed decimals/COBOL-style encodings when applicable) and ensure data integrity post-conversion.
</li><li>Develop Python utilities for orchestration, validation, reconciliation, exception handling, and operational automation (e.g., pre/post checks, file-based extracts, run reports).
</li><li>Implement purge controls: retention rules, legal hold/exclusions, referential integrity management, dependency ordering, and rollback/restore strategy.
</li><li>Optimize performance for large volumes (partitioning strategies, indexing, batching, minimal logging approaches where appropriate, transaction scoping).
</li><li>Integrate and run jobs in Control‑M: job definitions, calendars, dependencies, resource limits, alerting, rerun/restart logic.
</li><li>Create operational runbooks, monitoring dashboards/metrics, and support production incidents (root cause, fixes, postmortems).
</li><li>Ensure security and compliance: least-privilege access, audit trails, PII handling, and evidence for retention/purge execution.
</li><li>Collaborate with DBAs, data governance, and application teams to validate retention policy interpretation and downstream impacts.
</li></ul><p><b>Required technical skills:</b></p><ul><li>
SQL Server: T‑SQL, stored procedures, transactions, error handling, temp tables, indexing, query tuning, SSMS, SQL Agent fundamentals (even if Control‑M is primary).</li><li>
EBCDIC: understanding of common code pages (e.g., 037/1047), conversion pitfalls, fixed-width layouts, and validation strategies.
</li><li>Python: building maintainable scripts/modules for ETL-style tasks, database connectivity (ODBC), logging, configuration, and testability.
</li><li>Batch scheduling: Control‑M job creation/execution, dependencies, alerts, reruns, and operational support.
</li><li>Data lifecycle: archiving patterns, retention, purge frameworks, auditability, and safe-delete patterns.
</li><li>Nice-to-have skills Experience with very large tables (VLDB), table partitioning/switching, and archival to cheaper storage tiers.
</li><li>Familiarity with mainframe-originated data models, COBOL copybooks, and packed numeric formats.
</li><li>CI/CD for database objects (DACPAC/SSD T or equivalent), Python packaging, and automated testing.
</li><li>Knowledge of data governance tools/processes and legal hold workflows.
</li><li>Experience in regulated environments (SOX, PCI, HIPAA, GDPR-like retention controls).</li></ul><p><b>
Benefits at IntelliBee</b></p><ul><li><b>
Long-Term Stability:</b> Join us on a multi-year opportunities with room to grow.</li><li><b>
Comprehensive Health Coverage:</b> Access quality healthcare benefits to keep you and your family well.</li><li><b>
Future Planning:</b> Enroll in our 401(k) program and invest in your financial security.</li><li><b>
GC Assistance:</b> We support immediate Green Card processing, if required.</li></ul></div></div></div>

ETL Data Engineer

Search 10000+ Senior etl developer jobs near you this April. New roles added regularly across leading industries. Apply today.