data warehousing engineer

sonnen Egypt

<div>
 <strong>
  Standort
  <br/>
  <br/>
 </strong>
 Cairo, EG
 <br/>
 <br/>
 <strong>
  Stellen-ID
 </strong>
 : 5268
 <br/>
 <br/>
 Join the energy revolution with #teamsonnen!
 <br/>
 <br/>
 At sonnen, we&rsquo;re driven by a clear goal: creating a future powered by clean, affordable energy for everyone. That&rsquo;s why we make our customers independent &ndash; not only from fossil fuels, but also from rising electricity costs.
 <br/>
 <br/>
 The key to this independence is our intelligent, all-in-one energy system. It combines solar panels, battery storage, energy tariffs, and wallboxes &ndash; all developed and manufactured in Germany.
 <br/>
 <br/>
 As the first and only provider in Germany, we also connect thousands of home batteries into one shared network: the sonnenVPP, our industry-leading virtual power plant.
 <br/>
 <br/>
 In short: every day, we&rsquo;re working to shape the energy future. And we&rsquo;d be thrilled to have you join us!
 <br/>
 <br/>
 We are seeking for a Data Engineer who will empower sonnen&rsquo;s business with data-driven insights, services and products with the help of sonnen&rsquo;s AWS-based analytics platform and by provisioning data from various sources from within and outside the company.
 <br/>
 <br/>
 We&rsquo;re looking for someone who shares our values, who isn&rsquo;t afraid to challenge existing processes, and who would like to work on innovative solutions in a fast-moving environment. If this sounds like you, then don&rsquo;t hesitate to get in touch.
 <br/>
 <br/>
 <strong>
  What you will do to help drive the energy transition:
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   You develop and maintain data analysis processes with a variety of structured and unstructured data sources.
  </li>
  <li>
   You implement, test, and maintain infrastructural components of sonnen&rsquo;s analytics platform and deploy and maintain data models.
  </li>
  <li>
   You implement data quality checks and monitoring mechanisms to ensure accuracy, completeness, and consistency of data.
  </li>
  <li>
   You collaborate with the business SMEs and stakeholders to understand their data requirements and support their analysis and modeling needs.
  </li>
  <li>
   You adhere to stringent quality assurance and documentation standards using version control and code repositories (e.g., Gitlab).
  </li>
  <li>
   You stay up-to-date with emerging trends and technologies in data engineering, and assess their potential applications to our business needs.
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  What You Will Need On That Journey
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   You hold a bachelor&rsquo;s degree in Computer Science or a related technical field
  </li>
  <li>
   You have 3+ years of relevant employment experience (Data Scientist, Engineer or Architect)
  </li>
  <li>
   You have experience with data architecture and warehousing solutions (e.g. AWS Redshift, Databricks)
  </li>
  <li>
   You continue to enhance the existing platform, creating the technical foundation for scalable processes. Both data and result quality are important to you.
  </li>
  <li>
   You have good knowledge of Python, Pandas, SQL, NoSQL, RestAPI
  </li>
  <li>
   You are fluent in English. German is a plus.
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Stellensegment:
 </strong>
 Computer Science, Quality Assurance, SQL, Database, Technology
</div>


Data Engineer (m/w/d)

Quantiphi

<div>
 <p>
  <strong>
   About the Company
  </strong>
  :
 </p>
 <p>
  Quantiphi is an award-winning Data Science and Machine Learning Software and Services Company focused on helping organizations translate the big promise of Machine Learning technologies into quantifiable business impact. We were founded on the belief that machine learning and artificial intelligence are transformative technologies that will create the next quantum gain in customer experience and unit economics of businesses. We are one of the five global launch partners for Google in Machine Learning and one of the three global launch partners for the Google Cloud Contact Center AI solution. Our signature approach combines ground-breaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed. We believe in &ldquo;Solving What Matters.
 </p>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Role
  </strong>
  : Senior Data Engineer
 </p>
 <p>
  <strong>
   Experience Level
  </strong>
  : 8 to 15 Years
 </p>
 <p>
  <strong>
   Work location
  </strong>
  : Doha, Qatar
 </p>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Responsibilities
  </strong>
  :
 </p>
 <ul>
  <li>
   Bachelor&rsquo;s degree in Computer Science or similar field or equivalent work experience.
  </li>
  <li>
   6+ years of experience on Data Warehousing, Data Engineering or Data Integration projects.
  </li>
  <li>
   Expert with data warehousing concepts, strategies, and tools.
  </li>
  <li>
   Strong SQL background.
  </li>
  <li>
   Strong knowledge of relational databases like SQL Server, PostgreSQL, MySQL.
  </li>
  <li>
   Strong experience in GCP &amp; Google BigQuery, Cloud SQL, Composer (Airflow), Dataflow, Dataproc, Cloud Function and GCS.
  </li>
  <li>
   Good to have knowledge on SQL Server Reporting Services (SSRS), and SQL Server Integration Services (SSIS).
  </li>
  <li>
   Knowledge of AWS and Azure Cloud is a plus.
  </li>
  <li>
   Experience in Informatica Power exchange for Mainframe, Salesforce, and other new-age data sources.
  </li>
  <li>
   Experience in integration using APIs, XML, JSONs etc.
  </li>
  <li>
   In-depth understanding of database management systems, online analytical processing (OLAP) and ETL (Extract, transform, load) framework, data-warehousing and Data Lakes
  </li>
  <li>
   Good understanding of SDLC, Agile and Scrum processes.
  </li>
  <li>
   Strong problem-solving, multi-tasking, and organizational skills.
  </li>
  <li>
   Highly proficient in working with large volumes of business data and strong understanding of database design and implementation.
  </li>
  <li>
   Good written and verbal communication skills.
  </li>
  <li>
   Demonstrated experience of leading a team spread across multiple locations.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Role &amp; Responsibilities:
  </strong>
 </p>
 <ul>
  <li>
   Work with business users and other stakeholders to understand business processes.
  </li>
  <li>
   Ability to design and implement Dimensional and Fact tables
  </li>
  <li>
   Identify and implement data transformation/cleansing requirements
  </li>
  <li>
   Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform and load data from various systems to the Enterprise Data Warehouse
  </li>
  <li>
   Develop conceptual, logical, and physical data models with associated metadata including data lineage and technical data definitions
  </li>
  <li>
   Design, develop and maintain ETL workflows and mappings using the appropriate data load technique
  </li>
  <li>
   Provide research, high-level design, and estimates for data transformation and data integration from source applications to end-user BI solutions.
  </li>
  <li>
   Provide production support of ETL processes to ensure timely completion and availability of data in the data warehouse for reporting use.
  </li>
  <li>
   Analyze and resolve problems and provide technical assistance as necessary. Partner with the BI team to evaluate, design, develop BI reports and dashboards according to functional specifications while maintaining data integrity and data quality.
  </li>
  <li>
   Work collaboratively with key stakeholders to translate business information needs into well-defined data requirements to implement the BI solutions.
  </li>
  <li>
   Leverage transactional information, data from ERP, CRM, HRIS applications to model, extract and transform into reporting &amp; analytics.
  </li>
  <li>
   Define and document the use of BI through user experience/use cases, prototypes, test, and deploy BI solutions.
  </li>
  <li>
   Develop and support data governance processes, analyze data to identify and articulate trends, patterns, outliers, quality issues, and continuously validate reports, dashboards and suggest improvements.
  </li>
  <li>
   Train business end-users, IT analysts, and developers
  </li>
 </ul>
</div>


Senior Data Engineer- GCP

Capco

<p></p><div><p><b>About Us</b></p>
<p><b>
&ldquo;Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar &amp; Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery.</b></p>
<p><b>
WHY JOIN CAPCO?</b></p>
<p><b>
You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.</b></p>
<p><b>
MAKE AN IMPACT</b></p>
<p><b>
Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.</b></p>
<p><b>
#BEYOURSELFATWORK</b></p>
<p><b>
Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.</b></p><br>
<p></p>
<p><b>
CAREER ADVANCEMENT</b></p>
<p><b>
With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.</b></p>
<p><b>
DIVERSITY &amp; INCLUSION</b></p>
<p><b>
We believe that diversity of people and perspective gives us a competitive advantage.</b></p>
<p><b>
MAKE AN IMPACT</b></p><p></p><p><br>
In this role, you will:</p><br>
<p></p>
<ul><li>Technical leadership for a team of engineers that focus on development, deployment and operations</li></ul>
<ul><li>Lead and contribute to multiple pods with moderate resource requirements, risk, and/or complexity</li></ul>
<ul><li>Interface technically with a range of stakeholders with customer and business impact</li></ul>
<ul><li>Leading others to solve complex problems</li></ul>
<ul><li>Experience in working within an agile, multidisciplinary DevOps team</li></ul>
<ul><li>Migrate and re-engineer existing services from on-premises data centers to Cloud (GCP/AWS)</li></ul>
<ul><li>ETL Engineer is responsible for performing system development work with background of various data models and data warehousing concepts.</li></ul>
<ul><li>Write, analyse, review, and rewrite programs to departmental and Group standards</li></ul>
<ul><li>Understanding the business requirements and provide the real-time solutions</li></ul>
<ul><li>Following the project development tools like JIRA, Confluence and GIT</li></ul>
<ul><li>Build and maintain operations tools for monitoring, notifications, trending, and analysis.</li></ul>
<ul><li>Enhance programs to increase operating efficiency or adapt to new requirements</li></ul>
<ul><li>Review code from team members Analyst/Developers as part of the quality assurance process</li></ul>
<ul><li>Produce unit test plans with detailed expected results to fully exercise the code.</li></ul>
<ul><li>Work closely with solution architect, business Analyst and technology lead to contribute in achieving final outcome.</li></ul>
<ul><li>Demonstrate upward graph in adaption of various Engineering Practices.</li></ul><br>
<p></p>
<p>
To be successful in this role, you should meet the following requirements:</p><br>
<p></p>
<ul><li>Mandatory Skills: -</li></ul>
<p>
o Senior Data Engineer with Cloud (GCP) (Experience - 8 to 12 Years)</p>
<p>
o Mandatory Google Cloud Big Query Scripting Skills or Cloud SQL hands-on experience</p>
<p>
o Mandatory SQL PL/SQL Scripting Experience [High level expertise and hands-on work]</p>
<p>
o Mandatory shell scripting Or Python Skills [High level expertise and hands-on work]</p>
<p>
o Should have experience on any of the RDBMS</p>
<p>
o Should have leadership experience.</p><br>
<p></p>
<ul><li>Good To Have: -</li></ul>
<p>
o GCP Data Engineer certifications is an added advantage.</p>
<p>
o Experience/knowledge on GCP components like GCS, Big Query, Airflow, Cloud SQL and Google Cloud SDK</p>
<p>
o Good to have knowledge - Preferable Control M or ETL Tool or Any from - UC4 Atomic, Airflow Composer</p>
<p>
o Prefer to have Juniper Ingestion process awareness</p>
<p>
o Experience in working within an agile, multidisciplinary &lsquo;Dev-Ops&rsquo; team.</p>
<p>
o Changes, Incident and Problem Management</p></div><p></p>

GCP Data Engineer

DICETEK LLC

<div><p>As a Data Integration &amp; Architecture Specialist, you will be a pivotal member of our data engineering and architecture team. You will play a crucial role in designing, implementing, and optimizing data integration solutions using data warehouse technologies. This position demands a strong understanding of Azure and Data warehouse solutions, data architecture principles, and the ability to design and administer robust data ecosystems.
</p><p><b>Primary skills:
</b></p><ul><li>Azure, Delta Lake, Data Factory, DataBricks, Python/PySpark
</li><li>SAS DWH<br>
</li></ul><p></p><br>
<ul><li>Bachelor's or master&rsquo;s degree in computer science, Information Technology, or a related field.
</li><li>Should have at least 4 years of experience in data engineering.
</li><li>Should possess at least 3 years of UAE banking experience.
</li><li>Candidates with Azure data products and data warehouse experience will be preferred
</li><li>Strong understanding of data warehousing concepts, ETL processes, and data governance.
</li><li>Knowledge of SQL for data manipulation and querying.
</li><li>Excellent problem-solving and troubleshooting skills.
</li><li>Strong communication and collaboration skills.
</li></ul><p><b>Certifications (Preferred):
</b></p><ul><li>Certified Data Integration Developer
</li><li>Azure Data Engineering Associate</li></ul></div><p></p>

Azure Data (warehouse) Engineer

metropolis

<div><h3 class="jobSectionHeader"><b>Who we are</b></h3>
<p>
Metropolis is an artificial intelligence company that uses computer vision technology to enable frictionless, checkout-free experiences in the real world. Today, we are reimagining parking to enable millions of consumers to just &quot;drive in and drive out.&quot; We envision a future where people transact in the real world with a speed, ease and convenience that is unparalleled, even online. Tomorrow, we will power checkout-free experiences anywhere you go to make the everyday experiences of living, working and playing remarkable - giving us back our most valuable asset, time.</p>
<h3 class="jobSectionHeader"><b>
Who you are</b></h3>
<p>
As a Senior Data Engineer at Metropolis, you will play a key role in shaping both customer-facing and business-facing data products that align with our mission. Your technical expertise and analytical acumen will contribute to designing and building extensive data sets that impact thousands of internal users and millions of members. Join a world-class data engineering team dedicated to advancing your skills and career in data engineering and beyond.</p>
<h3 class="jobSectionHeader"><b>
What you'll do</b></h3>
<ul><li>Collaborate with engineers, product managers, and data scientists to understand data needs, and develop end-to-end data pipelines, solutions, and foundational data sets</li>
<li>Design and own the data architecture for large-scale projects, making informed decisions about design and operational trade-offs</li>
<li>Build, launch, and optimize sophisticated data pipelines, data models, and visualizations that support diverse use cases across multiple products or domains</li>
<li>Define and manage Service Level Agreements (SLAs) for all data sets within areas of ownership</li>
<li>Implement data security models based on privacy requirements, ensure compliance with safeguards, address data quality issues, and evolve data governance processes</li>
<li>Solve complex data integration challenges using optimal ETL/ELT patterns, frameworks, and query techniques for both structured and unstructured data sources</li>
<li>Maintain and enhance existing production processes by optimizing complex code using advanced algorithmic concepts</li>
<li>Optimize pipelines, dashboards, frameworks, and systems to streamline data artifact development</li>
<li>Mentor team members, providing and receiving actionable feedback to foster skill growth and collaboration</li>
<li>Ensure flexibility with availability during evening hours</li>
</ul><h3 class="jobSectionHeader"><b>What we're looking for</b></h3>
<ul><li>Bachelor's degree in computer science, Computer Engineering, or a relevant technical field; a master's degree is preferred</li>
<li>5+ years of experience in data engineering, database engineering, business intelligence, data warehousing, and ETL tools, working with large data sets in the cloud</li>
<li>Proficiency in SQL, ETL/ELT, and data modeling, with extensive experience in Snowflake and dbt as a plus</li>
<li>5+ years of experience with Python, and experience building scalable Big Data solutions and ETL ecosystems</li>
<li>Hands-on experience with RDBMS such as MySQL, MS SQL Server, and Postgres</li>
<li>Familiarity with integration tools like Airflow and Automic, along with a working knowledge of CI/CD pipelines</li>
<li>Ability to deliver high standards of code quality, system reliability, and performance</li>
<li>Experience with Spark and PySpark to handle large-scale data processing and enhance data pipeline efficiency</li>
</ul><h3 class="jobSectionHeader"><b>Our Stack</b></h3>
<ul><li>Languages + Frameworks: TypeScript, React, Scala (principally), Java (limited)</li>
<li>Datastores: MySQL, PostgreSQL, Snowflake</li>
<li>Cloud: AWS</li>
<li>Version control: Git &amp; GitHub</li>
<li>AI Tooling: Copilot on GitHub</li>
<li>Observability: Datadog</li>
</ul>
<p></p><p><i>When you join Metropolis, you'll join a team of world-class product leaders and engineers, building an ecosystem of technologies at the intersection of parking, mobility, and real estate. Our goal is to build an inclusive culture where everyone has a voice and the best idea wins. You will play a key role in building and maintaining this culture as our organization grows. </i><i>#LI-SR1 #LI-Onsite</i></p><div><p><i>
Metropolis values in-person collaboration to drive innovation, strengthen culture, and enhance the Member experience. Our corporate team members hold to our office-first model, which requires employees to be on-site at least four days a week, fostering organic interactions that spark creativity and connection</i></p>
<p><i>
Metropolis may utilize an automated employment decision tool (AEDT) to assess or evaluate your candidacy for employment or promotion. AEDTs are used to assist in assessing a candidate's application relative to the required job qualifications and responsibilities listed in the job posting.</i></p>
<p><i>
As part of this process, Metropolis retains data relevant to your candidacy, including personal information, for a period that is reasonably necessary for the use of the tool. If you are hired for the position, your data may become part of your employee records.</i></p>
<p><i>
Metropolis Technologies is an equal opportunity employer. We make all hiring decisions based on merit, qualifications, and business needs, without regard to race, color, religion, sex (including gender identity, sexual orientation, or pregnancy), national origin, disability, veteran status, or any other protected characteristic under federal, state, or local law.</i></p></div></div>

Senior Data Engineer

Tata Consultancy Services (TCS)

<div></div><div><div><div><div><div>Role- Databricks Data Engineer
</div><div>Experience-5-8 years
</div><div>Location- PAN India</div><br>
<div><br>
</div><div>Skill required-cloud platform Azure/AWS/GCP and Databricks, SQL, DevOps, agile methodology, GIT, JIRA
</div></div></div></div><div><div><div><b>Location</b></div>
<div>Hyderabad</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Developer</div>
</div><div><div><b>Job Id</b></div>
<div>378786</div>
</div><div><div><b>Desired Skills</b></div>
<div>Digital : Databricks | AWS | Cloud Azure</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF ENGINEERING</div></div></div><div></div>

Databricks Data Engineer

Search 10000+ Data warehousing engineer jobs near you this November. New roles added regularly across leading industries. Apply today.

10000 data warehousing engineer jobs NEAR_ME

Data Engineer (m/w/d)

Senior Data Engineer- GCP

GCP Data Engineer

Azure Data (warehouse) Engineer

Azure Data (warehouse) Engineer

Senior Data Engineer

Databricks Data Engineer