Role description
Aws Datahub Architect
Torrance CA Onsite
Key Responsibilities:
- Data Architecture Design:
- Architect and implement a scalable data hub solution on AWS using best practices for data ingestion, transformation, storage, and access control.
- Define data models, data lineage, and data quality standards for the DataHub.
- Select appropriate AWS services (S3, Glue, Redshift, Athena, Lambda) based on data volume, access patterns, and performance requirements.
- Come up with a design that accommodates AI/ML applications in the next phase
- Data Ingestion and Integration:
- Design and build data pipelines to extract, transform, and load data from various sources (databases, APIs, flat files) into the DataHub using AWS Glue, AWS Batch, or custom ETL processes.
- Implement data cleansing and normalization techniques to ensure data quality.
- Manage data ingestion schedules and error handling mechanisms.
- Data Governance and Access Control:
- Establish data access controls and security policies to protect sensitive data within the DataHub using IAM roles and policies.
- Develop data governance frameworks including data quality checks, data lineage tracking, and data retention policies.
- Data Analytics Enablement:
- Create data catalogs and metadata management systems to facilitate data discovery and understanding by business users and data analysts.
- Design and implement data views and dashboards using Power BI to enable data exploration and visualization.
- Create data warehouses and data marts to meet the needs of the business
- Monitoring and Optimization:
- Monitor data pipeline performance, data quality, and system health to identify and resolve issues proactively.
- Optimize data storage and processing costs by leveraging AWS cost optimization features.
- Develop the required governance, security, monitoring and guard rails to enable efficient data exchange between internal application and their external vendors, partners, and SaaS providers
- Develop intake process, SLAs, and usage rules for internal and external data set producers and consumers
Required Skills and Experience:
- AWS Expertise: Deep understanding of AWS data services including S3, Glue, Redshift, Athena, Lake Formation, Sep Functions, CloudWatch and EventBridge.
- Data Modeling: Proficiency in designing dimensional and snowflake data models for data warehousing and data lakes.
- Data Engineering Skills: Experience with ETL/ELT processes, data cleansing, data transformation, and data quality checks. Experience with Informatica IICS and ICDQ is a plus.
- Programming Languages: Proficiency in Python, SQL, and potentially PySpark for data processing and manipulation.
- Data Governance: Knowledge of data governance best practices including data classification, access control, and data lineage tracking.
Preferred Qualifications:
- Experience with data lakehouse architectures and the ability to leverage both structured and unstructured data.
- Familiarity with data visualization tools like Tableau or Power BI.
- Strong communication and collaboration skills to work with stakeholders across business and technical teams.
- AWS certifications related to data analytics and architecture.
Skills
Mandatory Skills : GCP Data Architecture,MDM Conceptual,Data Architecture,Data lakehouse Architecture,Dimensional Data Modeling
Other details
Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree (“LTIM”):
Benefits and Perks:
- Comprehensive Medical Plan Covering Medical, Dental, Vision
- Short Term and Long-Term Disability Coverage
- 401(k) Plan with Company match
- Life Insurance
- Vacation Time, Sick Leave, Paid Holidays
- Paid Paternity and Maternity Leave
The range displayed on each job posting reflects the minimum and maximum salary target for the position across all US locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.
Disclaimer: The compensation and benefits information provided herein is accurate as of the date of this posting.
LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.
Benefits
Compensation range: $110,000.00 to $150,000.00 per year
About LTIMindtree
LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700 clients, LTIMindtree brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world. Powered by 83,000+ talented and entrepreneurial professionals across more than 40 countries, LTIMindtree — a Larsen & Toubro Group company — solves the most complex business challenges and delivers transformation at scale. For more information, please visit
https://www.ltimindtree.com/.