hadoop developer

Morgan Stanley

<div>In the Technology division, we leverage innovation to build the connections and capabilities that power our Firm, enabling our clients and colleagues to redefine markets and shape the future of our communities. This is a Data &amp; Analytics Engineering position at the Associate/Director level, which is part of the job family responsible for providing specialist data analysis and expertise that drive decision-making and business insights as well as crafting data pipelines, implementing data models, and optimizing data processes for improved data accuracy and accessibility, including applying machine learning and AI-based techniques.
Morgan Stanley is an industry leader in financial services, known for mobilizing capital to help governments, corporations, institutions, and individuals around the world achieve their financial goals.
Interested in joining a team that&rsquo;s eager to create, innovate and make an impact on the world? Read on.
Wealth Management and Investment Management Technology (WMIMT) is responsible for the design, development, delivery, and support of the technical platform behind the products and services used by the Business. Morgan Stanley Wealth Management (WM) is a product of the acquisition of Smith Barney from Citigroup, which was completed in June '13. Its core client base is individual investors, small- to medium-size businesses and institutions, and high net worth families and individuals.
 
 
Position Overview:
 
 
AIDT under Management Technology provides consistent, trusted, and integrated business information across all platforms and delivery channels within Morgan Stanley Wealth Management (MSWM) businesses. AIDT areas of expertise include but are not limited to Enterprise Data Warehouse (EDW) and Datalake (DL), cross-business-unit Information Management, Business Intelligence and more. AIDT team synthesizes and provisions a multitude of business-critical metrics and underlying detailed information in all Core areas of MSWM. Examples of essential data domains and metrics include Assets, Revenue, Account Demographics, Financial Advisor (FA) information, Securities and Cash Transactions, and so on.
 
 
As an integral part of AIDT, Data Integration &amp; Delivery team is tasked with providing insightful and accurate business intelligence on Account Performance metrics, Investment Insights, Trade Surveillance, Anti-Money Laundering and many other aspects of Wealth Management business.
The role is for a data engineer/ETL developer and requires active participation with leadership teams, business units and technology groups across the project lifecycle. Specific assignments will depend on the size and complexity of the project
What you'll do in the role:
<ul><li>As an ETL / Hadoop developer, the candidate will design and develop Informatica ETL and Hadoop applications.
</li><li>This is an individual contributor role.
</li><li>Undertaking end-to-end project delivery (from inception to post-implementation support), including review and finalization of business requirements, creation of
 
functional specifications and/or system designs, and ensuring that end-solution meets business needs and expectations.
</li><li>Development of new transformation processes to load data from source to target, or performance tuning of existing ETL code (mappings, sessions) and Hadoop Platform.
</li><li>Analysis of existing designs and interfaces and applying design modifications or enhancements
</li><li>Coding and documenting data processing scripts and stored procedures.
</li><li>Own the release of code into production using firm CICD tools and process
</li><li>Providing business insights and analysis findings for ad-hoc data requests
</li><li>Unit Testing software components and complete solutions (including debugging and troubleshooting) and preparing migration documentation.
</li><li>Providing reporting-line transparency through periodic updates on project or task status.
</li></ul>What you'll bring to the role:
<ul><li>6+ years of experience with the technical analysis and design, development, and implementation of data warehousing / Data Lake solutions.
</li><li>6+ years of Strong SQL programming and stored procedure development skills.
</li><li>6+ years of experience developing in Informatica data management in the cloud or Informatica Power Center and DataStage.
</li><li>4+ years in Python, Control M orchestration and Bit Bucket and Jenkins and CICD
</li><li>4+ years in Hive/Impala/Spark, Unix, Python,
</li><li>Python scripting
</li><li>4+ years relational database design in DB2, Snowflake and Teradata.
</li><li>4+ years in Strong UNIX Shell scripting experience to support data warehousing solutions.
</li><li>Some experience in AWS Glue and S3
</li><li>Process oriented, focused on standardization, streamlining, and implementation of best practices delivery approach.
</li><li>Excellent problem solving and analytical skills.
</li><li>Excellent verbal and written communication skills.
</li><li>Experience in optimizing large data loads.
</li><li>Should be a good collaborator
</li><li>Bachelor's/master's degree in engineering, preferably Computer Science/Engineering
</li></ul>Secondary Skills / Desired skills.
<ul><li>Exposure to an Agile Development environment would be a plus.
</li><li>Knowledge about TWS Scheduler would an added advantage.
</li><li>Strong understanding of Data warehousing domain.
</li><li>Ability to architect an ETL solution and data conversion strategy.
</li><li>Good understanding of dimensional modelling;
</li></ul>WHAT YOU CAN EXPECT FROM MORGAN STANLEY:
At Morgan Stanley, we raise, manage and allocate capital for our clients &ndash; helping them reach their goals. We do it in a way that&rsquo;s differentiated &ndash; and we&rsquo;ve done that for 90 years. Our values - putting clients first, doing the right thing, leading with exceptional ideas, committing to diversity and inclusion, and giving back - aren&rsquo;t just beliefs, they guide the decisions we make every day to do what's best for our clients, communities and more than 80,000 employees in 1,200 offices across 42 countries. At Morgan Stanley, you&rsquo;ll find an opportunity to work alongside the best and the brightest, in an environment where you are supported and empowered. Our teams are relentless collaborators and creative thinkers, fueled by their diverse backgrounds and experiences. We are proud to support our employees and their families at every point along their work-life journey, offering some of the most attractive and comprehensive employee benefits and perks in the industry. There&rsquo;s also ample opportunity to move about the business for those who show passion and grit in their work.
To learn more about our offices across the globe, please copy and paste https://www.morganstanley.com/about-us/global-offices into your browser.
Morgan Stanley's goal is to build and maintain a workforce that is diverse in experience and background but uniform in reflecting our standards of integrity and excellence. Consequently, our recruiting efforts reflect our desire to attract and retain the best and brightest from all talent pools. We want to be the first choice for prospective employees.
It is the policy of the Firm to ensure equal employment opportunity without discrimination or harassment on the basis of race, color, religion, creed, age, sex, sex stereotype, gender, gender identity or expression, transgender, sexual orientation, national origin, citizenship, disability, marital and civil partnership/union status, pregnancy, veteran or military service status, genetic information, or any other characteristic protected by law.
Morgan Stanley is an equal opportunity employer committed to diversifying its workforce (M/F/Disability/Vet).</div>

Data Warehouse Engineer / ETL Developer - Associate/Director

Muller's Solutions

<div>M&uuml;ller&rsquo;s Solutions is looking for an experienced Big Data Engineer to join our innovative team. In this role, you will be responsible for designing and developing scalable big data solutions that enable advanced analytics and insights across the organization. You will work with large data sets and utilize cutting-edge technologies to ensure data processing is efficient and reliable.
Key Responsibilities:<ul>
<li>Design, build, and maintain scalable data pipelines using big data technologies such as Apache Spark, Hadoop, and Kafka.</li>
<li>Collaborate with data scientists, analysts, and IT teams to identify data requirements and deliver solutions that meet business needs.</li>
<li>Ensure high data quality and integrity by implementing robust data validation and testing processes.</li>
<li>Optimize data storage solutions for performance and cost-efficiency across cloud and on-premises environments.</li>
<li>Monitor and troubleshoot data processing workflows to ensure timely data delivery.</li>
<li>Document data architectures, processes, and workflows for knowledge sharing and compliance.</li>
<li>Stay ahead of industry trends and best practices in big data technologies and methodologies.</li> 
</ul> 
 
Requirements 
Requirements:<ul>
<li>Bachelor's degree in Computer Science, Information Technology, or a related field.</li>
<li>3+ years of experience as a Big Data Engineer or in a similar data engineering role.</li>
<li>Proficiency in big data technologies such as Apache Spark, Hadoop, and Apache Kafka.</li>
<li>Strong coding skills in programming languages like Java, Scala, or Python.</li>
<li>Familiarity with data processing frameworks and ETL tools.</li>
<li>Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and data storage solutions (e.g., HDFS, S3, BigQuery).</li>
<li>Analytical mindset and excellent problem-solving abilities.</li>
<li>Strong communication skills to collaborate effectively with technical and non-technical stakeholders.</li>
<li>A self-motivated and proactive approach to work, with the ability to manage multiple tasks and deadlines.</li>
</ul>Preferred Qualifications:<ul>
<li>Experience with machine learning frameworks and algorithms is a plus.</li>
<li>Knowledge of data governance and security best practices.</li>
<li>Familiarity with containerization technologies and orchestration tools like Docker and Kubernetes.</li> 
</ul> 
 
Benefits 
1- Attractive Package.
2- Family Benefits.
3- Visa.
4-Air Tickets.</div>

Big Data Engineer

Müller's Solutions

<div>
 M&uuml;ller's Solutions is looking for an experienced Big Data Engineer to join our innovative team. In this role, you will be responsible for designing and developing scalable big data solutions that enable advanced analytics and insights across the organization. You will work with large data sets and utilize cutting-edge technologies to ensure data processing is efficient and reliable.
 
 
 
 Key Responsibilities:
 
 
 
 <ul>
 <li>
 Design, build, and maintain scalable data pipelines using big data technologies such as Apache Spark, Hadoop, and Kafka
 </li>
 <li>
 Collaborate with data scientists, analysts, and IT teams to identify data requirements and deliver solutions that meet business needs
 </li>
 <li>
 Ensure high data quality and integrity by implementing robust data validation and testing processes
 </li>
 <li>
 Optimize data storage solutions for performance and cost-efficiency across cloud and on-premises environments
 </li>
 <li>
 Monitor and troubleshoot data processing workflows to ensure timely data delivery
 </li>
 <li>
 Document data architectures, processes, and workflows for knowledge sharing and compliance
 </li>
 <li>
 Stay ahead of industry trends and best practices in big data technologies and methodologies
 
 
 </li>
 </ul>
 
 Requirements
 
 
 
 
 Requirements:
 
 
 
 <ul>
 <li>
 Bachelor's degree in Computer Science, Information Technology, or a related field
 </li>
 <li>
 3+ years of experience as a Big Data Engineer or in a similar data engineering role
 </li>
 <li>
 Proficiency in big data technologies such as Apache Spark, Hadoop, and Apache Kafka
 </li>
 <li>
 Strong coding skills in programming languages like Java, Scala, or Python
 </li>
 <li>
 Familiarity with data processing frameworks and ETL tools
 </li>
 <li>
 Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and data storage solutions (e.g., HDFS, S3, BigQuery)
 </li>
 <li>
 Analytical mindset and excellent problem-solving abilities
 </li>
 <li>
 Strong communication skills to collaborate effectively with technical and non-technical stakeholders
 </li>
 <li>
 A self-motivated and proactive approach to work, with the ability to manage multiple tasks and deadlines
 
 
 </li>
 </ul>
 
 Preferred Qualifications:
 
 
 
 <ul>
 <li>
 Experience with machine learning frameworks and algorithms is a plus
 </li>
 <li>
 Knowledge of data governance and security best practices
 </li>
 <li>
 Familiarity with containerization technologies and orchestration tools like Docker and Kubernetes
 
 
 </li>
 </ul>
 
 Benefits
 
 
 
 1- Attractive Package.
 
 
 2- Family Benefits.
 
 
 3- Visa.
 
 
 4-Air Tickets.
</div>

LTIMindtree

<div>Role description 
Mandatory Karat Interview

Job Description

At least 3 to 5 years of development work experience in Hadoop programming HDFS using pysparkHive based Data warehouse projects and with good Shell Scripting experience

Experience in Big Data technologies including Pyspark Hive and Hadoop

Experience in Pyspark programming languages

You have a good understanding of organizational strategy architecture patterns Microservices Event Driven and technology choices and coaching the team in execution in alignment to these guidelines

You can apply organizational technology patterns effectively in projects and make recommendations on alternate options

You have handson experience working with large volumes of data including different patterns of data ingestion processing batch realtime movement storage and access for both internal and external to BU and ability to make independent decisions within scope of project

You have a good understanding of data structures and algorithms

You can test debug and fix issues within established SLAs

You can design software that is easily testable and observable

You understand how teams goals fit a business need

You can identify business problems at the project level and provide solutions

You understand data access patterns streaming technology data validation data performance cost optimization

Strong SQL skills 
Skills 
Mandatory Skills : Apache Spark, Aws Batch, Big Data Hadoop Ecosystem, Data Architecture, Python 
Good to Have Skills : AWS EC2, AWS RDS, OCI Data Lake 
Other details 
Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree (&ldquo;LTIM&rdquo;):

Benefits and Perks:
<ul>
<li>Comprehensive Medical Plan Covering Medical, Dental, Vision</li>
<li>Short Term and Long-Term Disability Coverage</li>
<li>401(k) Plan with Company match</li>
<li>Life Insurance</li>
<li>Vacation Time, Sick Leave, Paid Holidays</li>
<li>Paid Paternity and Maternity Leave</li>
</ul>
The range displayed on each job posting reflects the minimum and maximum salary target for the position across all US locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.

Disclaimer: The compensation and benefits information provided herein is accurate as of the date of this posting.

LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law. 
Benefits 
Compensation range: $79,851.00 to $107,720.00 per year 
About LTM 
LTM is an AI-centric global technology services company and the Business Creativity partner to the world&rsquo;s largest and most disruptive enterprises. We bring human insights and intelligent systems together to help clients create greater value at the intersection of technology and domain expertise. Our capabilities span integrated operations, transformation, and business AI &mdash; enabling new ways of working, new productivity paradigms, and new roads to value. Together with over 87,000 employees across 40 countries and our global network of partners, LTM &mdash; a Larsen &amp; Toubro company &mdash; owns business outcomes for our clients, helping them not just outperform the market, but to Outcreate it. Please also note that neither LTM nor any of its authorized recruitment agencies/partners charge any candidate registration fee or any other fees from talent (candidates) towards appearing for an interview or securing employment/internship. Candidates shall be solely responsible for verifying the credentials of any agency/consultant that claims to be working with LTM for recruitment. Please note that anyone who relies on the representations made by fraudulent employment agencies does so at their own risk, and LTM disclaims any liability in case of loss or damage suffered as a consequence of the same. Recruitment Fraud Alert - https://www.ltimindtree.com/recruitment-fraud-alert/</div>

Senior Product Engineer

Guidehouse

<div>Job Family:
Data Science Consulting 
Travel Required:
Up to 10% 
Clearance Required:
None
What You Will Do:
Guidehouse is seeking a Databricks Apps Developer to support the AI &amp; Data practice in designing and building interactive prototype solutions, demos, and reusable accelerators for the Databricks Center of Excellence (CoE). This role focuses on front-end development, user‑centric workflow design, and integration with modern Databricks features (such as Genie, AI/BI dashboards, Delta Live Tables, and Databricks Model Serving) to create compelling internal assets that showcase Guidehouse&rsquo;s technical capabilities.
This is an exciting opportunity for someone who enjoys rapid prototyping, interface design, and hands-on development in a highly collaborative environment. This position is dedicated to internal innovation, developing reusable tools that strengthen Guidehouse&rsquo;s market offerings and support pursuit teams across our segments.
Innovation &amp; Solution Development<ul><li>
Design and develop React-based user interfaces and interactive front-end components for data and AI prototype applications.</li><li>
Integrate Databricks capabilities, including Genie, AI/BI dashboards, Unity Catalog, MLflow, Delta tables, and REST APIs, into user-facing demo workflows.</li><li>
Build intuitive, well‑structured user experiences that highlight technical capabilities in client-ready demos and internal accelerators.</li><li>
Document front-end architecture and design patterns for repeatability.</li><li>
Collaborate on cross-functional teams to rapidly prototype and iterate on solutions, incorporating feedback from demo cycles to refine UX and functionality.</li><li>
Translate stakeholder goals into actionable user stories and acceptance criteria to guide front-end feature development.</li><li>
Integrate AI/LLM features via secure APIs and Databricks model-serving endpoints to enable prompt-driven or context-enriched UI flows.</li><li>
Develop reusable UI components, scaffolding, and templates to accelerate build-out of future prototypes.</li><li>
Contribute to internal frameworks that standardize demo environments, code structure, and deployment patterns across the practice.</li></ul>
Internal Collaboration &amp; Team Enablement<ul><li>
Partner closely with AI &amp; Data practice leaders to shape prototype application requirements and design prototype architectures aligned to go-to-market needs.</li><li>
Work with cross-functional teams of data scientists and data engineers to connect UI features to underlying Databricks capabilities (DLT, Workflows, Model Serving).</li><li>
Participate in Agile ceremonies (backlog refinement, sprint planning, reviews, retrospectives) and clearly communicate UI progress, risks, and dependencies.</li><li>
Support Go‑to‑Market (GTM) efforts by contributing demo scripts, pitch-ready UX workflows, and reusable assets for proposal teams.</li><li>
Share best practices, design guidance, and sample code with broader Guidehouse teams to promote internal capability uplift.</li><li>
Maintain organized backlogs, sprint documentation, and technical notes using Jira and Confluence.</li><li>
Support requirements gathering efforts to translate internal stakeholder and business needs into user stories to guide prototype application development.</li><li>
Mentor junior team members and contribute to reusable frameworks and accelerators.</li><li>
Contribute to thought leadership, business development, and best practice development across the AI &amp; Data team.</li></ul> 
What You Will Need:<ul><li>
US Citizenship is required.</li><li>
Bachelor&rsquo;s degree in computer science, engineering, information systems, or a related field.</li><li>
Minimum THREE (3) years of experience in front-end software development.</li><li>
Strong proficiency in React, Typescript/Javascript, HTML/CSS, and UI state management frameworks.</li><li>
Experience integrating front-end applications with REST APIs, serverless endpoints, or cloud-hosted microservices.</li><li>
Experience with Databricks capabilities such as Unity Catalog, Delta Live Tables, Model Serving endpoints, AI/BI dashboards, and Genie</li><li>
Proficiency with Git-based version control and modern development workflows.</li><li>
Ability to design intuitive user experiences and translate abstract concepts into polished UI workflows.</li><li>
Excellent communication, facilitation, and stakeholder engagement skills, including the ability to explain technical application configurations to non-technical audiences.</li></ul> 
What Would Be Nice To Have:<ul><li>
Master&rsquo;s degree in computer science, engineering, mathematics, statistics, or a related technical field.</li><li>
FIVE (5) years of experience in application development.</li><li>
Demonstrated success developing and deploying React-based Databricks Apps.</li><li>
Experience building data- or AI-driven applications.</li><li>
Experience supporting product lifecycle activities, market analysis, or roadmap planning for AI and data products.</li><li>
Familiarity with Python, SQL, and cloud functions to support lightweight back-end/API development.</li><li>
Understanding of UX design concepts, wireframing, or rapid prototyping tools (Figma, Miro, etc.).</li><li>
Familiarity with Agile practices and Atlassian tools (Jira, Confluence).</li><li>
Familiarity with Databricks workspace configuration and administration.</li><li>
Active Databricks certifications strongly preferred.</li><li>
Prior experience in consulting or a client-facing role preferred.</li><li>
Familiarity with federal contracting and procurement processes.</li></ul> 
What We Offer:
Guidehouse offers a comprehensive, total rewards package that includes competitive compensation and a flexible benefits package that reflects our commitment to creating a diverse and supportive workplace.
Benefits include:<ul><li>
Medical, Rx, Dental &amp; Vision Insurance</li><li>
Personal and Family Sick Time &amp; Company Paid Holidays</li><li>
Position may be eligible for a discretionary variable incentive bonus</li><li>
Parental Leave and Adoption Assistance</li><li>
401(k) Retirement Plan</li><li>
Basic Life &amp; Supplemental Life</li><li>
Health Savings Account, Dental/Vision &amp; Dependent Care Flexible Spending Accounts</li><li>
Short-Term &amp; Long-Term Disability</li><li>
Student Loan PayDown</li><li>
Tuition Reimbursement, Personal Development &amp; Learning Opportunities</li><li>
Skills Development &amp; Certifications</li><li>
Employee Referral Program</li><li>
Corporate Sponsored Events &amp; Community Outreach</li><li>
Emergency Back-Up Childcare Program</li><li>
Mobility Stipend</li></ul>
About Guidehouse
Guidehouse is an Equal Opportunity Employer&ndash;Protected Veterans, Individuals with Disabilities or any other basis protected by law, ordinance, or regulation.
Guidehouse will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of applicable law or ordinance including the Fair Chance Ordinance of Los Angeles and San Francisco.
If you have visited our website for information about employment opportunities, or to apply for a position, and you require an accommodation, please contact Guidehouse Recruiting at 1-571-633-1711 or via email at RecruitingAccommodation@guidehouse.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodation.
All communication regarding recruitment for a Guidehouse position will be sent from Guidehouse email domains including @guidehouse.com or guidehouse@myworkday.com. Correspondence received by an applicant from any other domain should be considered unauthorized and will not be honored by Guidehouse. Note that Guidehouse will never charge a fee or require a money transfer at any stage of the recruitment process and does not collect fees from educational institutions for participation in a recruitment event. Never provide your banking information to a third party purporting to need that information to proceed in the hiring process.
If any person or organization demands money related to a job opportunity with Guidehouse, please report the matter to Guidehouse&rsquo;s Ethics Hotline. If you want to check the validity of correspondence you have received, please contact recruiting@guidehouse.com. Guidehouse is not responsible for losses incurred (monetary or otherwise) from an applicant&rsquo;s dealings with unauthorized third parties.
Guidehouse does not accept unsolicited resumes through or from search firms or staffing agencies. All unsolicited resumes will be considered the property of Guidehouse and Guidehouse will not be obligated to pay a placement fee.</div>

Databricks Apps Developer

Search 1639+ Hadoop developer jobs near you this March. New roles added regularly across leading industries. Apply today.

1639 hadoop developer jobs Near Me

Data Warehouse Engineer / ETL Developer - Associate/Director

Big Data Engineer

Big Data Engineer

Big Data Engineer

Big Data Engineer

Senior Product Engineer

Databricks Apps Developer