big data lead

CRUTZ LEELA ENTERPRISES

<p>Big Data Architect- Lead</p><p>Experience: 10-12 years</p><p>Key Responsibilities:</p><ul><li>Data Architecture Design: Designing and implementing scalable and resilient data</li></ul><p>architectures for both batch and streaming data processing.</p><ul><li>Data Modeling: Developing data models and database structures to ensure efficient</li></ul><p>data storage and retrieval.</p><ul><li>Data Security and Governance: Ensuring data security, integrity, and compliance</li></ul><p>with relevant regulations.</p><ul><li>Data Integration: Integrating data from various sources, including legacy systems,</li></ul><p>into the big data infrastructure.</p><ul><li>Performance Optimization: Monitoring and optimizing the performance of the big</li></ul><p>data infrastructure.</p><ul><li>Collaboration: Working with data scientists, engineers, and business stakeholders</li></ul><p>to understand requirements and translate them into technical solutions.</p><ul><li>Technology Selection: Evaluating and recommending new technologies and tools</li></ul><p>for data management and processing.</p><ul><li>Mentorship: Provide guidance and mentorship to junior team members.</li><li>Problem Solving: Identifying and resolving complex data challenges.</li><li>Participate in the pre and post sales process, helping both the sales, professional.</li></ul><p>Skills and Qualifications:</p><ul><li>Bachelor&rsquo;s / Master&rsquo;s degree in computer science, computer engineering, or</li></ul><p>relevant field.</p><ul><li>Overall 10+ years of experience, at least 2 years of experience in Big Data</li></ul><p>Architect.</p><ul><li>Strong understanding of big data technologies: Hadoop, Spark, NoSQL databases,</li></ul><p>cloud-based data services (AWS, Azure, GCP).</p><ul><li>Experience with open-source ecosystem programming languages (i.e., Python,</li></ul><p>Java, Scala, Spark etc.)</p><ul><li>Proficiency in data modeling and database design: SQL, NoSQL.</li><li>Experience with ETL processes: Extracting, transforming, and loading data.</li><li>Strong analytical and problem-solving skills.</li><li>Good communication and collaboration skills.</li><li>Experience with data security and governance principles.</li><li>Knowledge of API design and development.</li><li>Understanding of data visualization techniques.</li><li>Strong understanding of authentication (i.e. LDAP , Active Directory, SAML,</li></ul><p>Kerberos etc.) &amp;amp; authorization configuration for Hadoop based distributed systems.</p><ul><li>Familiarity of DevOps methodology &amp;amp; toolsets and automation experience.</li></ul><p>Job Types: Full-time, Permanent</p><p>Pay: ₹500,000.00 - ₹1,800,000.00 per year</p><p>Benefits:</p><ul><li>Provident Fund</li></ul><p>Work Location: In person</p>

Big Data Architect(Lead)

Pragma Edge

<div></div><div><div><div><div><div><div><div><div><div><div><div><div><div><ul><div><div>Job Category - IT</div>
</div><div></div><div><div>Job Type - Full Time</div>
</div><div></div><div><div>No of openings: 01</div>
</div><div></div><div><div>Experience : 6 to 8 Years</div>
</div><div></div><div><div>Job Location - Hyderabad</div>
</div></ul></div></div></div></div></div></div></div></div></div></div><div></div><div><div><div><div><div><div><div>Senior IT Data Engineer</div>
</div></div><div><div><p>The Senior IT Data Engineers are experts in data streaming, building data pipelines that support real-time data refreshes and are cost-optimized for computing resources. They deeply understand data security, implementing row-level and column-level security measures.
</p><p>This role typically involves leading the implementation of complex projects, using advanced big data technologies, and ensuring robust data pipeline orchestration across multiple systems.</p>
</div></div><div><div><div>Job Responsibilities</div>
</div></div><div><div><ul><li>Lead the design and orchestration of complex data pipelines and ETL processes, focusing on optimizing data models.</li><li>
Architect scalable data solutions, including data warehousing and big data technologies, and ensure alignment with organizational goals.</li><li>
Implement advanced data governance frameworks and ensure robust data security measures.</li><li>
Optimize cloud costs by strategically using cloud resources and efficient data architectures.</li><li>
Lead the development of data visualization strategies, ensuring they contribute to data-driven decision-making at a strategic level.</li><li>
Design and deploy enterprise-scale data visualization solutions, optimizing performance within tools.</li><li>
Oversee complex data pipeline orchestration and ensure seamless integration across systems.</li><li>
Interact with 3rd party vendors to incorporate new functionality and evaluate tools.</li><li>
Resolve complex escalations and situations, driving effective resolutions.</li><li>
Ensure adherence to data privacy and security practices to protect sensitive information.</li><li>
Communicate effectively with stakeholders to understand and address their needs through data visualization.</li><li>
Perform other assigned job-related duties that align with our organization&rsquo;s vision, mission, and values and fall within your scope of practice.</li></ul>
</div></div><div><div><div>Qualifications</div>
</div></div><div><div><ul><li>Education: Bachelor&rsquo;s Degree or relevant experience.</li><li>
Preferred Certification(s): Any relevant IT Certification.</li><li>
Experience: 5+ years of relevant and practical experience.</li></ul><p><b>
Special Skills:</b></p><ul><li>
Advanced skills in data streaming and real-time data processing.</li><li>
Expertise in designing complex data architectures and scalable systems.</li><li>
Deep knowledge of big data technologies and extensive experience with data security measures.</li><li>
Ability to lead data architecture reviews and approvals.</li></ul><p><b>
Soft Skills:</b></p><ul><li>
Project Management: Learning and understanding complex data initiatives from conception to completion.</li><li>
Mentorship: Guiding junior team members in their professional development.</li><li>
Strategic Thinking: Aligning data solutions with broader organizational goals.</li><li>
Communication: Articulating data strategies to both technical and non-technical stakeholders.</li><li>
Problem-Solving: Resolving complex data challenges and escalations.</li><li>
Adaptability: Staying current with rapidly evolving data technologies and best practices.</li><li>
Creativity: Innovating new approaches to data pipeline design and optimization.</li></ul></div></div></div></div></div></div></div></div></div><p></p>

Data Engineer

RAJA JI DAIRY

<p>We are an established <b>Dairy &amp; Ice Cream brand</b> looking for a <b>young, creative, and passionate Social Media &amp; Digital Growth Manager</b> to build and grow our digital presence in the UAE.</p><p>If you live and breathe social media, have a flair for content creation, and know how to turn engagement into sales, this role is for you.</p><p><b>Key Responsibilities:</b></p><ul><li>Build and manage brand social media pages across Instagram, TikTok, Facebook, YouTube, LinkedIn, and more</li><li>Develop and execute 360&deg; digital campaigns with influencer collaborations and paid ad placements</li><li>Create engaging content using photo/video editing tools and AI tools</li><li>Oversee community management, engaging followers and building brand loyalty</li><li>Manage SEO, website updates, and analytics to boost online visibility and sales</li><li>Monitor campaign performance, optimize results, and report insights</li><li>Collaborate with internal teams to ensure consistency across all digital touchpoints</li></ul><p><b>Requirements:</b></p><ul><li>Minimum 2 years of relevant social media/digital marketing experience in Dubai</li><li>Experience in FMCG, Dairy, Food Manufacturing, or Restaurant industry is a plus</li><li>Valid UAE Driving License</li></ul><p><b>What&rsquo;s in it for You:</b></p><ul><li>Attractive Salary + Incentives &ndash; rewarding performance and results</li><li>Company-provided UAE Visa and other allowances</li><li>Excellent career growth opportunities in branding, digital, and marketing leadership</li><li>Freedom to experiment with ideas, platforms, and tools to make real impact</li><li>Work on high-visibility campaigns that shape brand identity</li></ul><p>Job Types: Full-time, Permanent</p><p>Pay: AED5,000.00 - AED5,500.00 per month</p>

Social Media & Digital Growth - Lead

Cognizant Technology Solutions

<div><p><b>Job Title: - GCP Data Engineer with Big Query
</b><br>
<b>Location: - AIA Pune</b><br>
<b>Job Type 3 days from office (Hybrid)</b></p><p><b>
Minimum 6 to 13 years of experience</b></p><p><b>
Mandatory Skills:</b> GCP Services &ndash; Big Query, Cloud SQL, Data flow<br>
Around 7+ years of experience in development in Data warehousing projects in GCP platforms,<br>
Good understanding of dimensional modelling<br>
Expertise in MySQL &amp; SQL/PL<br>
GCP &amp; BigQuery knowledge is must, GCP certification is added advantage<br>
Good experience in Cloud Composer, DAGs , airflow<br>
REST API development experience<br>
Good in analytical and problem solving, efficient communication<br>
Ability to lead the team members, convert requirements into technical solutions, assign the work, coordinate the team and review the deliverables and ensure on schedule.</p></div>

GCP Data Engineer with Big Query

Information Tech Consultants

<div>
 <p>
  🌟 Senior Data Scientist SME /
  <strong>
   Data Science SME (Subject matter expert)
  </strong>
  🧠
 </p>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Location : London (Relocation required - Sponsorship will be provided)
  </strong>
 </p>
 <p>
  <strong>
   Experience : 9-12 years
  </strong>
 </p>
 <p>
  <strong>
   CTC- 40-45 lacs
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <p>
  We are seeking a highly accomplished and results-oriented
  <strong>
   Senior Data Scientist Subject Matter Expert (SME)
  </strong>
  with over
  <strong>
   10 years of experience
  </strong>
  to lead our advanced analytics and AI initiatives. This is a pivotal role requiring deep technical mastery across large-scale Big Data technologies, multi-cloud environments, and cutting-edge specialized AI domains, including
  <strong>
   Generative AI, Computer Vision, and Natural Language Processing (NLP)
  </strong>
  .
 </p>
 <p>
  You will be the principal technical leader, driving strategy, setting standards, and delivering high-impact solutions that transform business outcomes.
 </p>
 <p>
  <br/>
 </p>
 <p>
  Key Responsibilities
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   <strong>
    AI/ML Strategy &amp; Architecture:
   </strong>
   Define the technical roadmap and architectural standards for deploying and scaling complex AI systems, particularly those involving
   <strong>
    Generative AI (GenAI)
   </strong>
   , large language models (
   <strong>
    LLMs
   </strong>
   ), and specialized models in Computer Vision and NLP.
  </li>
  <li>
   <strong>
    Big Data Engineering:
   </strong>
   Design, build, and optimize high-throughput, distributed data pipelines and features using
   <strong>
    Apache Spark (Scala)
   </strong>
   and
   <strong>
    Hive
   </strong>
   on massive datasets to support model training and inference.
  </li>
  <li>
   <strong>
    Cross-Cloud Execution:
   </strong>
   Lead the design and deployment of ML models and data infrastructure across multiple major cloud providers (
   <strong>
    AWS, Azure, and GCP
   </strong>
   ), ensuring portability, scalability, and cost efficiency.
  </li>
  <li>
   <strong>
    Specialized Model Development:
   </strong>
   Lead hands-on development, fine-tuning, and deployment of production-grade models in key specialized areas:
  </li>
  <li>
   <strong>
    Computer Vision:
   </strong>
   Developing and optimizing models for image recognition, object detection, and video analytics.
  </li>
  <li>
   <strong>
    NLP:
   </strong>
   Building sophisticated systems for sentiment analysis, entity extraction, semantic search, and RAG architectures leveraging LLMs.
  </li>
  <li>
   <strong>
    Generative AI:
   </strong>
   Exploring and implementing cutting-edge GenAI techniques for content creation, data augmentation, and innovative product features.
  </li>
  <li>
   <strong>
    SME Consulting &amp; Mentorship:
   </strong>
   Act as the internal authority and consultant, providing technical guidance, architectural review, and mentorship to junior data scientists and engineering teams.
  </li>
  <li>
   <strong>
    MLOps &amp; Governance:
   </strong>
   Establish best practices for MLOps, model monitoring, version control, and model risk governance in a multi-cloud production environment.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  Required Skills and Expertise (10+ Years)
 </p>
 <p>
  <br/>
 </p>
 <p>
  <br/>
 </p>
 <p>
  1. Big Data and Cloud Mastery
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   <strong>
    Programming &amp; Big Data:
   </strong>
   10+ years of extensive, hands-on experience with
   <strong>
    Apache Spark
   </strong>
   , with strong preference for production development using
   <strong>
    Scala
   </strong>
   . Deep expertise with
   <strong>
    Apache Hive
   </strong>
   for data querying and management.
  </li>
  <li>
   <strong>
    Cloud Proficiency:
   </strong>
   Demonstrated expertise in deploying and managing data/ML workloads across
   <strong>
    at least two
   </strong>
   of the three major cloud platforms:
   <strong>
    AWS
   </strong>
   (Sagemaker, EMR, S3),
   <strong>
    Azure
   </strong>
   (Azure ML, Synapse Analytics), and
   <strong>
    GCP
   </strong>
   (Vertex AI, BigQuery).
  </li>
  <li>
   <strong>
    Data Architecture:
   </strong>
   Expert knowledge of distributed systems, data partitioning, optimization techniques, and data warehousing concepts in a cloud-native context.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  2. Advanced AI/ML Specialization
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   <strong>
    Generative AI (GenAI) &amp; LLMs:
   </strong>
   Proven experience with the architecture and implementation of Generative AI solutions, including prompt engineering, fine-tuning, and deploying
   <strong>
    Large Language Models (LLMs)
   </strong>
   .
  </li>
  <li>
   <strong>
    Computer Vision:
   </strong>
   In-depth knowledge of deep learning frameworks (TensorFlow, PyTorch) and experience with Computer Vision tasks (e.g., CNNs, object detection models like YOLO).
  </li>
  <li>
   <strong>
    NLP:
   </strong>
   Expert practical experience in NLP techniques, including transformer models, embedding generation, and building complex text-based applications.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  3. Leadership &amp; Soft Skills
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   <strong>
    Technical Leadership:
   </strong>
   Proven track record of leading complex data science projects from research to production deployment.
  </li>
  <li>
   <strong>
    Communication:
   </strong>
   Exceptional ability to translate complex technical findings into clear, strategic recommendations for technical and executive audiences.
  </li>
  <li>
   <strong>
    Mentorship:
   </strong>
   Experience mentoring and training senior engineers and data scientists.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  Education and Certification
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   Master&rsquo;s or Ph.D. in Computer Science, Data Science, Engineering, or a highly quantitative field.
  </li>
  <li>
   Relevant professional cloud certifications (e.g., AWS Certified Machine Learning Specialty, Google Cloud Professional Data Engineer) are highly desirable.
  </li>
 </ul>
 <p>
 </p>
</div>


Senior Data Scientist SME & AI

Target

<div></div><div><div><div><div><div><p><b>About us:</b><br>
Working at Target means helping all families discover the joy of everyday life. We bring that vision to life through our values and culture. Learn more about Target here.</p><p></p><p><b>
About the Role:</b><br>
As a <b>Lead Data Engineer</b>, you will serve as the <b>technical anchor</b> for the engineering team, responsible for designing and developing <b>scalable, high-performance data solutions</b>. You will <b>own and drive data architecture</b> that supports both functional and non-functional business needs, ensuring <b>reliability, efficiency, and scalability</b>.<br>
Your expertise in <b>big data technologies, distributed systems, and cloud platforms</b> will help shape the engineering roadmap and best practices for <b>data processing, analytics, and real-time data serving</b>. You will play a key role in <b>architecting and optimizing data pipelines</b> using <b>Hadoop, Spark, Scala/Java, and cloud technologies</b> to support enterprise-wide data initiatives.<br>
Additionally, <b>experience with API development for serving low-latency data</b> and <b>Customer Data Platforms (CDP)</b> will be a strong plus.</p><p></p><p><b>
Key Responsibilities:</b></p><ul><li><p>
Architect and build <b>scalable, high-performance data pipelines</b> and <b>distributed data processing solutions</b> using <b>Hadoop, Spark, Scala/Java, and cloud platforms (AWS/GCP/Azure)</b>.</p></li><li><p>
Design and implement <b>real-time and batch data processing solutions</b>, ensuring data is efficiently processed and made available for analytical and operational use.</p></li><li><p><b>
Develop APIs and data services</b> to expose <b>low-latency, high-throughput</b> data for downstream applications, enabling real-time decision-making.</p></li><li><p>
Optimize and enhance <b>data models, workflows, and processing frameworks</b> to improve performance, scalability, and cost-efficiency.</p></li><li><p>
Drive <b>data governance, security, and compliance</b> best practices.</p></li><li><p>
Collaborate with <b>data scientists, product teams, and business stakeholders</b> to understand requirements and deliver <b>data-driven solutions</b>.</p></li><li><p>
Lead the <b>design, implementation, and lifecycle management</b> of data services and solutions.</p></li><li><p>
Stay up to date with <b>emerging technologies</b> and drive adoption of best practices in <b>big data engineering, cloud computing, and API development</b>.</p></li><li><p>
Provide <b>technical leadership and mentorship</b> to engineering teams, promoting best practices in <b>data engineering and API design</b>.</p></li></ul><p></p><p><b>
About You:</b></p><ul><li><p><b>
7+ years of experience in data engineering, software development, or distributed systems.</b></p></li><li><p><b>
Expertise in big data technologies</b> such as <b>Hadoop, Spark, and distributed processing frameworks.</b></p></li><li><p><b>
Strong programming skills in Scala and/or Java</b> (Python is a plus).</p></li><li><p><b>
Experience with cloud platforms (AWS, GCP, or Azure)</b> and their <b>data ecosystem</b> (e.g., S3, BigQuery, Databricks, EMR, Snowflake, etc.).</p></li><li><p><b>
Proficiency in API development</b> using <b>REST, GraphQL, or gRPC</b> to serve real-time and batch data.</p></li><li><p><b>
Experience with real-time and streaming data architectures</b> (Kafka, Flink, Kinesis, etc.).</p></li><li><p>
Strong knowledge of <b>data modeling, ETL pipeline design, and performance optimization</b>.</p></li><li><p>
Understanding of <b>data governance, security, and compliance</b> in large-scale data environments.</p></li><li><p><b>
Experience with Customer Data Platforms (CDP) or customer-centric data processing</b> is a strong plus.</p></li><li><p>
Strong problem-solving skills and ability to work in <b>complex, unstructured environments</b>.</p></li><li><p>
Excellent communication and collaboration skills, with experience working in <b>cross-functional teams</b>.</p></li></ul><p></p><p><b>
Why Join Us?</b></p><ul><li><p>
Work with cutting-edge <b>big data, API, and cloud technologies</b> in a fast-paced, collaborative environment.</p></li><li><p>
Influence and shape the <b>future of data architecture and real-time data services</b> at Target.</p></li><li><p>
Solve <b>high-impact business problems</b> using <b>scalable, low-latency data solutions</b>.</p></li><li><p>
Be part of a culture that values <b>innovation, learning, and growth</b>.</p></li></ul></div></div></div></div></div><p></p>

Lead Data Engineer

code guardian tech international private limited

<p>Job Summary:</p><p>We are hiring an experienced Data Scientist (AI/ML) &ndash; Manager Level to lead the development of advanced machine learning, deep learning, and AI-driven solutions. The ideal candidate will handle end-to-end model building&mdash;from data collection and preprocessing to model deployment and performance monitoring. This role requires strong expertise in ML frameworks, real-world AI applications, big data systems, and cross-team collaboration.</p><p>Key Responsibilities:</p><p>1. Develop, train, and evaluate ML and Deep Learning models for classification, regression, clustering, NLP, and computer vision tasks.</p><p>2. Clean, preprocess, and transform large structured and unstructured datasets.</p><p>3. Conduct exploratory data analysis (EDA), feature engineering, and statistical modeling.</p><p>4. Build scalable data pipelines and automate model deployment using MLOps workflows.</p><p>5. Research and experiment with cutting-edge AI/ML algorithms and technologies.</p><p>6. Collaborate with data engineers, developers, domain experts, and stakeholders.</p><p>7. Maintain documentation and version control for datasets, models, and code.</p><p>Required Qualification:</p><p>1. B.E/B.Tech / MCA / MBA / PG in Computer Science, Data Science, AI/ML, or related fields (Minimum 60% aggregate / First Division).</p><p>2. Certifications in AI/ML, Deep Learning, Neural Networks, Big Data Analytics, or related areas.</p><p>3. Additional training in TensorFlow, PyTorch, Hadoop, Kubernetes, MLOps is a plus.</p><p>4. Strong knowledge of SQL/NoSQL databases.</p><p>5. 7+ years of experience in AI/ML model development, OCR, data visualization, and indexing.</p><p>Required Skills:</p><p>1. Strong programming skills in Python or R.</p><p>2. Hands-on experience with ML libraries and frameworks like Scikit-learn, TensorFlow, Keras, PyTorch.</p><p>3. Experience with NLP, computer vision, predictive modeling, and deep learning.</p><p>4. Expertise in data preprocessing, feature engineering, model validation &amp; evaluation.</p><p>5. Experience with big data technologies such as Hadoop, Spark, Hive.</p><p>6. Experience using data visualization tools (Power BI, Tableau, Matplotlib, etc.)</p><p>7. Prior experience developing AI solutions in finance, healthcare, e-commerce, cybersecurity, or telecom.</p><p>8. Participation in open-source projects, Kaggle competitions, or published research is an added advantage.</p><p>Job Type: Full-time</p><p>Benefits:</p><ul><li>Provident Fund</li></ul><p>Work Location: In person</p>

Data Scientist (AI/ML)

Search 10000+ Big data lead jobs near you this January. New roles added regularly across leading industries. Apply today.