big data lead

BRISKWIN IT SOLUTIONS

<div><div><div>Exp: 6-9yrs</div>
<div><b>Work location : Pune/Chennai/Mumbai/Noida/Coim</b><b>batore/Bangalore</b><br>
<b>Work Mode: Hybrid</b></div>
<div>Notice Period : Imm &ndash; 30 days</div>
<div></div><div><b>Mandatory skills : SSIS + MongoDB + SQL</b><p></p><b>
</b><p><b>
Job Title: Data Engineer Experience: 5+ years</b></p></div>
<div>
Job Description: We are looking for an experienced Data Engineer with strong expertise in building and managing data pipelines, integrating diverse data sources, and ensuring high data quality and performance. The ideal candidate will have hands-on experience with both structured and unstructured data systems.</div>
<div>Key Responsibilities: &bull; Design, develop, and maintain scalable ETL/ELT pipelines. &bull; Work with stakeholders to understand data requirements and deliver reliable solutions. &bull; Integrate data from various sources including SQL Server and MongoDB. &bull; Optimize data workflows and ensure data integrity and security. Must-Have Skills: &bull; 5+ years of experience in data engineering or related roles. &bull; Strong proficiency in SQL and MongoDB. &bull; Hands-on experience with SSIS (SQL Server Integration Services). &bull; Solid understanding of data modeling, ETL processes, and data warehousing. &bull; Experience with version control (Git) and working in collaborative environments.</div>
<div>Nice-to-Have: &bull; Experience with cloud platforms (Azure, AWS, or GCP). &bull; Familiarity with big data tools like Spark or Databricks. &bull; Exposure to CI/CD pipelines and DevOps practices.&rdquo;</div>
</div><div><div><div><div><b>Job Location: </b>BangaloreChennaiCoimbatoreNoidaPune</div></div></div></div></div>

Big Data Lead

Tata Consultancy Services (TCS)

<div></div><div><div><div><div><div><b>Responsibilities:</b></div>
<ul>
<li>Ingest data from disparate sources (Structured, unstructured and semi-structured) and develop ETL jobs using the above skills.</li>
<li>Do impact analysis and come up with estimates</li>
<li>Take responsibility for end-to-end deliverable.</li>
<li>Create Project Plan &amp; Work on Implementation Strategy</li>
<li>Need to have comprehensive understanding on ETL concepts and Cross Environment Data Transfers</li>
<li>Need to Handle Customer Communications and Management Reporting</li></ul><br>
<div></div>
<div><b>
Desired Competencies (Technical/Behavioral Competency)</b></div>
<div>
Must-Have skills-Spark, Pyspark, Hive</div>
<div>
Good-to-Have skill: Agile</div>
</div></div></div><div><div><div><b>Location</b></div>
<div>Sydney</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Lead</div>
</div><div><div><b>Job Id</b></div>
<div>378295</div>
</div><div><div><b>Desired Skills</b></div>
<div>Big Data</div></div></div></div><div></div>

Solution Designer

<div></div><div><div><div><div><ul><div>5 - 7 Years</div>
<div></div><div>1 Opening</div>
 <div>Hyderabad</div></ul></div><p></p><div><br>
<div><div>
</div></div></div></div><div></div><div><h3 class="jobSectionHeader"><b>Role description</b></h3>
<div><p><b>Key Responsibilities</b></p>
<ul>
<li>Collect, clean, and process large datasets from multiple sources.</li>
<li>Develop and implement machine learning models and statistical algorithms.</li>
<li>Perform exploratory data analysis and generate insights for stakeholders.</li>
<li>Collaborate with engineering and business teams to integrate models into production.</li>
<li>Communicate findings through visualizations and reports.<br>
<br>
<b>Required Skills
</b></li><li>Strong knowledge of Python or R for data analysis and modeling.</li>
<li>Proficiency in machine learning frameworks (e.g., scikit-learn, TensorFlow, PyTorch).</li>
<li>Experience with SQL and data manipulation.</li>
<li>Familiarity with data visualization tools (e.g., Tableau, Power BI, Matplotlib).</li>
<li>Understanding of statistics and probability.</li>
</ul></div>
<h3 class="jobSectionHeader"><b>Skills</b></h3>
<div><p>Python,Big Data,Machine Learning</p></div></div></div></div><p></p>
<br><div><h3 class="jobSectionHeader"><b>About UST</b></h3>
<div>UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world&rsquo;s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients&rsquo; organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact&mdash;touching billions of lives in the process.</div></div>

Lead I - Data Science (Python,Big Data,Machine Learning)

Antons

<b>Key Responsibilities</b> 
<ul>
<li>
<p> <b>Catalog Implementation</b>: Lead the design, configuration, and implementation of <b>Databricks Unity Catalog</b> to support enterprise-wide data management and governance.</p>
</li>
<li>
<p> <b>Governance &amp; Compliance</b>: Ensure adherence to <b>data governance frameworks</b> and compliance standards.</p>
</li>
<li>
<p> <b>Metadata &amp; Lineage</b>: Establish robust <b>metadata management, lineage tracking, classification, and business glossary practices</b>.</p>
</li>
<li>
<p> <b>Integration</b>: Integrate the data catalog with <b>ETL/ELT pipelines, BI tools, and data platforms</b> to enable seamless data discovery and accessibility.</p>
</li>
<li>
<p> <b>Tooling &amp; Platforms</b>: Drive adoption of governance tools.</p>
</li>
<li>
<p> <b>Best Practices</b>: Define and enforce <b>cataloging, metadata, and governance standards</b>, promoting data ownership and stewardship across the organization.</p>
</li>
<li>
<p> <b>Collaboration</b>: Partner with engineering, analytics, and compliance teams to embed governance into data pipelines and business processes.</p>
</li>
</ul>
 <b>Key Skills &amp; Experience</b> 
<ul>
<li>
<p> <b>6+ years</b> of experience in <b>Data Management, Data Governance, or Metadata Management</b>.</p>
</li>
<li>
<p> <b>Mandatory</b>: Hands-on experience with <b>Databricks Unity Catalog</b>.</p>
</li>
<li>
<p>Strong knowledge of <b>data governance frameworks</b>.</p>
</li>
<li>
<p>Expertise in <b>metadata standards, data lineage, classification, and glossary management</b>.</p>
</li>
<li>
<p>Experience with <b>ETL/ELT integration</b> and connecting catalogs to <b>BI tools</b>.</p>
</li>
<li>
<p>Familiarity with <b>data governance platforms</b>.</p>
</li>
<li>
<p>Strong understanding of <b>data privacy and compliance regulations</b>.</p>
</li>
<li>
<p>Excellent communication, stakeholder management, and leadership skills.</p>
</li>
</ul>

Data Catalog Lead

KAUST (King Abdullah University of Science and Technology)

<div>
 <p>
  <strong>
   Job Purpose
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <p>
  The Data Repository Lead will lead the development, launch, management and expansion of KAUST&rsquo;s institutional data repository and its associated services, a core component of the University&rsquo;s research data management ecosystem. The role ensures trustworthy stewardship and discoverability of research data by implementing workflows for deposit, curation, metadata quality, persistent identifiers (e.g., DOIs for datasets, ORCID iDs for contributors), access control (including internal research data asset cataloging and embargoes), and long-term preservation.
 </p>
 <p>
  <br/>
 </p>
 <p>
  The Lead consults widely with researchers across the university to identify and prioritize their needs and partners with IT, Core Labs, Research Compliance, and other university stakeholders to integrate systems and automate pipelines that support funder/publisher compliance, ethical and legal requirements, and the FAIR principles. Success will be demonstrated through service reliability, growth in high-quality deposits and demonstrable reuse, researcher satisfaction, and alignment with KAUST&rsquo;s RDM policy, international standards, and community best practices.
 </p>
 <p>
  <br/>
 </p>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Major Accountabilities
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   Work closely with the library manager to develop direction for KAUST&rsquo;s institutional data repository, in consultation with KAUST researchers and other university stakeholders, and in alignment with KAUST strategy and policies.
  </li>
  <li>
   Develop and implement guidelines and procedures for internal research data asset cataloging, public release of eligible datasets, metadata review, removal, retention, and dataset versioning.
  </li>
  <li>
   Work with external vendors and internal partners to evaluate and implement suitable systems.
  </li>
  <li>
   Connect the data repository with single sign on, storage platforms, instruments/Core Labs data pipelines, data management planning tools, publications repositories and current research information systems, persistent identifier services (DataCite and ORCID), and other relevant system APIs for metadata synchronization and reporting.
  </li>
  <li>
   Regularly consult with researchers to identify their needs and tailor services to their requirements.
  </li>
  <li>
   Deliver training and support for researchers and coordinate improved data management planning and the application of the FAIR principles with research data stewards and champions to increase the long-term value derived from research data assets.
  </li>
  <li>
   Ensure repository services comply with KAUST policies, funder/publisher requirements, and legal/ethical standards.
  </li>
  <li>
   Promote discovery and interoperability by establishing robust links between data, related publications, and research software/code.
  </li>
  <li>
   Monitor service health (uptime/fixity, number and quality of deposits, curation process times, storage use) and impact (downloads/citations, user satisfaction) through dashboards and regular reports.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Competencies
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Required:
  </strong>
 </p>
 <ul>
  <li>
   Demonstrated expertise with at least one major institutional data repository or research data platform (Invenio, Figshare, Dataverse or comparable).
  </li>
  <li>
   Demonstrated proficiency and familiarity with current issues in research data management, including FAIR principles, metadata standards, persistent identifiers (DOIs, ORCID iDs), longterm preservation, and compliance with legal/ethical/publisher/funder requirements.
  </li>
  <li>
   Experience developing and implementing workflows for data deposit, curation, metadata quality control, versioning, access control, and embargo management.
  </li>
  <li>
   Strong project management skills with the ability to manage multiple projects concurrently, set and meet deadlines, and adapt to evolving priorities and technologies.
  </li>
  <li>
   Demonstrated ability to deliver training, guidance, and outreach, and to promote good research data management practices among faculty, researchers, students, and staff.
  </li>
  <li>
   Excellent communication and collaboration skills, with experience working effectively across diverse academic populations and with external vendors/partners.
  </li>
  <li>
   A strong user focus and service orientation, with excellent analytical, interpersonal, and problem-solving skills, and the ability to embrace innovation and continuous improvement.
  </li>
 </ul>
 <p>
  <strong>
   Preferred:
  </strong>
 </p>
 <ul>
  <li>
   Experience integrating data repository platforms with research management systems, lab data pipelines, researcher workflows and storage platforms.
  </li>
  <li>
   Familiarity with international best practices and emerging trends in research reproducibility, intellectual property laws (including data licensing), and academic research evaluation practices.
  </li>
  <li>
   Familiarity with APIs, scripting, or automation for metadata synchronization, reporting, and system interoperability.
  </li>
  <li>
   Experience monitoring service performance through dashboards and analytics.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Qualifications
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   Required: Master&rsquo;s degree in library science, information science, data science, a data intensive scientific discipline relevant to research done at KAUST, or equivalent education and experience.
  </li>
  <li>
   Preferred: PhD or equivalent advanced degree in a relevant field.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Experience
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   A minimum of 5 years of experience in Research Data Management, Research Data Repositories, or Related Research Data Stewardship or Data Management Planning.
  </li>
 </ul>
 <p>
 </p>
</div>


Data Respository Lead

<div></div><div><div><div><div><ul><div>5 - 7 Years</div>
<div></div><div>1 Opening</div>
 <div>Bangalore, Bengaluru, Chennai, Hyderabad, Kochi, Trivandrum</div></ul></div><p></p><div><br>
<div><div>
</div></div></div></div><div></div><div><h3 class="jobSectionHeader"><b>Role description</b></h3>
<div><p>Role Proficiency:</p>
<p>
Provide expertise on data analysis techniques using software tools. Under supervision streamline business processes.</p>
<p>
Outcomes:</p>
<div>
<ul><li> Design and manage the reporting environment; which include data sources security and metadata.</li></ul>
<ul><li> Provide technical expertise on data storage structures data mining and data cleansing.</li></ul>
<ul><li> Support the data warehouse in identifying and revising reporting requirements.</li></ul>
<ul><li> Support initiatives for data integrity and normalization.</li></ul>
<ul><li> Assess tests and implement new or upgraded software. Assist with strategic decisions on new systems. Generate reports from single or multiple systems.</li></ul>
<ul><li> Troubleshoot the reporting database environment and associated reports.</li></ul>
<ul><li> Identify and recommend new ways to streamline business processes</li></ul>
<ul><li> Illustrate data graphically and translate complex findings into written text.</li></ul>
<ul><li> Locate results to help clients make better decisions. Solicit feedback from clients and build solutions based on feedback.</li></ul>
<ul><li> Train end users on new reports and dashboards.</li></ul>
<ul><li>Set FAST goals and provide feedback on FAST goals of repartees</li></ul>
</div>
<p></p><p>Measures of Outcomes:</p>
<div>
<ul><li> Quality - number of review comments on codes written</li></ul>
<ul><li> Data consistency and data quality.</li></ul>
<ul><li> Number of medium to large custom application data models designed and implemented</li></ul>
<ul><li> Illustrates data graphically; translates complex findings into written text.</li></ul>
<ul><li> Number of results located to help clients make informed decisions.</li></ul>
<ul><li> Number of business processes changed due to vital analysis.</li></ul>
<ul><li> Number of Business Intelligent Dashboards developed</li></ul>
<ul><li> Number of productivity standards defined for project</li></ul>
<ul><li>Number of mandatory trainings completed</li></ul>
</div>
<p></p><p>Outputs Expected:</p>
<p>
Determine Specific Data needs:</p>
<div>
<ul><li>Work with departmental managers to outline the specific data needs for each business method analysis project</li></ul></div><br>
<p><br>
Critical business insights:</p>
<div>
<ul><li>Mines the business&rsquo;s database in search of critical business insights; communicates findings to relevant departments.</li></ul></div><br>
<p><br>
Code:</p>
<div>
<ul><li>Creates efficient and reusable SQL code meant for the improvement<br>
manipulation<br>
and analysis of data.</li></ul>
<ul><li>Creates efficient and reusable code. Follows coding best practices.</li></ul></div><br>
<p><br>
Create/Validate Data Models:</p>
<div>
<ul><li>Builds statistical models; diagnoses<br>
validates<br>
and improves the performance of these models over time.</li></ul></div><br>
<p><br>
Predictive analytics:</p>
<div>
<ul><li>Seeks to determine likely outcomes by detecting tendencies in descriptive and diagnostic analysis</li></ul></div><br>
<p><br>
Prescriptive analytics:</p>
<div>
<ul><li>Attempts to identify what business action to take</li></ul></div><br>
<p><br>
Code Versioning:</p>
<div>
<ul><li>Organize and manage the changes and revisions to code. Use a version control tool for example git<br>
bitbucket. etc.</li></ul></div><br>
<p><br>
Create Reports:</p>
<div>
<ul><li>Create reports depicting the trends and behaviours from analyzed data</li></ul></div><br>
<p><br>
Document:</p>
<div>
<ul><li>Create documentation for worked performed. Additionally<br>
perform peer reviews of documentation of others' work</li></ul></div><br>
<p><br>
Manage knowledge:</p>
<div>
<ul><li>Consume and contribute to project related documents<br>
share point<br>
libraries and client universities</li></ul></div><br>
<p><br>
Status Reporting:</p>
<div>
<ul><li>Report status of tasks assigned</li></ul>
<ul><li>Comply with project related reporting standards and processes</li></ul>
</div>
<p></p><p>Skill Examples:</p>
<div>
<ul><li> Analytical Skills: Ability to work with large amounts of data: facts figures and number crunching.</li></ul>
<ul><li> Communication Skills: Communicate effectively with a diverse population at various organization levels with the right level of detail.</li></ul>
<ul><li> Critical Thinking: Data Analysts must review numbers trends and data to come up with original conclusions based on the findings.</li></ul>
<ul><li> Presentation Skills - facilitates reports and oral presentations to senior colleagues</li></ul>
<ul><li> Strong meeting facilitation skills as well as presentation skills.</li></ul>
<ul><li> Attention to Detail: Vigilant in the analysis to determine accurate conclusions.</li></ul>
<ul><li> Mathematical Skills to estimate numerical data.</li></ul>
<ul><li> Work in a team environment</li></ul>
<ul><li> Proactively ask for and offer help</li></ul>
</div>
<p></p><p>Knowledge Examples:</p>
<p>
Knowledge Examples</p>
<div>
<ul><li> Database languages such as SQL</li></ul>
<ul><li> Programming language such as R or Python</li></ul>
<ul><li> Analytical tools and languages such as SAS &amp; Mahout.</li></ul>
<ul><li> Proficiency in MATLAB.</li></ul>
<ul><li> Data visualization software such as Tableau or Qlik.</li></ul>
<ul><li> Proficient in mathematics and calculations.</li></ul>
<ul><li> Efficiently with spreadsheet tools such as Microsoft Excel or Google Sheets</li></ul>
<ul><li> DBMS</li></ul>
<ul><li> Operating Systems and software platforms</li></ul>
<ul><li>Knowledge regarding customer domain and sub domain where problem is solved</li></ul>
</div>
<p></p><p>Additional Comments:</p>
<p></p>
<p>Responsibilities Lead the development of fruit defect detection models using object detection and image segmentation techniques. Design and implement deep learning pipelines using frameworks like PyTorch or TensorFlow. Work closely with domain experts to define defect categories and edge cases (e.g., bruises, rot, discoloration, deformities). Build, manage, and optimize data pipelines&mdash;including dataset curation, labeling workflows, and augmentation strategies. Ensure high model performance in terms of accuracy, recall, and inference speed&mdash;across diverse lighting and background conditions. Collaborate with product and engineering teams to deploy models to production (cloud or edge-based inference). Research and apply cutting-edge computer vision techniques (e.g., YOLOv8, EfficientDet, Mask R-CNN, ViTs, or DETR). Lead and mentor junior ML engineers and researchers. Own model evaluation and explainability tools for business and QA teams. Requirements 7+ years of experience in AI/ML with a focus on computer vision and deep learning. Strong expertise in object detection and image classification techniques. Proven experience working with real-world noisy image datasets and model optimization. Proficient in Python and frameworks such as PyTorch or TensorFlow. Familiar with tools such as OpenCV, Label Studio, Roboflow, or CVAT. Solid understanding of CNNs, transfer learning, and data-centric AI practices. Experience deploying models in production environments (REST APIs, ONNX, TensorRT, etc.).</p></div>
<h3 class="jobSectionHeader"><b>Skills</b></h3>
<div><p>Python,Machine Learning,Artificial Intelligence</p></div></div></div></div><p></p>
<br><div><h3 class="jobSectionHeader"><b>About UST</b></h3>
<div>UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world&rsquo;s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients&rsquo; organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact&mdash;touching billions of lives in the process.</div></div>

Lead I - Data Science

<p><strong>Key Responsibilities:</strong></p>
<ul>
 <li>Own the end-to-end product lifecycle for digital banking offeringsideation, design, development, launch, performance tracking, and ongoing optimization.</li>
 <li>Shape and deliver the digital strategy and product roadmap, balancing long-term vision with near-term execution.</li>
 <li>Drive digital transformation by integrating emerging technologies (AI, machine learning, open banking APIs, blockchain) into new and existing products.</li>
 <li>Lead cross-functional teams and collaborate with stakeholders in IT, marketing, compliance, risk, and operations to ensure seamless delivery of digital initiatives.</li>
 <li>Conduct market research, competitor analysis, and customer feedback sessions to identify new opportunities and areas for improvement in digital banking products.</li>
 <li>Oversee the implementation of user-centric design principles, ensuring top-tier customer experience across all digital touchpoints.</li>
 <li>Monitor product performance through data analytics and KPIs, and make data-driven recommendations for enhancements.</li>
 <li>Ensure products comply with all regulatory standards and internal governance frameworks.</li>
</ul>
<p> br&gt;
</p>

Digital Banking Products Lead

Search 10000+ Big data lead jobs near you this November. New roles added regularly across leading industries. Apply today.