Developer

Role: Big Data/Spark/Scala

Exp:5-10 years

Location: Bangalore, Bhubaneswar, Pune

Job Responsibilities:

Design, build, and maintain scalable big data pipelines for processing and analyzing large datasets using Spark, Airflow, Bodo, Flume, Flink, etc.

• Utilize technologies like Hadoop, Spark, Kafka, and NoSQL databases.

• Develop data ingestion, transformation, and aggregation strategies.

• Design and implement data warehouses and data marts using Presto, Snowflake, or similar technologies.

• Create efficient data models and schemas for optimal query performance.

• Great to have an understanding of graph query (GQL), Gremlin, Cypher, etc.

• Know to build business system-engineering architectures using graphs, how to scale the workload on distributed systems.

• Hands on experience applying graphs for business impact, including experience on data management, infrastructure, budgeting, trade-offs, project workflow management, and business processes engineering.

• Strong programming skills: Python/Scala/Rust for Supercomputing on TB+ data.

• Experience with creating quantitative analytics and business operation dashboards using Tableau, SuperSet or other visualisation tools.

• Experience with data mining, relational and noSQL databases, and data warehouse for data automation.

• Experience working with large language model and natural language processing is a plus.

• Excellent problem solving, critical thinking backed by expert understanding of probability, statistics, algorithms and mathematics.

• Be able to strategize and innovate business solutions for high impact projects.

• Be able to evaluate and transform latest, untested academic methods into production workflows.

• Self-driven, highly motivated and ability to work both independently and within a team.

- Operate optimally in fast pace development environment with dynamic changes, tight deadlines and limited resources