Job Role: Data Engineer
Location: India
Experince: 3 Yrs
Role Summary: Experienced Data Engineer with a strong background in working with large sets of data, data warehousing tools, and software development methodology. In this role, you’ll participate directly in designing, building, and maintaining our data infrastructure, data products, and collaborating with operations and product management teams to ensure business success and pursue new product opportunities..
Key Responsibilities:
Design, develop, and maintain scalable data workflows and pipelines using big data technologies, including Map/Reduce, Spark, Databricks and Acxiom proprietary tools
Collaborate with data analysts, product managers, and other stakeholders to understand and develop product requirements
Tune workflows to enhance processing efficiency and optimize use of resources
Write well-crafted, tested, readable, and maintainable code
Participate in code reviews to ensure code quality and distribute knowledge
Drive innovation. Stay up to date with advancements in data engineering tools, cloud services, and generative AI; seeking opportunities to drive leaps in value creation for Acxiom’s clients
Requirements:
Bachelor's (or better) degree in Computer Science, Engineering, Information Systems, or a related field
1 year of prior experience in data engineering, Databricks experience preferred.
Proficiency in Python / PySpark
Proficiency with big data technologies including SQL, Spark, Hadoop
Experience designing data models to optimize storage and retrieval
Experience working with AWS based solutions
Experience with CICD (shift left) development practices
Strong problem-solving skills and a commitment to excellence
Strong written and oral communication skills with an ability to work collaboratively in a fast-paced, team-oriented environment
Bonus Points:
Prior experience with IaC and Terraform
Prior experience developing in Scala
ML skills and experience deploying AI models into solutions