Big Data Engineer

Presently we are unable to sponsor and request applicants to apply who are authorized to work without sponsorship*

Employment TYPE: Contract W2 - NO C2C

Job Title: Big Data Engineer

Location: Wilmington, DE - Onsite

About BCforward

BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.

Job Description

We are seeking a Big Data Engineer to join our team. The ideal candidate will have strong experience in Java/J2EE development, Agile delivery, and CI/CD practices and a proven ability to design, build, test, deploy, and maintain secure, resilient applications .

Responsibilities:

- Design, develop and maintain scalable and large-scale data processing pipelines and infrastructure on the cloud following engineering standards, governance standards and technology best practices

- Develop and optimize data models for large-scale datasets, ensuring efficient storage, retrieval, and analytics while maintaining data integrity and quality.

- Collaborate with cross-functional teams to translate business requirements into scalable and effective data engineering solutions.

- Demonstrate a passion for innovation and continuous improvement in data engineering, proactively identifying opportunities to enhance data infrastructure, data processing and analytics capabilities.

Required Skills & Qualifications:

- Strong analytical problem solving and critical thinking skills

- Proficiency in at least one programming language ( Python, if not Java or Scala)

- Proficiency in at least one distributed data processing framework ( Spark or similar)

- Proficiency in at least one cloud data Lakehouse platforms (AWS Data lake services or Databricks, alternatively Hadoop),

- Proficiency in at least one scheduling/orchestration tools ( Airflow, if not AWS Step Functions or similar)

-Proficiency with relational and NoSQL databases.

- Proficiency in data structures, data serialization formats (JSON, AVRO, Protobuf, or similar), and big-data storage formats (Parquet, Iceberg, or similar),

-Experience working in teams following Agile methodology

- Experience with test-driven development (TDD) or behavior-driven development (BDD) practices, as well as working with continuous integration and continuous deployment (CI/CD) tools.

Preferred Skills:

• Experience with cloud platforms and related services.
• Exposure to test automation and performance engineering.