BI Technical Expert

About the role:

The BI Technical Expert is responsible for the deployment, configuration, monitoring, and maintenance of enterprise-grade data platforms including Cloudera (CDP) , Confluent Kafka , Apache NiFi , RabbitMQ , and Starburst Enterprise . This role ensures the reliability, scalability, and security of data pipelines and distributed query engines supporting real-time and batch analytics across the organization.

Responsibilities:

• Manage Hadoop ecosystem components (HDFS, Hive, Impala, Spark)
• Monitor and optimize cluster performance using Cloudera Manager
• Implement security (Kerberos, Ranger) and perform upgrades
• Design and manage data flows for ingestion and transformation
• Monitor flow performance and ensure secure data movement
• Integrate with Kafka, HDFS, S3, and relational databases
• Deploy and manage RabbitMQ clusters and plugins
• Configure queues, exchanges, and user permissions
• Monitor broker health and implement HA and DR strategies
• Deploy and manage Starburst Enterprise clusters
• Configure catalogs for data sources (Hive, Iceberg, Delta Lake, RDBMS)
• Optimize distributed SQL queries and manage resource groups
• Implement access control, query auditing, and data governance policies

Required Skills & Qualifications:

• Bachelor’s degree in computer science, Engineering, or related field
• 4+ years of experience in System administration
• 4+ years of experience in Data Platform Administration.
• Strong Linux administration and scripting (Bash, Python)
• Experience with distributed systems, SQL engines, and messaging platforms
• Familiarity with monitoring tools (Prometheus, Grafana, Cloudera Manager)

Preferred Certifications:

• Cloudera Certified Administrator (CCA)
• Confluent Certified Administrator
• Apache NiFi Certification
• RabbitMQ Certified Expert
• Starburst or Trino/Presto Certification