Summary:
Seeking an experienced Hadoop Admin / SRE to support NextGen platforms built on Big Data technologies such as Hadoop, Spark, Kafka, Impala, HBase, Docker, Ansible, and more. The role focuses on cluster management, platform operations, and DevOps across tools like Cloudera, Jupyter, DataRobot, ELK, and others.
Key Responsibilities:
- Manage Cloudera Hadoop and AI/ML platforms in all environments (upgrades, monitoring, deployments, disaster recovery).
- Administer Docker, OpenShift, Jupyter, and containerized platforms.
- Act as SME for Hadoop ecosystem, including Kafka, Spark, Impala, Hive, HBase, etc.
- Handle incident/problem management, performance tuning, and capacity planning.
- Collaborate with developers, vendors, and stakeholders for end-to-end platform solutions.
Required Skills:
- Strong knowledge of Hadoop architecture, HDFS, Kerberos/AD authentication.
- Experience analyzing Hadoop logs, tuning YARN, and configuring clusters.
- Expertise in Cloudera tools (HDFS, Kafka, Hive, HBase, Impala, Hue, SOLR, etc.).
- Proficient in Unix/Linux, Java, Python, Shell/Perl scripting.
- Familiarity with DevOps tools: Ansible, Jenkins, Bitbucket, SVN.
- Experience with job scheduling, monitoring, and automation.
- Hands-on with databases: Sybase, SQL, Oracle.
Certifications Preferred:
- Cloudera Admin / Dev
- Cloud, Docker, and OpenShift technologies