Company:
Expert In Recruitment Solutions
Location: Jersey City
Closing Date: 16/10/2024
Hours: Full Time
Type: Permanent
Job Requirements / Description
Big Data/Hadoop Systems Administrator
(Need local)
Jersey City, NJ - Hybrid
Must go onsite 2 days/week to Jersey City, NJ (not open to relocation)
lease include their LinkedIn profile *
Client is looking for:
-Hands on Cloudera Experience
-BCP disaster framework
-Must know how to run Cloudera environments
-Kafka experience and BDR (Backup Data Replication)
-CDP (Cloudera Data Platform) not CDH (Cloudera Distributed Hadoop) Experience
-Strong Linux & Linux 8 experience
-Security Active directory
-Kerberos, certificates & encryption
-Must have strong communication skills, if manager cannot make a meeting they will need to present
Job Description
Big Data/Hadoop Systems Administrator to support and administer the firms Big Data clusters. Big Data platform serves as the foundation for a key set of offerings running Cloudera's distribution. It is an opportunity for the candidate to gain both knowledge and experience with the most advanced data technology in a highly secured environment.
Responsibilities
Responsible for setting up environments and on-going administration of on-site physical Cloudera clusters (non-production, production, BCP/DR).
Management & support of Cloudera services including, but not limited to: HDFS, Hadoop, MapReduce, Hive/Impala, YARN, Solr, Kafka, Oozie & Spark using Cloudera Manager and command-line.
Cloudera BDR (Backup Data Replication) for HDFS and Kafka replication (SRM Streams Replication Manager)
Working closely with different systems groups (SysAdmins, Development), jointly work on key deliverables ensuring production scalability and stability.
Aligning with systems administrator's groups to deploy new software environments required for Hadoop and to expand/upgrade existing environments.
Integration support of tools that require connectivity to Hadoop ecosystem (BI tools, data ingestion tools, ETL/ELT tools, ODBC/JDBC, etc.)
Monitor Hadoop clusters connectivity and security.
Hands-on experience in SQL (Oracle) and NoSQL Databases (HBASE).
Develop and enhance platform best practices.
Stay in touch with latest technical developments. Keep up with best practices being followed in industry around Hadoop, Big Data, and Analytics.
Qualification (Education, Experience & Skills)
Bachelor's degree in Computer Science or a related technical field, or equivalent experience.
5+ years' experience supporting complex, large-scale Production environments.
Strong hands-on experience with Linux/UNIX administration, Red Hat Linux.
Strong experience administering Cloudera CDP (Cloudera Data Platform).
Strong experience configuring Kerberos and Certificate Keystores.
Strong experience in shell scripting and bash.
Excellent understanding of Active Directory/LDAP.
Experience with system backup and disaster recovery.
Experience with virtualization systems.
Experience in defining processes for one or more Production environments.
Experience in Agile development environment.
Cloudera Certified Administrator (CCA) or Cloudera Certified Professional (CCP) is desired.
Red Hat Certified System Administrator (RHCSA) or similar is desired.
Communication skills – both written and verbal.
Strong analytical and problem-solving skills.
Self-driven, ability to work independently and as part of a team.
(Need local)
Jersey City, NJ - Hybrid
Must go onsite 2 days/week to Jersey City, NJ (not open to relocation)
lease include their LinkedIn profile *
Client is looking for:
-Hands on Cloudera Experience
-BCP disaster framework
-Must know how to run Cloudera environments
-Kafka experience and BDR (Backup Data Replication)
-CDP (Cloudera Data Platform) not CDH (Cloudera Distributed Hadoop) Experience
-Strong Linux & Linux 8 experience
-Security Active directory
-Kerberos, certificates & encryption
-Must have strong communication skills, if manager cannot make a meeting they will need to present
Job Description
Big Data/Hadoop Systems Administrator to support and administer the firms Big Data clusters. Big Data platform serves as the foundation for a key set of offerings running Cloudera's distribution. It is an opportunity for the candidate to gain both knowledge and experience with the most advanced data technology in a highly secured environment.
Responsibilities
Responsible for setting up environments and on-going administration of on-site physical Cloudera clusters (non-production, production, BCP/DR).
Management & support of Cloudera services including, but not limited to: HDFS, Hadoop, MapReduce, Hive/Impala, YARN, Solr, Kafka, Oozie & Spark using Cloudera Manager and command-line.
Cloudera BDR (Backup Data Replication) for HDFS and Kafka replication (SRM Streams Replication Manager)
Working closely with different systems groups (SysAdmins, Development), jointly work on key deliverables ensuring production scalability and stability.
Aligning with systems administrator's groups to deploy new software environments required for Hadoop and to expand/upgrade existing environments.
Integration support of tools that require connectivity to Hadoop ecosystem (BI tools, data ingestion tools, ETL/ELT tools, ODBC/JDBC, etc.)
Monitor Hadoop clusters connectivity and security.
Hands-on experience in SQL (Oracle) and NoSQL Databases (HBASE).
Develop and enhance platform best practices.
Stay in touch with latest technical developments. Keep up with best practices being followed in industry around Hadoop, Big Data, and Analytics.
Qualification (Education, Experience & Skills)
Bachelor's degree in Computer Science or a related technical field, or equivalent experience.
5+ years' experience supporting complex, large-scale Production environments.
Strong hands-on experience with Linux/UNIX administration, Red Hat Linux.
Strong experience administering Cloudera CDP (Cloudera Data Platform).
Strong experience configuring Kerberos and Certificate Keystores.
Strong experience in shell scripting and bash.
Excellent understanding of Active Directory/LDAP.
Experience with system backup and disaster recovery.
Experience with virtualization systems.
Experience in defining processes for one or more Production environments.
Experience in Agile development environment.
Cloudera Certified Administrator (CCA) or Cloudera Certified Professional (CCP) is desired.
Red Hat Certified System Administrator (RHCSA) or similar is desired.
Communication skills – both written and verbal.
Strong analytical and problem-solving skills.
Self-driven, ability to work independently and as part of a team.
Share this job
Useful Links