Course Overview
This Hadoop for Systems Administrators course covers the essentials of deploying and managing an Apache™ Hadoop® cluster. The course is lab intensive, with each student creating their own Hadoop cluster using either the CDH (Cloudera’s Distribution, including Apache Hadoop) or Hortonworks Data Platform stacks. Core Hadoop services are explored in depth with emphasis on troubleshooting and recovering from common cluster failures.
Supported Distributions: Red Hat Enterprise Linux 7
What you’ll learn
Upon completion of the Hadoop for Systems Administrators course, students will be able to:
- Create Hadoop clusters
- Troubleshoot and recover cluster failures
Requirements
- Qualified participants should be comfortable with the Linux commands and have some systems administration experience, but do not need previous Hadoop experience
Target audiences
- System Administrator
Curriculum
- 1 Section
- 10 Lessons
- 3 Days
Expand all sectionsCollapse all sections
- Topics10
- 1.1HADOOP OVERVIEW Data Analysis Big Data Origins of Hadoop Hadoop Marketplace Hadoop Core Hadoop Ecosystem: Hadoop Ecosystem (cont) Hadoop Ecosystem (cont) Hadoop Ecosystem (cont) Hadoop Ecosystem (cont) Cluster Architecture Hardware/Software Requirements Running Commands on Multiple Systems Lab Tasks Running Commands on Multiple Hosts Preparing to Install Hadoop
- 1.2HDFS Design Goals Design Blocks Block Replication Namenode Daemon Secondary Namenode Daemon Datanode Daemon Accessing HDFS Permissions and Users Adding and Removing Datanodes Balancing Lab Tasks Single Node HDFS Multi-node HDFS Files and HDFS Managing and Maintaining HDFS
- 1.3YARN YARN Design Goals YARN Architecture Resource Manager Node Manager Containers YARN: Other Important Features Slider Lab Tasks YARN
- 1.4MAPREDUCE MapReduce Terminology and Data Flow Lab Tasks Mapreduce
- 1.5DATA INGESTION Sqoop Flume Kafka Lab Tasks Sqoop
- 1.6INSTALLING HADOOP WITH AMBARI LAB TASKS CDH Uninstall Installing Hadoop with Ambari Tez
- 1.7DATA PROCESSING FRAMEWORKS The Bane of MapReduce Tez overview Pig Hive Spark Storm Solr Solr (cont) Lab Tasks Pig
- 1.8DATA LINEAGE AND GOVERNANCE Falcon Atlas Oozie
- 1.9CLUSTER MANAGEMENT Ambari Metrics System (AMS) Zookeeper
- 1.10NOSQL IMPLEMENTATIONS HBase Phoenix
Instructor
