Master Flume, Sqoop, Hive for Big Data Ingestion & Analytics (Updated)

[mitsumi]

Master Flume, Sqoop, Hive for Big Data Ingestion & Analytics (Updated)
.MP4 | Video: 1280x720, 30 fps(r) | Audio: AAC, 44100 Hz, 2ch | 1.75 GB
Duration: 3 hours | Genre: eLearning Video | Language: English

Complete course on Sqoop, Flume & Hive- Great for CCA175 & Hortonwork Spark Certification preparation.

What you'll learn

    Hadoop distributed File system and commands. Lifecycle of sqoop command. Sqoop import command to migrate data from Mysql to HDFS. Sqoop import command to migrate data from Mysql to Hive. Working with various file formats, compressions, file delimeter,where clause and queries while importing the data. Understand split-by and boundary queries. Use incremental mode to migrate the data from Mysql to HDFS. Using sqoop export, migrate data from HDFS to Mysql. Using sqoop export, migrate data from Hive to Mysql. Understand Flume Architecture. Using flume, Ingest data from Twitter and save to HDFS. Using flume, Ingest data from netcat and save to HDFS. Using flume, Ingest data from exec and show on console. Flume Interceptors.

Requirements

    Cloudera vm installation if you want to run examples.

Description

In this course, you will start by learning what is hadoop distributed file system and most common hadoop commands required to work with Hadoop File system.

Then you will be introduced to Sqoop Import

    Understand lifecycle of sqoop command.

    Use sqoop import command to migrate data from Mysql to HDFS.

    Use sqoop import command to migrate data from Mysql to Hive.

    Use various file formats, compressions, file delimeter,where clause and queries while importing the data.

    Understand split-by and boundary queries.

    Use incremental mode to migrate the data from Mysql to HDFS.

Further, you will learn Sqoop Export to migrate data.

    What is sqoop export

    Using sqoop export, migrate data from HDFS to Mysql.

    Using sqoop export, migrate data from Hive to Mysql.

Further, you will learn about Apache Flume

    Understand Flume Architecture.

    Using flume, Ingest data from Twitter and save to HDFS.

    Using flume, Ingest data from netcat and save to HDFS.

    Using flume, Ingest data from exec and show on console.

    Describe flume interceptors and see examples of using interceptors.

    Flume multiple agents

    Flume Consolidation.

Finally, we will start with our last section about Apache Hive

    Hive Intro

    External & Managed Tables

    Working with Different Files - Parquet,Avro

    Compressions

    Hive Analysis

    Hive String Functions

    Hive Date Functions

    Partitioning

    Bucketing

Who this course is for:

    Who want to learn sqoop and flume or who are preparing for CCA                                                                                                                                                                                                and HDPCD certifications
             

               

Download link:

Só visivel para registados e com resposta ao tópico.

Only visible to registered and with a reply to the topic.

Links are Interchangeable - No Password - Single Extraction