Big Data Crash Course

This course is the perfect blend of exploring the expedition of various Big Data Technologies such as Hadoop, Spark, Nifi, Apache Kafka, etc, and hands-on experience using Google Cloud Platform.

$14.95 / MONTH SITE SUBSCRIPTION (W/ 14 DAY FREE TRIAL) $149.95 / YEAR SITE SUBSCRIPTION (W/ 14 DAY FREE TRIAL)

Course curriculum

1. About this course: Overview, Learning Outcomes, Who Should Enroll...
1. Segment - 01 - Course Structure and Approach
2. Segment - 02 - Course Pre-requisites
3. Segment - 03 - Course Outcomes
1. Segment - 04 - Google Cloud Account Setup
2. Segment - 05 - Creating a Dataproc Cluster
3. Segment - 06 - GCP Account Best Practices
4. Segment - 07 - Twitter Developer Account Setup
1. Segment - 08 - Definition of Big Data
2. Segment - 09 - Data Lake Overview
3. Segment - 10 - Key Roles in Big Data Science Project
4. Segment - 11 - Big Data Logical Architecture
5. Segment - 12 - Typical Big Data Pipeline
6. Segment - 13 - Hadoop Overview
7. Segment - 14 - Bonus Demystifying JVM vs JDK vs JRE
1. Segment - 15 - HDFS Overview
2. Segment - 16 - Small FS vs HDFS
3. Segment - 17 - HDFS Architecture
4. Segment - 18 - Hands-on HDFS
1. Segment - 19 - Introduction to MR
2. Segment - 20 - Logical & Physical Architecture of MR
3. Segment - 21 - YARN (Distributed OS)
4. Segment - 22 - YARN Architecture
5. Segment - 23 - Hands-on Spark Job on YARN
1. Segment - 24 - RDBMS USPs & its Limitations
2. Segment - 25 - Polyglot Persistence
3. Segment - 26 - Why HBase and Limitations
4. Segment - 27 - HBase Terms
5. Segment - 28 - HBase Physical Storage
6. Segment - 29 - HBase Architecture
7. Segment - 30 - Installation HBase on DataProc cluster
8. Segment - 31 - Installing Confluent Kafka
9. Segment - 32 - KSQLDB Troubleshoot
10. Segment - 33 - Hands-on HBase
1. Segment - 34 - Sqoop Overview
2. Segment - 35 - Sqoop Architecture
3. Segment - 36 - Sqoop Installation
4. Segment - 37 - Hands-on Sqoop
1. Segment - 38 - Hive Overview
2. Segment - 39 - Hive Architecture
3. Segment - 40 - Impala Overview
4. Segment - 41 - Impala Architecture
5. Segment - 42 - Text vs Binary Data Formats
6. Segment - 43 - Avro Format
7. Segment - 44 - Hive Hands-on
8. Segment - 45 - Hands-on Sqoop + Hive Integration
9. Segment - 46 - Hands-on Schema Evolution
1. Segment - 47 - Spark Overview
2. Segment - 48 - Spark Logical Architecture
3. Segment - 49 - Spark Physical Architecture
4. Segment - 50 - Spark Core Vs Spark SQL
5. Segment - 51 - Spark Execution Modes
6. Segment - 52 - Hands-on Spark on Jupyter
1. Segment - 53 - Introduction to Apache Kafka
2. Segment - 54 - Evolution of Kafka
3. Segment - 55 - Why Kafka?
4. Segment - 56 - Apache Kafka Vs Confluent Kafka
5. Segment - 57 - Kafka Architecture
6. Segment - 58 - Kafka Demo - Producer Consumer
1. Segment - 59 - NiFi Overview
2. Segment - 60 - NiFi UseCases
3. Segment - 61 - NiFi Limitations
4. Segment - 62 - NiFi Components and its Architecture
5. Segment - 63 - Hands-on NiFi Installation on GCP
6. Segment - 64 - Hands-on Twitter Data Ingestion Using Nifi Part 1
7. Segment - 65 - Hands-on Twitter Data Ingestion Using Nifi Part 2
8. Segment - 66 - Hands-on Twitter Data Ingestion Using Nifi Part 3
1. Segment - 67 - Conclusion

About this course

Free
68 lessons
9.5 hours of video content

Big Data Crash Course

Course curriculum

Welcome to the course!

Module 1: Overview

Module 2: Environment setup

Module 3: Getting Started with Big Data Journey

Module 4: Hadoop Filesystem

Module 5: Distributed Processing using MapReduce and Beyond

Module 6: Data Persistence in Big Database

Module 7: Data Ingestion using Sqoop

Module 8: Data Analysis using Hive Impala

Module 9: Data Processing using Spark

Module 10: Streaming Events through Kafka

Module 11: Building Dataflows using NiFi

Module 12: Epilogue

About this course