Big Data Analytics (BDA)

Introduction to Big Data

Syllabus Overview

Introduction to Big Data

Importance of Big Data

GLIMPSE of Big Data Analytics

The Hadoop Distributed Files System (HDFS)

MapReduce

Glimpse of MapReduce

Implement Word Count Application using MapReduce on Single Node Cluster

NoSQL Databases

NoSQL Databases – Detailed Overview

GLIMPSE of NoSQL databases

Review of Traditional Databases

NoSQL – Introduction

Need for NoSQL Databases

Columnar Databases

Failover and Reliability Principles

CAP Theorem

Differences between SQL and NoSQL databases

Types of NoSQL Databases

Advantages & Disadvantages of NoSQL

Impact of NoSQL on Data Science

Commonly used NoSQL Databases

Working mechanisms of MongoDB

Glimpse of MongoDB

MongoDB- Overview

MongoDB – Advantages | Environment

MongoDB – Installation on Windows

MongoDB – Create & Drop Database

MongoDB- Create & Drop Collection

MongoDB – Data Types

APACHE PIG

Glimpse of Apache Pig

Apache Pig – Introduction by Sri K. Gangadhar Rao

Apache Pig – Installing and Running Pig by Sri K. Gangadhar Rao

Working with Pig Latin for implementing the Word Count application

APACHE HIVE

GLIMPSE of Apache HIVE

GLIMPSE of Hive Query Language (HiveQL)

Introduction to Spark

Spark: What is Apache Spark | Spark’s Basic Architecture | Data Frames | Transformations | Actions | An End-to-End Example

GLIMPSE of Apache Spark

Spark’s Toolset

Running Production Applications | Datasets | Structured Streaming | Machine Learning and Advanced Analytics | Lower-Level APIs | SparkR | Spark’s Ecosystem and Packages

Spark SQL

Big Data and SQL | How to Run Spark SQL Queries | Catalog | Tables | Views | Databases | Select Statements

Datasets

Spark Datasets – When to Use Datasets | Creating Datasets | Actions | Transformations

Resilient Distributed Datasets (RDD)

RDD – Creating RDDs | Manipulating RDDs | Transformations | Actions | Saving Files | Caching | Check pointing | Pipe RDDs to System Commands