Introduction to User Experience

Spark Framework is Polyglot- can be programmed in several programming languages and along with the scattered big data all over the web. This Scala tutorial using spark is the best any programmer can get by just a click from their couch. The course will be accompanied by industry experts with your ease of time.

Introduction to Big Data, Hadoop and Spark

  • Overview of Big Data
  • Introduction to Apache Hadoop
  • Hadoop Distributed File System
  • Hadoop mapreduce
  • Introduction to Apache Spark, Characteristics and use cases
  • Spark Unified Stack
  • Apache Spark architecture
  • Introduction to Scala Programming language

    <

  • Introduction to Scala and Basic Syntax
  • Classes and Objects
  • If else Statements
  • Loops in Scala
  • Advanced Scala Programming

  • Functions and Procedures
  • Access Modifiers
  • Strings and Arrays
  • Scala Collections
  • Classes and Objects

  • Scala Traits
  • Pattern Matching
  • Exception Handling and files I/O
  • Apache Spark RDDs'

  • Programming with RDDs'
  • Starting with Spark
  • Creating RDDs'
  • RDD Operations
  • Lifecycle of Spark
  • Spark Caching
  • Common Tranformations and Actions
  • Spark Functions
  • Working with key-value Pairs

  • Key-value Pairs
  • Aggregrate Functions
  • Joins in Spark
  • Advanced Spark Programming

  • Spark shared variables
  • Fault tolerance
  • Broadcast variables
  • Numeric RDD Operations
  • Executors and Drivers
  • Cluster Managers
  • Spark SQL

  • Introduction to SQL Context
  • Hive with Spark SQL
  • SQL Caching
  • Machine Learning in Spark

  • Machine learning with MLlib
  • Data types: Labelled points and Local Matrices
  • MLib Algorithms
  • Classification and Regression
  • Clustering
  • GraphX in Spark

  • Creating Graphs
  • Graph Operators
  • Subgraph Transformations
  • Computation with Map reduce triplets