Big Data Streaming Analytics with Scala and Spark

Use Spark to perform low latency computations through the use of efficient caching and iterative algorithms. Leverage the features of its shell for easy and interactive data analysis. Employ its fast batch processing and low latency features to process your real-time data streams and so on.
Learn via
Classroom/Virtual
Duration
2 days or 4 evenings
Level
Advance
Type
Course
  • Overview
  • Prerequisites
  • Learning Outcomes
  • What's included
  • Course Outline

Spark is one of the hottest Big Data technologies. The amount of data generated today by devices, applications and users is exploding. Therefore, there is a critical need for tools that can analyze large-scale data and unlock value from it. Spark is a powerful technology that meets that need. You can, for example, use Spark to perform low latency computations through the use of efficient caching and iterative algorithms; leverage the features of its shell for easy and interactive Data analysis; employ its fast batch processing and low latency features to process your real time data streams and so on.

Today’s most cutting-edge companies such as Apple, Netflix, Facebook, and Uber have deployed Spark at massive scale, processing petabytes of data to deliver innovations — from detecting fraudulent behavior to delivering personalized experiences in real-time — that are transforming every industry.

This course is suitable to professionals who are working or aim to work in analytics related roles in such departments as Data Science, Data Engineering, Applications Development, Customer Insight, Business Intelligence, IT, Finance, and so on.

Basic knowledge of SQL and some programming language is preferred yet not mandatory.

At the end of this course, you will be able to:
• Manage the basic and intermediate features of the Scala language
• Use User Defined Functions (UDF) in Spark SQL
• Use SQL language for interrogating Spark DataFrames / Datasets
• Apply transformations to a data stream and persist the resulting data in various formats and storages
• Find relationships in a graph data model
• Walk-away with a fully configured VM containing a single Spark node and related storage (Hadoop/Hive) and a collection of tips/best practices.

•Interactive training classes in 2 days (daytime timetable) or 4 evenings (evening timetable)
•Hands-on practice after the classes with a work-based assignment in 14-21 days
•Access to support by our mentors during the course period
•Pairview Certification for achieving this competency

Learning Goal: You will learn the main features of the Scala programming language which is also the language with which Apache Spark has been written, starting from the basic up to the usage of powerful operators for managing collections of data.
• Why Scala for Spark
• Using a Scala IDE
• Collections in Scala-Array & ArrayBuffer
…and more.

Learning Goal: Get started with the computation framework which tremendously boosted Hadoop performances: from a single node installation and configuration up to the understanding of Spark internals, the Resilient Distributed Dataset (RDD) along with using a notebook for development
• Introduction to Spark and its ecosystem
• Spark 2 vs Spark 3
• Spark Modes
…and more.

Learning Goal: Learn the Apache Spark module for structured data processing: from managing the various ingestion data formats to apply a schema to the DataFrame/Dataset to run advanced SQL queries
• DataFrames and Datasets, StructType class
• Data Sources: Generic Load/Save, Parquet Files, JSON/Avro files, txt/csv/tab files, Hive Tables, JDBC to other databases
• Schema Inference
…and more.

Learning Goal: You will get a practical understanding of Spark Streaming, which enables scalable, high-throughput, fault-tolerant stream processing of live data streams
• Introduction to Spark Structured Streaming Programming Model
• Bounded vs Unbounded Streaming
• Creating streaming DataFrames and Datasets
…and more.

Learning Goal: You will get introduced to Spark’s API for graphs and graph-parallel. A graph database is a database designed to treat the relationships between data as equally important to the data itself. It is intended to hold data without constricting it to a pre-defined model.
• The Property graph: Vertex and Edge
• Graph Operators
…and more.

What You Will Benefit From

Our expert knowledge and job-focused approach sets us apart in our quest to offer excellent services to our delegates and deliver on their career development goals.

Get Real Employable Skills

Our job-focused courses and quality curriculum is designed and taught by industry experts and highly experienced professionals, not academics, so you learn the high-impact skills that top companies want.

Gain Best Real-World Practices

Apply your skills in real time through interactive trainer-led practices during the classes, and after-class assignments. As you do so, you are empowered with the problem-solving skills and job market insights needed to capture most new job opportunities in this field or take your career to the next level.

Achieve Professional Certification

Obtain Pairview Certification for completing this course, recognised by many employers in the industry.

Personalised Support and Career Consultancy

You will have access to tailored support by our dedicated mentors while you learn and practise. Our mentors guide your learning and are focused on answering your questions, motivating you and keeping you on track. They also give you valuable advice on professional and career development.

What They Think

Great company with thorough professionals that will ensure the process you are taken through is seamless as they will work around the clock to cater to your needs. Highly recommend Pairview for those wishing to make a career change or enter the world of Analytics.

RT

The training was very effective in providing me with the essential skill set and experience that I was able to carry into my job applications. The live project was one of the key topics during my job interviews. Having gone through the project experience and being able to explain it well, I could prove my capabilities and get the

NKT

You’ll never get it wrong when you make the right choice of choosing Pairview programmes for individual and corporate training needs. They are fantastic and supportive, and they know the market, which makes them think ahead. I enjoyed their supportive training, real-time projects, and extra development and have remained a high-flyer.

David Mba

Analytics Specialist

As an immigrant without a formal UK qualification (though I had a degree from my home country), I applied for jobs with only rejections. I knew about Pairview and enrolled in their Data Analytics programme. Their trainers were exceptional. I began applying for jobs and got interviews for every application. It was like no time before I got an

OOA

Senior Data Analyst

I undertook the Insight Analyst programme and although the fee was high, it was worth paying for it. The training was so impactful, with hands-on practices and real-life business scenarios. Sometimes I asked them for help with a next-day interview, the consultant tried his best to prep me that night. I am now an Insight Analyst, all thanks to

EK

Insight Analyst

I discovered Pairview and did their Data Scientist Programme, which was one of the best decisions of my life. I have now been offered a Data Analyst job and I have a new career in IT to look forward to. This programme has literally transformed my life. I learned cutting edge technology and the tutors genuinely care about me

Peter Twiggs

Data Analyst

Personalised Career Development Add-ons

We provide Add-on Services customised for your needs at every step of your learning journey to ensure your success.

  • Project-based Work Experience
  • CV Surgery
  • Placement Support
  • Recruitment Coaching

Gain indispensable experience with our projects

Gain work experience by undertaking real-world projects deriving from our consultancy work with global corporate clients. You will work on some of the most popular problems faced by businesses across industry sectors.

Learn by doing leads to real skills mastery and business acumen competency.

 

PROJECTS BY THE NUMBERS

92%+   of delegates completed their projects with Merit or Distinction

4.6+   service ratings

 

PROJECT SERVICES

  • 2 months of work experience
  • Assigned Project Manager for supervision and support
  • Weekly support sessions
  • Project presentation and personalised feedback
  • Unlimited submissions and feedback loops
  • Practical tips and industry best practices

Perfect your CV with our bespoke CV Surgery

Marketing yourself effectively to employers is critical so you can get the job you want for the best pay possible.

We will work with you personally on a one-to-one basis to perfect your CV. We will ensure it is a clear and accurate picture of your capabilities, is professionally written, and can capture interest of most recruiters and bring maximum opportunities of job interviews for your relevant roles.

 

CV SURGERY BY THE NUMBERS

100%   of final CVs captured job opportunities in the first few days

4.9+   service ratings

 

CV SURGERY SERVICES

  • One personalised review and edit
  • Various templates sourced from successful job placements
  • Resume optimisation tips

Have access to our extensive recruitment network

We help our corporate clients solve skill shortage challenges and provide talent security in the hardest to find skill sets on the market. Gain access to the best job opportunities within our extensive recruitment network and channels.

 

PLACEMENT SUPPORT BY THE NUMBERS

98%+   of delegates got jobs or progressed their career upon completion

4.7+   service ratings

 

PLACEMENT SUPPORT SERVICES

  • Personal assistance in your job search
  • Job opportunities from our corporate partners
  • 1-on-1 calls
  • Helps expand your professional network

Maximise your job opportunities and salary negotiation

Our Recruitment Consultant will help you target the most potential, relevant job opportunities across all available channels for job interviews and provide you with all the necessary interview preparation and techniques to enable you to successfully manage interviews and salary negotiations.

The Consultant will cover responses to those awkward or sensitive questions you may be asked and work with you to increase your level of personal impact and credibility at referral meetings and interviews through role play and practice. You will learn to project what you have to offer calmly and with confidence.

 

RECRUITMENT COACHING BY THE NUMBERS

98%+   of delegates got jobs or progressed their career upon completion

4.7+   service ratings

 

RECRUITMENT COACHING SERVICES

  • Weekly recruitment consultancy sessions
  • Personalized feedback and career guidance
  • Demystifying the hiring process for you
  • Advice on recruitment tests
  • Advice on interview questions and techniques
  • Advice on negotiating job offers
priscilla-du-preez-XkKCui44iM0-unsplash

Big Data Streaming Analytics with Scala and Spark

$1,618.00$1,906.38

Choose a learning option and start date to view further information and payment details below.
We are just a click away if you need any assistance
Clear

Contact Us!

Have enquiries of a course/programme? Want a career consultation? Or look for bespoke training?

Let’s start a conversation!

All Rights Reserved © 2020

Welcome Back, We Missed You!

Download Now

Please fill out this form to view the brochure