Course Outline
Introduction
Overview of Apache Spark Features and Architecture
- Apache Spark modules: Spark SQL, Spark Streaming, MLlib, GraphX
- RDD, Dataframes, drive-workers, DAG, etc.
Setting up Apache Spark on .NET
- Preparing the Java VM
- Running .NET for Apache Spark using .NET Core
Getting Started
- Creating a sample .NET console application
- Adding the Spark driver
- Initializing a SparkSession
- Executing the application
Preparing Data
- Building a data preparation pipeline
- Performing ETL (Extract, Transform, and Load)
Machine Learning
- Building a machine learning model
- Preparing the data
- Training a model
Real-time Processing
- Processed streaming data in real-time
- Case study: monitoring sensor data
Interactive Query
- Working with Spark SQL
- Analyzing structured data
Visualizing Results
- Plotting results
- Using third-party tools to visualize results
Troubleshooting
Summary and Conclusion
Requirements
- .NET programming experience using C# or F#
Audience
- Developers
Testimonials (11)
I liked that it was practical. Loved to apply the theoretical knowledge with practical examples.
Aurelia-Adriana - Allianz Services Romania
Course - Python and Spark for Big Data (PySpark)
A lot of practical examples, different ways to approach the same problem, and sometimes not so obvious tricks how to improve the current solution
Rafał - Nordea
Course - Apache Spark MLlib
This is one of the best hands-on with exercises programming courses I have ever taken.
Laura Kahn
Course - Artificial Intelligence - the most applied stuff - Data Analysis + Distributed AI + NLP
Just the overall exposure. Very helpful.
Travis - Beckman Coulter
Course - Introduction to Blazor
The trainer was very helpful answering any questions we had and let us share our screen to show the errors we were having which was great.
chithra - Public Health Wales NHS Trust
Course - Advanced Blazor
Question and answer. And project demonstration.
Qing - Ametek
Course - Implementing the Actor Model with Microsoft Orleans
It took up good stuff with a good speed, and not stayed in areas that was not important, left that to the student when the course was over. I mean that for a 2 day course it is a good value.
Mikael Forsberg - Kvadrat Örebro AB
Course - Introduction to .Net Core
The trainer explained the subjects very good with actual examples from real world which made it simpler for us to grasp the information
Florin-Viorel Marut - Continental Automotive Romania
Course - High-Performance Application Development with .NET Core
Very hands on knowledge on the subject. A little bit of theory at the beginning to set the stage.
Thibault Chappuis - Mikron SA Boudry
Course - Entity Framework Core 2.0
Time management of the training. Allocated time of training was well-spent and maximized.
Edgar Caguioa - ANALOG DEVICES GEN. TRIAS, INC.
Course - Visual Studio with VB.Net
I appreciated Folio's wide breadth of knowledge. Not only was he familiar with the course content, but he also knew of constructs in languages we were familiar with to make examples more meaningful to us. During intervals he shared his knowledge of technologies and solutions outside the training scope to provide insights into other solutions we could use in future (and future training).