Hello All Machine Learning Enthusiasts,

Recently, my new course on machine learning “Advanced Machine Learning With ENCOG ” got published on Pluralsight.com. Although the course is targeted for ENCOG users , but the concepts discussed in this course are widely applicable in other frameworks also. This advanced level course is segregated in multiple parts.

This first part is available here.

Here is the table of contents for the first part of the course :

**Module 1 (Course Introduction ):** This module will provide an overview of this course and why one should take this course. This module will also describe the scope of this course. There is also a quick recap clip inside this module, which will help you to brush up the basics before delving into the advanced topics of machine learning.

Module clips are as follows :

- Introduction
- Course Scope
- Course Structure
- Quick Recap
- Summary

**Module 2 (Network Tuning Part 1)** : This module will be focused on various network tuning techniques to improve the accuracy of neural network predictive models. Network Tuning module has been divided into two parts. In the Part 1, We will look at network size tuning using pruning process. We will also discuss the need of such tuning. We will take a C# WPF application demo to understand network size optimization and how it can be used to solve the major problems of underfitting and overfitting.

Module clips are as follows :

- Introduction
- Outline
- Network Tuning
- UnderFitting And Overfitting
- Selection of layers and neurons
- Why Network Pruning ?
- About Pruning
- ENCOG support for Pruning
- Training ,Cross Validation and Test dataset
- Demo Introduction
- Demo : XAML Code
- Demo : Core Steps-Shuffle, Segregate, Normalize And Prune
- Demo : Core Steps-Train
- Demo : Observations
- Summary

**Module 3 (Network Tuning part 2) :** In the first part, we looked at the requirement of network tuning and we talked in detail about two issues of learning process, first was underfitting and second was overfitting. And we had discussed the network size optimization using the pruning process to address these two key issues.In this module, we will take another aspect of network tuning, which is to tune the training process itself. We will look at various strategies and how ENCOG machine learning framework can help us to implement these strategies.

Module clips are as follows :

- Introduction
- Outline
- Training Process Tuning
- ENCOG Training Strategies
- Greedy Strategy
- Demo : Greedy Strategy
- Hybrid Strategy
- Demo : Hybrid Strategy
- Reset Strategy
- Demo : Reset Strategy
- Required Improvement Strategy
- Demo : Required Improvement Strategy
- Smart Learning Rate and Smart Momentum Strategy
- Demo : Smart Learning Rate and Smart Momentum Strategy
- StopTrainingStrategy
- Demo : Basic Stop Strategies
- Demo : StopTrainingStrategy
- EarlyStoppingStrategy
- Demo : EarlyStoppingStrategy
- Summary

**Module 4 (Neural Network Architectures Overview) :** This module will provide an overall picture of various ENCOG Supported neural network architectures .This module will outline the reasons of co-existence of so many neural network architectures. Finally we will try to map different neural network architectures in different categories using an architectural map.

Module clips are as follows :

- Introduction
- Outline
- Type of Network Covered
- Why So Many ?
- Architectural Tree
- Summary

**Module 5 ( Feed Forward Network – Part 1):** This is the first part of the Feed forward networks, in which we will learn about linear neural networks. We will start with learning the concept of linear and non-linear problems. Then we will take two linear neural networks, Adaline and Linear Perceptron. We will also learn to implement these linear networks using ENCOG framework.

Module clips are as follows :

- Introduction
- Outline
- Feed forward Networks
- Input Output Mapping
- Linear Versus Non-Linear” Linear Neural Networks
- Adaline Network
- Adaline Network in ENCOG
- Demo : Adaline Network
- Perceptron Network
- Perceptron Network in ENCOG
- Demo : Perceptron Network
- Summary

**Module 6 (Feed Forward Network – Part 2) :** This is the second part of the Feed forward networks, in which we will learn about non-linear neural networks.We will take two non-linear neural networks, Multi Layer Perceptron and Radial Basis Function Network. We will also learn to implement these non-linear networks using ENCOG framework. We will also look at few of the real world applications of feedforward networks.

Module clips are as follows :

- Introduction
- Outline
- Non-Linear Neural Networks
- Multi Layer Perceptron
- Multi Layer Perceptron in ENCOG
- Demo : MLP Network
- RBF (Radial Basis Function) Network
- Radial Basis Function Calculation
- RBF Network Implementation
- XOR Problem using RBF
- Basic RBF Network Implementation
- RBF Network in ENCOG
- Demo : RBF Network
- Applications of Feedforward Networks
- Summary

**Module 7 (Feedback Networks) :** This module will provide an overview of feedback networks and its properties. We will learn in detail about two simple recurrent networks in this module, first one is the ELMAN network and second is JORDAN network. We will also look at real world applications of feedback networks. We will also take few C# demos to learn the implementation of feedback networks using ENCOG machine learning framework.

Module clips are as follows :

- Introduction
- Outline
- Feedback Network
- Elman Network
- Temporal XOR Problem
- Elman Network Training
- Elman Network in ENCOG
- Demo : Elman Network
- Jordan Network
- Jordan Network in ENCOG
- Demo : Jordan Network
- Applications of Recurrent Networks
- Summary

**Module 8 (Course Summary) :**This module will provide a quick summary to this advanced level course. We will also look at a short glimpse of the next course.

Module clips are as follows :

- Introduction
- Summary
- Next Course Glimpse

Finally, I would also like to mention two great books written by Jeff Heaton. This are great ebooks and must have for all ENCOG users.

- Programming Neural Networks with Encog3 in C#, 2nd Edition by Heaton, Jeff (Oct 2, 2011)
- Introduction to Neural Networks for C#, 2nd Edition by Jeff Heaton (Oct 2, 2008)

Hi, when your next level course of Advance Machine learning is expected to release ?

I have completed the course, its in production pipeline. It will be live pretty soon.

Hi! I just finished your introduction course on Pluralsight for Encog, and I started the advanced course. I was wondering if you would release another Encog course on Optimization techniques of Encog, or maybe a course that just makes a brief survey of the most important techniques, to help to know which one fits best for a given problem. Thanks!

Hi !! First of all, thanks for viewing my course. I hope it helped you a little bit. And Yes, I am coming up with my next course on Pluralsight, in which I will talk about unsupervised learning with self organizing map for dimensionality reduction and clustering, pattern recall and reconstruction using hopfield network, time series forecasting, and optimization using genetic algorithm.

I have completed this course already, and its under production process.So, I will be live pretty soon. So stay tuned and keep giving feedback.