Friday 14:35–16:10 in Auditorium

Deep learning tutorial - advanced techniques

Geoffrey French, Calvin Giles

Audience level:
Experienced

Description

Some of the more advanced deep learning to help you get the best out of it in a practical setting. The main focus is on computer vision and image processing.

Abstract

In the last few years, deep neural networks have been used to generate state-of-the-art results in image classification, segmentation and object detection. They have also successfully been used for speech recognition.

In this tutorial we build on the basics, demonstrating some useful techniques that are useful in a practical setting. Along with tips and tricks found to be useful, we will discuss the following:

  • active learning; train a neural network using less training data
  • using pre-trained networks; using the body of a pre-trained network (e.g. an ImageNet network) and re-using it for localisation or locating objects not within the original training set
  • having fun with neural networks; some of the fun techniques that have been demonstrated in the last couple of years

Prior knowledge of deep learning, machine learning, linear algebra, a bit of calculus and the NumPy/SciPy stack would be helpful for participation. We will mainly focus on using the Theano toolkit along with the Lasagne neural network library.