Skip to content

leriomaggio/deep-learning-keras-tensorflow

Folders and files

NameName
Last commit message
Last commit date

Latest commit

e8c5a10 · May 5, 2017
May 5, 2017
Apr 12, 2017
May 5, 2017
May 5, 2017
May 5, 2017
May 5, 2017
May 5, 2017
May 5, 2017
May 5, 2017
Apr 12, 2017
Apr 12, 2017
May 5, 2017
Apr 26, 2017
Apr 26, 2017
Apr 13, 2017
May 5, 2017
May 5, 2017
Apr 13, 2017
Apr 8, 2017
Apr 20, 2017
Apr 8, 2017
Apr 13, 2017
Apr 11, 2017
Apr 8, 2017
Apr 12, 2017
Apr 12, 2017

Repository files navigation

Deep Learning with Keras and Tensorflow


Author: Valerio Maggio

PostDoc Data Scientist @ FBK/MPBA

Contacts:

@leriomaggio +ValerioMaggio
valeriomaggio vmaggio_at_fbk_dot_eu
git clone https://github.com/leriomaggio/deep-learning-keras-tensorflow.git

  • Part I: Introduction

    • Intro to Deep Learning and ANN

      • Perceptron and MLP
    • naive pure-Python implementation

      • fast forward, sgd, backprop
    • Intro to Tensorflow

      • Model + SGD with Tensorflow
    • Introduction to Keras

      • Overview and main features
        • Keras Backend
        • Overview of the core layers
      • Multi-Layer Perceptron and Fully Connected
        • Examples with keras.models.Sequential and Dense
        • HandsOn: FC with keras
  • Part II: Supervised Learning and Convolutional Neural Nets

    • Intro: Focus on Image Classification

    • Intro to ConvNets

      • meaning of convolutional filters
        • examples from ImageNet
      • Visualising ConvNets
    • Advanced CNN

      • Dropout
      • MaxPooling
      • Batch Normalisation
    • HandsOn: MNIST Dataset

      • FC and MNIST
      • CNN and MNIST
    • Deep Convolutiona Neural Networks with Keras (ref: keras.applications)

      • VGG16
      • VGG19
      • ResNet50
    • Transfer Learning and FineTuning

    • Hyperparameters Optimisation

  • Part III: Unsupervised Learning

    • AutoEncoders and Embeddings
    • AutoEncoders and MNIST
      • word2vec and doc2vec (gensim) with keras.datasets
      • word2vec and CNN
  • Part IV: Recurrent Neural Networks

    • Recurrent Neural Network in Keras
      • SimpleRNN, LSTM, GRU
  • PartV: Additional Materials:

    • Quick tutorial on theano
    • Perceptron and Adaline (pure-python) implementations
    • MLP and MNIST (pure-python)
    • LSTM for Sentence Generation
    • Custom Layers in Keras
    • Multi modal Network Topologies with Keras
  • Wrap up and Conclusions


Requirements

This tutorial requires the following packages:

(Optional but recommended):

The easiest way to get (most) these is to use an all-in-one installer such as Anaconda from Continuum. These are available for multiple architectures.


Python Version

I'm currently running this tutorial with Python 3 on Anaconda

!python --version
Python 3.5.2

Setting the Environment

In this repository, files to re-create virtual env with conda are provided for Linux and OSX systems, namely deep-learning.yml and deep-learning-osx.yml, respectively.

To re-create the virtual environments (on Linux, for example):

conda env create -f deep-learning.yml

For OSX, just change the filename, accordingly.

Installing Tensorflow

To date tensorflow comes in two different packages, namely tensorflow and tensorflow-gpu, whether you want to install the framework with CPU-only or GPU support, respectively.

For this reason, tensorflow has not been included in the conda envs and has to be installed separately.

Tensorflow for CPU only:

pip install tensorflow

Tensorflow with GPU support:

pip install tensorflow-gpu

Note: NVIDIA Drivers and CuDNN must be installed and configured before hand. Please refer to the official Tensorflow documentation for further details.

Important Note:

All the code provided+ in this tutorial can run even if tensorflow is not installed, and so using theano as the (default) backend!

This is exactly the power of Keras!

Therefore, installing tensorflow is not stricly required!

+: Apart from the 1.2 Introduction to Tensorflow tutorial, of course.

Configure Keras with tensorflow

By default, Keras is configured with theano as backend.

If you want to use tensorflow instead, these are the simple steps to follow:

  1. Create the keras.json (if it does not exist):
touch $HOME/.keras/keras.json
  1. Copy the following content into the file:
{
    "epsilon": 1e-07,
    "backend": "tensorflow",
    "floatx": "float32",
    "image_data_format": "channels_last"
}
  1. Verify it is properly configured:
!cat ~/.keras/keras.json
{
	"epsilon": 1e-07,
	"backend": "tensorflow",
	"floatx": "float32",
	"image_data_format": "channels_last"
}

Test if everything is up&running

1. Check import

import numpy as np
import scipy as sp
import pandas as pd
import matplotlib.pyplot as plt
import sklearn
import keras
Using TensorFlow backend.

2. Check installed Versions

import numpy
print('numpy:', numpy.__version__)

import scipy
print('scipy:', scipy.__version__)

import matplotlib
print('matplotlib:', matplotlib.__version__)

import IPython
print('iPython:', IPython.__version__)

import sklearn
print('scikit-learn:', sklearn.__version__)
numpy: 1.11.1
scipy: 0.18.0
matplotlib: 1.5.2
iPython: 5.1.0
scikit-learn: 0.18
import keras
print('keras: ', keras.__version__)

# optional
import theano
print('Theano: ', theano.__version__)

import tensorflow as tf
print('Tensorflow: ', tf.__version__)
keras:  2.0.2
Theano:  0.9.0
Tensorflow:  1.0.1

If everything worked till down here, you're ready to start!