Deep Belief Network

--- 🏗️ work in progress 🏗️ ---

Overview

Model

RBM and GRBM

Training

MLE(MCMC), CD, and PCD

• Maximum Likelihood Estimation (MLE) using MCMC
• Contrastive Divergence (CD)
• Persistent Contrastive Divergence (PCD)

As a Generative Model

Conditional Generation

RBM for conditional generation on MNIST

Generative Discriminator

RBM for generative discriminator on MNIST

Test set classification accuracy: 94.07%

References