Deep Learning
some general deep learning techniques
Last updated
Was this helpful?
some general deep learning techniques
Last updated
Was this helpful?
Deep Learning Book
Deep learning
by Andrew Ng
/
/
/
hardly used now (2019.11)
(now part of PyTorch)
(Lua)
/
Stochastic Gradient Descent (SGD)
RMSProp
Momentum
AdaGrad
Sigmoid
Tanh
ReLU
Leaky ReLU
Adam
AdamW
AdaBound
AMSGrad
RAdam
Batch Normalization
Weight Normalization
Layer Normalization
Instance Normalization
Spectral Normalization
Group Normalization
Switchable Normalization
Xavier Initialization
He Initialization
Swish
Mish