Need help with dl-course?
Click the “chat” button below for chat support from the developer who created it, or find similar developers for support.

About the developer

catalyst-team
204 Stars 60 Forks MIT License 92 Commits 0 Opened issues

Description

Deep Learning with Catalyst

Services available

!
?

Need anything else?

Contributors list

Deep Learning with Catalyst Stepik Slack

dls-catalyst-course

This is an open deep learning course made by Deep Learning School, Tinkoff, and Catalyst team. Lectures and practice notebooks located in

./week*
folders. Homeworks are in
./homework*
folders.

Note: the course is under update: weeks with colab barge are ready to go, weeks with [WIP] label are still in progress. You could use the

v20.12
branch for the earlier version of the full course.

Syllabus

  • Open In Colab week 1: Deep learning intro
    • Deep learning – introduction, backpropagation algorithm. Optimization methods.
    • Neural Network in numpy.
  • Open In Colab week 2: Deep learning frameworks
    • Regularization methods and deep learning frameworks.
    • Pytorch basics & extras.
  • Open In Colab week 3: Convolutional Neural Network
    • CNN. Model Zoo.
    • Convolutional kernels. ResNet. Simple Noise Attack.
  • Open In Colab week 4: Object Detection, Image Segmentation
    • Object Detection. (One, Two)-Stage methods. Anchors.
    • Image Segmentation. Up-scaling. FCN, U-net, FPN. DeepMask.
  • Open In Colab week 5: Metric Learning
    • Metric Learning. Contrastive and Triplet Loss. Samplers.
    • Cross Entropy Loss modifications. SphereFace, CosFace, ArcFace.
  • Open In Colab week 6: Autoencoders
    • AutoEncoders. Denoise, Sparse, Variational.
    • Generative Models. Autoregressive models.
  • Open In Colab week 7: Generative Adversarial Models
    • Generative Adversarial Networks. VAE-GAN. AAE.
    • Energy based model.
  • Open In Colab week 8: Natural Language Processing
    • Embeddings.
    • RNN. LSTM, GRU.
  • Open In Colab week 9: Attention and transformer model
    • Attention Mechanism.
    • Transformer Model.
  • Open In Colab week 10: Transfer Learning in NLP
    • Pretrained Transformers. BERT. GPT.
    • Data Augmentation in Texts. Domain Adaptation.
  • Open In Colab week 11: Recommender Systems
    • Collaborative Filtering. FunkSVD.
    • Neural Collaborative Filtering.
  • week 12: Reinforcement Learning for RecSys
    • Open In Colab DQN Algorithm.
    • Open In Colab DDPG Algorithm.
    • Open In Colab RecSim with Wolpertinger.
  • [WIP] week 13: Extras
    • Research & Deploy.
    • Config API. Reaction.

Environment

Anaconda setup

# setup - env
conda create -n catalyst-dl python=3.7 anaconda
source activate catalyst-dl
conda remove nb_conda_kernels -y
conda install -c conda-forge nb_conda_kernels -y
conda install notebook jupyter nb_conda -y
conda remove nbpresent -y

setup - jupyter

jupyter notebook password

jupyter run

jupyter notebook --no-browser --ip 0.0.0.0 --port 8888

Requirements

pip install -U catalyst==21.04.2 torch==1.8.0 albumentations==0.5.0

Course staff & contributors

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.