PyTorch from scratch

This repo contains work implementing PyTorch and core DL models.

This code is based on a self-study project where I implemented PyTorch functionality and deep learning models from scratch, following Redwood ML Course.

Content

The code in this repo is being transferred and cleaned up from another repository that contains private materials.

Not all content is available now. The full content is:

• Core PyTorch functionality:
  • Autograd engine
  • Neural Network layers
  • Backpropagation
  • Optimizers
  • Data Parallelism (multi-GPU)
• Deep Learning Models:
  • ResNet
  • BERT
  • GPT-2
  • DDPM
  • CLIP
• Reinforcement Learning:
  • DQN
  • PPO