Deep Learning Gymnastic

Want to stay in shape with your deep learning skills? Let’s lift some tensors, and learn (or revise) together useful and important skills or concepts when building deep learning models in TensorFlow or PyTorch. The posts below are heavily inspired from the amazing series of videos from Andrej Karpathy on neural network.

Deep Learning Gymnastics #1: Tensor Broadcasting

Deep Learning Gymnastics #1: Tensor Broadcasting
In the heart of the implementation of modern deep learning models (yes, including LLMs) always lies some subtle and critical ...
Read More

Deep Learning Gymnastics #2: Tensor Indexing

Deep Learning Gymnastics #2: Tensor Indexing
Welcome to the second episode of the Deep Learning Gymnastics series. Hope you're in good shape. Get warmed up. We ...
Read More

Deep Learning Gymnastics #3: Tensor (re)Shaping

Deep Learning Gymnastics #3: Tensor (re)Shaping
Welcome to the 3rd episode of the Deep Learning Gymnastics series. By now you should already start to be in ...
Read More

Deep Learning Gymnastics #4: Master Your (LLM) Cross Entropy

Deep Learning Gymnastics #4: Master Your (LLM) Cross Entropy
Welcome to the 4th episode of our Deep Learning Gymnastics series. Today, we’ll use all the skills learned in our ...
Read More