CUDA Studylog 2 - Matrix Multiplication and 2D Grid Organization
Deep dive into implementing efficient matrix multiplication using CUDA, with a focus on memory optimization techniques
Recent posts
CUDA Studylog 1 - Getting a taste of CUDA kernels
A Introduction Guide for ML Engineers. Learn the fundamentals and practical implementations needed to get started with CUDA kernels
The Pickle Problem - A Security Nightmare in ML
Learn how malicious code can be embedded in model weights and how it can sabotage training processes.
In-Context Vectors - Controlling Language Models Through Latent Space Steering
In-Context Vectors represent a promising approach to controlling language model behavior through direct manipulation of hidden states. Talk about making In C...
Why zero-ing gradients isn’t enough?
Talks about why setting set_to_none = True makes a difference