CUDA Studylog 3 - Tiling and Shared Memory for Matrix Multiplication Optimization
Optimizing CUDA matrix multiplication using tiling and shared memory, with detailed explanations of memory access patterns and performance improvements
Recent posts
CUDA Studylog 2 - Matrix Multiplication and 2D Grid Organization
Deep dive into implementing efficient matrix multiplication using CUDA, with a focus on memory optimization techniques
CUDA Studylog 1 - Getting a taste of CUDA kernels
A Introduction Guide for ML Engineers. Learn the fundamentals and practical implementations needed to get started with CUDA kernels
The Pickle Problem - A Security Nightmare in ML
Learn how malicious code can be embedded in model weights and how it can sabotage training processes.
In-Context Vectors - Controlling Language Models Through Latent Space Steering
In-Context Vectors represent a promising approach to controlling language model behavior through direct manipulation of hidden states. Talk about making In C...