CUDA Study Log 4: Optimizing Constrained Decoding with Triton Kernel
Update traditional CUDA matrix multiplication kernel for constrained decoding
Recent posts
CUDA Studylog 3 - Tiling and Shared Memory for Matrix Multiplication Optimization
Optimizing CUDA matrix multiplication using tiling and shared memory, with detailed explanations of memory access patterns and performance improvements
CUDA Studylog 2 - Matrix Multiplication and 2D Grid Organization
Deep dive into implementing efficient matrix multiplication using CUDA, with a focus on memory optimization techniques
CUDA Studylog 1 - Getting a taste of CUDA kernels
A Introduction Guide for ML Engineers. Learn the fundamentals and practical implementations needed to get started with CUDA kernels
The Pickle Problem - A Security Nightmare in ML
Learn how malicious code can be embedded in model weights and how it can sabotage training processes.