Bridging the Three Gulfs of Agentic Development (and how they shape evals)
A practical framework for spotting and fixing evaluation blind spots in agentic LLM pipelines, based on Shankar et al.’s Three Gulfs model.
Recent posts
Let Agents do the talking: A Scalable Way to Evaluate Multi-Turn Chatbots
Interactive evaluations: lightweight, automated tests that use agents to measure multi-turn chatbot quality at scale.
CUDA Study Log 4: Optimizing Constrained Decoding with Triton Kernel
Update traditional CUDA matrix multiplication kernel for constrained decoding
CUDA Studylog 3 - Tiling and Shared Memory for Matrix Multiplication Optimization
Optimizing CUDA matrix multiplication using tiling and shared memory, with detailed explanations of memory access patterns and performance improvements
CUDA Studylog 2 - Matrix Multiplication and 2D Grid Organization
Deep dive into implementing efficient matrix multiplication using CUDA, with a focus on memory optimization techniques