An Overview of RL Environments
Everything that happens in an RL environment between the policy update and the next rollout - verification, reward shaping, tool calling, curriculum design, ...
Machine Learning Posts
The Pickle Problem - A Security Nightmare in ML
Learn how malicious code can be embedded in model weights and how it can sabotage training processes.
In-Context Vectors - Controlling Language Models Through Latent Space Steering
In-Context Vectors represent a promising approach to controlling language model behavior through direct manipulation of hidden states. Talk about making In C...
Why zero-ing gradients isn’t enough?
Talks about why setting set_to_none = True makes a difference
Creating an Automated UI controller with GPT agents & GPT-4v
Talks about how we can build an automated UI controller with GPT agents
Rapid Prototyping with LLMs - The Journey from Notebook Musings to Real-World Enterprise Solutions
Talks about how LLMs enabled me to rapidly prototype and test ideas and how they are enabling a new era of Product Integration.
Understanding LoRA and QLoRA - The Powerhouses of Efficient Finetuning in Large Language Models
Delving into the math behind LoRA and QLoRA
Adapting Text Augmentation to Industry problems
Applying recent NLP-Augmentation ideas to Industrial projects
Speeding-up your dataset-creation process
Talks about building a dataset from scratch and offers a few tricks to speed-up the process