Beyond Token Prediction: the post-Pretraining journey of modern LLMs
(This blog post, as most of my recent ones, is written with AI assistance and augmentation)
Recent Posts
From Taskmasters to Trailblazers: The Challenge-Inspire Model of Leadership
The breakneck speed of innovation in the artificial intelligence sector has naturally steered my writing towards AI-centric themes on this blog. Regular readers, however, will recall that my passi...
AI as the New Member of the Engineering Team: Crafting an End-to-End AI Application with AI
Exploring the AI-Driven Future of Software Development
Beyond Singular Intelligence: Exploring Multi-Agent Systems and Multi-LoRA in the Quest for AGI
In my view, the concept of Artificial General Intelligence (AGI) as it’s commonly understood might be a misnomer. Human intelligence itself is not ‘general’; it is inherently constrained by our sen...
My most epic runs
The Big Sur Marathon is considered the most beautiful marathons in the US and top ten in the world. However, it did not make it into my top 10 most epic runs
The Multimodal Generative AI Revolution is Here!
In the landscape of Generative AI (GenAI), we often find ourselves amazed at the rapidity and scale of advancements. GPT-4 stands as a shining example, pushing the boundaries of linguistic understa...
Beyond Prompt Engineering: The Multi-Layered Cake of GenAI Development
The layers of GenAI development
Mitigating LLM Hallucinations: a multifaceted approach
(I recently turned this guide into a paper. You can find it here)
On open source LLMs, take two: The three laws of GenAI model evolution
In this post I summarize the main advances in the area of LLM models, and particularly open source LLMs (including Falcon, LlaMa2, and Free Willy). I describe different leaderboards and what their ...
Prompt Engineering 201: Advanced methods and toolkits
DALL-E 2: An old professor with a notebook in his hand talking to a futuristic looking robot. 4k. Professional photo. Photorealistic