The post-training journey of modern LLMs revisited
(This blog post, as most of my recent ones, is written with AI assistance and augmentation. First time using nano banana for the infographics!)
Recent Posts
The AI Co-Developer 18 Months Later
Eighteen months ago, I wrote a post on how Large Language Models would change software development, sharing my early experiences with the technology. You can read those initial thoughts here. A lot...
Being Human in the Age of AI: On Critical Thinking, Agency, and Scientific Discovery
We seem to be living through a pivotal moment, often dubbed the “Age of AI”. It feels like barely a day goes by without news of another AI breakthrough that promises to revolutionize how we live, w...
2024: A Year in AI Research
2024 has been an intense year for AI. While some argue that we haven’t made much progress, I beg to differ. It is true that many of the research advances from 2023 have still not made it to mainst...
The end of the “Age of Data”? Enter the age of superhuman data and AI
Everything ends, many things start again
The Informed Intuition Model: Blending Data with Gut Feel for Smarter Decisions
If you have been following my journey for a while, you’re probably aware of my fascination with decision-making frameworks. The line between success and failure, whether in businesses or individual...
Measuring and Mitigating Hallucinations in Large Language Models: A Multifaceted Approach
(Interestingly, this is the first time arXiV has declined a submission from me. I would give the editors kudos for finally taking their role seriously if it wasn’t because I suspect this is simply ...
Beyond Token Prediction: the post-Pretraining journey of modern LLMs
(This blog post, as most of my recent ones, is written with AI assistance and augmentation)
From Taskmasters to Trailblazers: The Challenge-Inspire Model of Leadership
The breakneck speed of innovation in the artificial intelligence sector has naturally steered my writing towards AI-centric themes on this blog. Regular readers, however, will recall that my passi...
AI as the New Member of the Engineering Team: Crafting an End-to-End AI Application with AI
Exploring the AI-Driven Future of Software Development