Essential Guide to Foundation Models and Large Language Models

Babar M Bhatti
15 min readFeb 6

The term Foundation Model (FM) was coined by Stanford researchers to introduce a new category of ML models. They defined FMs as models trained on broad data (generally using self-supervision at scale) that can be adapted to a wide range of downstream tasks.

The Stanford team made a point to note that FMs are NOT foundational models in the sense that they are not the foundation for AI — that is, such models are not implied to be AGI.

Babar M Bhatti

AI, Machine Learning for Executives, Data Science, Product Management. Co-Founder Speaker, Author. Co-founder @MutualMind