Skip to content

#14TageLLM

14 days, 3–4 short lessons a day.

The challenge takes you through the 48 free lessons of AI Steps: first how large language models are built, then PyTorch from tensors and autograd to a training loop. In the free learning room “A model learns”, you then train real weights yourself. Free, in your browser, without payment details.

  • 14 days
  • 48 free lessons
  • 16 units
  • 20–30 minutes a day

How it works

  1. Create a free account. You need no payment details.
  2. Each day, do the lessons from the plan below. One lesson takes 5–9 minutes, and your answers are checked right away.
  3. Start whenever you like: day 1 is the day you begin. Your streak shows whether you keep going.

Your plan, day by day

The days follow the order of the course. The minutes are the lesson lengths stated in the course.

Minutes per day, from the lesson lengths stated in the course.

Days 1–7: Language model foundations

7 units, 21 lessons

  1. Day 1

    What is a language model?Concept, Predict & trace, Build & verify

    3 lessons, 22 min
  2. Day 2

    Applications and limitationsConcept, Predict & trace, Build & verify

    3 lessons, 23 min
  3. Day 3

    Stages of building and using an LLMConcept, Predict & trace, Build & verify

    3 lessons, 23 min
  4. Day 4

    The Transformer architectureConcept, Predict & trace, Build & verify

    3 lessons, 22 min
  5. Day 5

    Large datasets and scalingConcept, Predict & trace, Build & verify

    3 lessons, 21 min
  6. Day 6

    GPT architecture at a glanceConcept, Predict & trace, Build & verify

    3 lessons, 22 min
  7. Day 7

    The complete build roadmapConcept, Predict & trace, Build & verify

    3 lessons, 21 min

Days 8–14: PyTorch foundations

9 units, 27 lessons

  1. Day 8

    Python readiness and the course environmentConcept, Predict & trace, Build & verify

    Scalars, vectors, matrices and tensorsConcept

    4 lessons, 24 min
  2. Day 9

    Scalars, vectors, matrices and tensorsPredict & trace, Build & verify

    Tensor operations and broadcastingConcept, Predict & trace

    4 lessons, 24 min
  3. Day 10

    Tensor operations and broadcastingBuild & verify

    Computation graphs and automatic differentiationConcept, Predict & trace, Build & verify

    4 lessons, 29 min
  4. Day 11

    Multilayer neural networksConcept, Predict & trace, Build & verify

    Datasets and DataLoaderConcept

    4 lessons, 27 min
  5. Day 12

    Datasets and DataLoaderPredict & trace, Build & verify

    A reproducible training loopConcept, Predict & trace

    4 lessons, 26 min
  6. Day 13

    A reproducible training loopBuild & verify

    Saving and loading modelsConcept, Predict & trace, Build & verify

    4 lessons, 30 min
  7. Day 14

    CPU, accelerator and multi-GPU foundationsConcept, Predict & trace, Build & verify

    Free learning room: A model learns, 18 min
    3 lessons, 20 min

After 14 days

  • You can explain how a language model is built: from predicting the next token and the transformer to pretraining and fine-tuning.
  • You have worked through tensors, autograd, a multilayer network, datasets and a training loop in exercises in your browser.
  • In the learning room “A model learns”, you have trained real weights in your browser and checked what your metric actually proves.
  • You know which building blocks a model of your own needs, and in which order they are built.

What the challenge does not do

You do not build a language model of your own in these 14 days yet. That happens in Plus (not bookable yet): 8 more sections with 202 lessons, from text data and attention to pretraining and fine-tuning, plus 3 more learning rooms.

View plans and availability

Join in public

Post your start with #14TageLLM on X. The link opens X with a prepared text; nothing is sent to us.