Skip to content
Tokens & temperature · Lesson 1 of 8
What is a token?
Read
Watch
Terminal
In this course
1
✓
What is a token?
, not started
, completed
2
Tokenizers are weird
, not started
3
Counting tokens (and cost)
, not started
4
Probabilities, not answers
, not started
5
Greedy vs. sampled
, not started
6
Temperature & randomness
, not started
7
Top-p and friends
, not started
8
Checkpoint: tune a chatbot
, not started
Lesson 1 of 8 · In this course
▾
1
✓
What is a token?
, not started
, completed
2
Tokenizers are weird
, not started
3
Counting tokens (and cost)
, not started
4
Probabilities, not answers
, not started
5
Greedy vs. sampled
, not started
6
Temperature & randomness
, not started
7
Top-p and friends
, not started
8
Checkpoint: tune a chatbot
, not started
0:00 / 3:12
Chapter 1 · Text in, numbers out
1×
CC
≡
Transcript · follows along
0:00:
A model never sees letters. Before it reads anything, your text is chopped into pieces.
1:10:
Common words get one piece. Rare words get split into chunks the model has seen before.
2:10:
You pay per token, and the context window is counted in tokens, so it pays to know them.
Next: Tokenizers are weird →