Skip to content
bits
Context is everything · Lesson 6 of 7

What to leave out

Tutor:

Every token you send draws on the same attention budget. So the real skill isn't stuffing the window, it's choosing. Anthropic's engineers put the goal as the smallest set of high-signal tokens that gets you the result you want. Smallest, not shortest: if Claude needs a fact, leaving it out is its own failure.

A quick test for each piece of context: would the answer change if this were gone? If not, it's costing you attention and money for nothing.

Tutor:

What usually earns its place: the task, the facts the task depends on, the constraints, the format you want, and one or two good examples.

What usually doesn't. Backstory nobody asked for: how the project started, who sits where. Stale versions: the 2019 rules and the 2021 rules that replaced them. Repeats: the same instruction three times in capitals. A laundry list of edge cases: Anthropic recommends a few varied, typical examples instead, because a model learns more from good examples than from a long list of rules. Whole files when a section will do, and raw logs or tool dumps the model doesn't need yet.

That last one has a better answer than deleting: keep a pointer (a file path, a doc title, a link) and let the model fetch the content only when it needs it. That's how agents like Claude Code work, and it's where Give your model tools and Retrieval without tears pick up.

Everything in vs Only what mattersillustrative: made-up numbers that show the idea, not output from a real modelcompare

promptReply to a customer whose order #4417 arrived damaged and who wants a replacement.

Everything in

Thank you for reaching out, and congratulations on three years with Acme! We're sorry about the coffee machine. Per our 2019 guidelines, refunds are processed within 14 days, although under the 2021 update…

Only what matters

Sorry your order #4417 arrived damaged. A replacement is on its way at no cost, and you don't need to send the broken one back. Thanks for your patience.

Tutor:

The left reply picked up the noise: a work anniversary, a broken coffee machine, a policy that no longer applies. Nothing in it was wrong to include on purpose. It was wrong to include by accident.

Tutor:

Your turn. The draft is a real-feeling mess. Cut it down to what the reply needs: the customer's message, what to offer, the tone and a length. The checks can only see what's there, not what you removed, so read your version back before you run it.

Your turn

Run your prompt and the replies land here.

    • Keeps the customer's message, not yet
    • Says what to offer, not yet
    • Sets a tone, not yet
    • Sets a length, not yet
    • Ran at 1.0, not yet
    run at
    ~0 tokens

    Turn on JavaScript to run prompts.