What is training data?

Also: Pretraining data, training corpus

Training data is the text a language model learns from before release: web pages, books, code and licensed or public datasets. What was widely written about a brand before the cutoff shapes what the model knows without searching. Crawler rules can limit future training use, but they cannot remove what was already learned.

What you control

You can disallow training crawlers in robots.txt for the future. You cannot change a released model. The practical lever is the open web: accurate, widely repeated facts.

Example: a company discussed in thousands of articles before a model's cutoff is usually described in more detail than a company founded the month before.

Training is not search

Blocking a training bot does not remove you from answers that use live search. See training vs search crawlers.

Related terms

All glossary terms

See what AI tells your buyers, first

Be the first to see whether AI recommends you or your competitors.

  • Early access: your free check comes first, on launch day
  • Six AI engines on every plan, no credits or seat fees
  • One email on launch day, nothing to pay now

We send you one confirmation email. After you confirm, we use your address only to tell you when Nodpick opens. You can withdraw at any time. Privacy policy · Contact us