Notes on AI search
Short, plain-language notes on how AI assistants like ChatGPT, Claude and Perplexity find and read websites.
- What AI crawlers are, and why they visit your websiteThree kinds of bots, explained in two minutes.
- robots.txt: the file that tells bots what they may readHow one small text file decides what AI assistants can see.