robots.txt: the file that tells bots what they may read
Every website can have one small text file at /robots.txt. Well-behaved bots read it first.
The file has groups. Each group names a bot and lists what that bot may not read. A group for * applies to every bot that has no group of its own.
Three outcomes
Allowed: the bot may read every page.
Partially blocked: some pages are closed to it.
Blocked: the whole site is closed to it.
This site's own file
This site shows all three: GPTBot is blocked, PerplexityBot may not read the /private/ folder, and every other bot may read everything. You can open the file and see for yourself.