# Truo, truo.com.au. Indexing was opened on 19 August 2026.
#
# TRAINING IS REFUSED IN TWO PLACES. Here, in the Disallow group below: this is
# the written policy, and the only place a token that never arrives as a user
# agent can be refused. And at the Cloudflare edge, by a firewall rule that
# refuses requests carrying training crawlers' user-agent strings. This file
# cannot override that rule: a crawler the edge refuses never reaches a page,
# whatever this file says.
#
# GOOGLE-EXTENDED IS A ROBOTS TOKEN, NEVER A USER AGENT (Applebot-Extended is
# the same). Google crawls with Googlebot and reads this group to decide how the
# pages may be used. Refusing it keeps them out of Gemini training AND limits
# their use for grounding Gemini's answers; that second cost is accepted under
# the no-training policy. It does not touch Google Search. Inclusion in Google
# Search's AI features is a separate Search Console setting, not this file.
#   https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers
#
# NO `User-agent: *` GROUP, on purpose. A crawler this file does not name,
# Googlebot and Bingbot included, is allowed by default, so a `*` group adds
# nothing, and a `Disallow: /` in one would take the site out of search.
#
# The five citation agents are named with Allow: / so the intent is written
# down rather than left to that default. They fetch a page to quote it, or to
# answer a person who asked, and that is the traffic Truo wants.
#
# Training stays blocked on purpose. Truo's whole position is that it does not
# train on anyone's data and does not hand data to anyone to train theirs.
# Opening the marketing site to training crawlers to chase reach would be an odd
# signal to send from that brand, and it buys no citations.

User-agent: GPTBot
User-agent: ClaudeBot
User-agent: CCBot
User-agent: Google-Extended
User-agent: Applebot-Extended
User-agent: Bytespider
User-agent: Amazonbot
User-agent: meta-externalagent
Disallow: /

User-agent: Claude-User
Allow: /

User-agent: Claude-SearchBot
Allow: /

User-agent: OAI-SearchBot
Allow: /

User-agent: ChatGPT-User
Allow: /

User-agent: PerplexityBot
Allow: /

Sitemap: https://truo.com.au/sitemap.xml