AI crawler · Perplexity

Perplexity-User: what it is and how to block it

Perplexity-User visits a page when a Perplexity user's question needs it, and links to the page in the answer. Perplexity says it generally ignores robots.txt because a user requested the fetch.

BrandVector Editorial · Last verified Oct 8, 2026

Operator
Perplexity
Type
User-triggered
robots.txt token
Perplexity-User
Follows robots.txt
No, per Perplexity
IP ranges
Published
Blocked by name
5.4% of top sites

What is Perplexity-User?

Perplexity-User is Perplexity's user-triggered crawler: it fetches a page when a user asks an AI assistant to. In Perplexity's words:

“Perplexity-User supports user actions within Perplexity. When users ask Perplexity a question, it might visit a web page to help provide an accurate answer and include a link to the page in its response.”

“It is not used for web crawling or to collect content for training AI foundation models.”

Perplexity-User user agent string

Perplexity documents this user agent string for Perplexity-User:

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user)

In robots.txt, use the token Perplexity-User, not the full string. Crawlers match on the token, and version numbers in the full string can change.

How many websites block Perplexity-User?

In our Oct 8, 2026 check of 817 of the most-visited websites, 5.4% block Perplexity-User by name for their whole site (44 sites).

robots.txt rule for Perplexity-UserSitesShare
Blocks the whole site by name445.4%
Blocks part of the site by name162.0%
Names it but doesn't block it91.1%
Blocked only by a catch-all (*) rule334.0%

For comparison, 0.1% of the same sites block Googlebot by name. The sites are the top 1,000 origins in the Chrome UX Report for August 2026; see how we measured.

How to block Perplexity-User in robots.txt

Add this group to the robots.txt file at the root of your domain to block Perplexity-User from your whole site:

User-agent: Perplexity-User
Disallow: /

To block only part of your site, list those paths instead:

User-agent: Perplexity-User
Disallow: /private/

A group that names Perplexity-User replaces your User-agent: * rules for it entirely (RFC 9309). If your catch-all group blocks paths that Perplexity-User should also stay out of, repeat them in its group. To let Perplexity-User in while a catch-all rule blocks others:

User-agent: *
Disallow: /

User-agent: Perplexity-User
Allow: /

Perplexity says robots.txt doesn't fully control Perplexity-User. To stop it completely, block it at your firewall or CDN using the verification details below.

“Since a user requested the fetch, this fetcher generally ignores robots.txt rules.”

What happens if you block Perplexity-User?

Perplexity doesn't document what blocking Perplexity-User changes.

How to verify requests from Perplexity-User

Perplexity publishes the IP addresses Perplexity-User uses. Check a request's IP address against that list before trusting its user agent, which any client can fake.

“combine both User-Agent string matching and IP address verification for enhanced security”

See every AI crawler and how often top sites block it

Sources

  1. Perplexity: Perplexity crawlers
  2. Perplexity Help Center: How does Perplexity follow robots.txt?
  3. RFC 9309: Robots Exclusion Protocol
  4. Chrome UX Report top 1,000 origins (global), August 2026

Rather have an expert do it?

Tell us about your site and goals, and we'll match you with an AI visibility (GEO) specialist. Free, no obligation.