> ## Documentation Index
> Fetch the complete documentation index at: https://docs.firstanswer.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# First Answer Crawler

> The FirstAnswerBot user agent, what it is for, and how to manage it in robots.txt.

## Overview

First Answer uses a single crawler, **FirstAnswerBot**, to check whether your site is ready for AI search engines and to power the recommendations we generate for your brand.

| Crawler            | User agent                                                                         | Purpose                                                             |
| ------------------ | ---------------------------------------------------------------------------------- | ------------------------------------------------------------------- |
| **FirstAnswerBot** | `FirstAnswerBot/1.0 (+https://docs.firstanswer.ai/resources/first-answer-crawler)` | Powers First Answer's AI-visibility recommendations for your brand. |

## Key points

* FirstAnswerBot content is **not used to train AI models**.
* It does **not collect personal data**.
* It is identified by the `FirstAnswerBot` token in its User-Agent. Match on that token (not the full string) when writing `robots.txt` or firewall rules.

## Managing FirstAnswerBot in robots.txt

**Allow it (recommended):**

```
User-agent: FirstAnswerBot
Allow: /
```

**Block it:**

```
User-agent: FirstAnswerBot
Disallow: /
```

<Info>
  If you block FirstAnswerBot, we may stop generating some of your recommendations. It does not affect your visibility in AI answers.
</Info>