If you've published your site but AI assistants like ChatGPT, Gemini, or Claude don't reference it in their answers, this article explains why and what you can do about it.
Symptoms
You might notice one or more of the following:
-
Your site is live and publicly reachable, but asking an AI assistant about your product doesn't surface your help center.
-
You uploaded a markdown file from your site to an AI tool, and the tool couldn't read it.
-
Your site appears in Google or Bing results, but not in AI assistant answers.
Cause
Scroll Sites makes your content available to AI tools, but it can't control when or whether an external AI provider picks it up. Three factors are usually behind this:
-
Crawler access: The Hide site from search engines setting blocks every crawler, including AI and large language model (LLM) crawlers.
-
External indexing: Each AI provider decides when to crawl and index your site. Not all of them read
llms.txtfiles yet, and indexing takes time. -
Manual versus crawled content: The markdown options on your articles are designed for your visitors to paste content into an AI tool themselves. External AI providers don't crawl them.
Solution
Work through these steps in order.
Check the search engine setting
The Hide site from search engines setting blocks AI crawlers as well as search engines. To check it:
-
Open your site card in My Sites.
-
Go to Site settings > SEO.
-
Turn off Hide site from search engines.
-
Publish your changes.
For more detail, see Hide Site From Search Engines.
Sites protected with login credentials or access tokens are hidden from crawlers by design. No search engine or AI crawler can reach a token-protected site, so this is expected behavior rather than a misconfiguration.
Confirm your LLM files are reachable
Every Scroll site automatically generates two files at the root of your site's domain:
-
llms.txtcontains links to all pages in your site, with excerpts or summaries. -
llms-full.txtcontains the title and full markdown content of every page.
Add /llms.txt and /llms-full.txt to your site's domain and open both in your browser to confirm they load. For example, yoursite.scroll.site/llms.txt. The path is the same whether you use a Scroll site domain or your own custom domain. If both files load, your content is available to any AI tool that looks for it.
To learn what else your site offers AI tools, see How Is My Site Made AI-Ready?
Allow time for indexing
New sites aren't discoverable immediately. Search engines typically need 2 to 4 weeks to crawl and index a newly published site, and many AI assistants draw on those same search indexes when they answer questions. You can speed this up by submitting your site in Google Search Console.
Strong SEO practices also improve AI discoverability. Descriptive page titles, meaningful meta descriptions, and internal links between related articles all help crawlers understand your content. See Optimizing for Search Engines (SEO) - Best Practices.
Share content with an AI tool directly
While you wait for external providers to index your site, your visitors can bring individual articles into the AI tool of their choice. Every article includes a Use with AI menu with these options:
-
Open in ChatGPT or Open in Claude starts a chat about the article.
-
Copy as markdown copies the article content in markdown format.
-
View as markdown displays the article content in markdown format.
These options are convenience features for your readers. They aren't crawl targets, so they don't affect whether an AI provider indexes your site.
What to Expect
Your site's AI-readiness doesn't depend on your license or trial status. The llms.txt files, the markdown options, and the Use with AI menu all work the same way during an evaluation as they do on a paid plan.
What you can control is whether crawlers can reach your content and how well that content is structured. What you can't control is each AI provider's crawling schedule, or which sources it chooses to cite.
Still Having Issues?
If you've checked all of the above and your site still isn't discoverable, contact our support team.
Related Articles