The key points
- Crawl access, retrieval, indexing and citation are separate steps.
- Content built only by JavaScript may be invisible to some assistants.
- Clear headings and direct answers are easier to quote.
- No file or markup can guarantee inclusion in AI answers.
What has to be true before a page can be cited?
Several separate things. The crawler must be allowed by your robots rules, which OpenAI and other providers document per bot, and not blocked by a firewall. The content must be available in the response, not hidden behind scripts the crawler will not run, which is where server rendering in Next.js helps. The page must be indexed or retrievable, and then it must actually be the best source for a question, the work covered in getting cited by AI search. Each stage can fail independently, and fixing one does not prove the next.
What makes a page easy to read and quote?
A plain structure: one main heading, question-style subheadings where the page answers questions, and a direct answer near the top in a sentence or two. Facts you state should be specific and true. Structured data that matches the visible page, such as FAQs and breadcrumbs, helps machines understand it, provided the same content is visible to people.
- Allow the crawlers you want, and check firewall rules
- Put the main content in the initial HTML
- Answer the question early, then explain
- Keep structured data identical to visible content
What should you not rely on?
A llms.txt file, FAQ markup or a high internal audit score are not proof that any AI platform reads, trusts or cites you. They are inexpensive hygiene. Whether you appear depends on the platform, the question and the competing sources, and nobody can promise it. Measure actual referrals and citations over time, with enquiries tracked in GA4, rather than assuming.
AI readability check
- Are AI crawlers allowed by robots rules and your firewall?
- Is the main text present without running JavaScript?
- Does each page answer its question directly near the top?
- Does structured data match what visitors can see?
- Do you track referrals from AI assistants?
Sources
Rules and guidance this answer relies on. Policies change, so check the current version before acting on it.
