# SEO

> Articles on seo from AI SpeedForce: technical and on-page SEO for a web that search engines and AI crawlers read side by side.

Canonical page: https://aispeedforce.com/blog/category/seo/

Last updated: 2026-09-23

Technical and on-page SEO for a web that search engines and AI crawlers read side by side.

[All](https://aispeedforce.com/blog/) [Agentic browsing](https://aispeedforce.com/blog/category/agentic-browsing/) [AEO](https://aispeedforce.com/blog/category/aeo/) [SEO](https://aispeedforce.com/blog/category/seo/) [Agent readiness](https://aispeedforce.com/blog/category/agent-readiness/)

- [robots.txt for AI crawlers: GPTBot, ClaudeBot and the rest](https://aispeedforce.com/blog/robots-txt-for-ai-crawlers/): SEO 23 September 2026. AI providers run separate crawlers for training, for search and for fetching a page a user asked about. robots.txt lets you treat each one differently. Here is who is who and how to write the rules.
- [llms.txt explained: what it is and how to write one](https://aispeedforce.com/blog/llms-txt-explained/): SEO 23 September 2026. llms.txt is a short Markdown file at your site root that tells language models what your site is and where the important pages are. It is a proposal, not a standard, and it is cheap to publish.
- [Lighthouse's agentic browsing audit: what it checks and how to pass](https://aispeedforce.com/blog/lighthouse-agentic-browsing-audit/): SEO 23 September 2026. Recent Lighthouse versions add an Agentic Browsing category that checks how well AI agents can read and use a page. Here is what it looks at and how to fix what it finds.
- [JSON-LD schema that matters: the types worth adding and how to link them](https://aispeedforce.com/blog/json-ld-schema-that-matters/): SEO 23 September 2026. A short list of schema.org types covers most business sites. Link them into one graph with @id, keep them true to the visible page, and validate before you ship.
- [Content Signals explained: search, ai-input and ai-train in robots.txt](https://aispeedforce.com/blog/content-signals-explained/): SEO 23 September 2026. Content Signals add one line to robots.txt that says how your content may be used once it is fetched: for search, as input to AI answers, or for model training.

[Subscribe with RSS](https://aispeedforce.com/blog/feed.xml)

## See how your own site scores

The free agent-readiness scan checks the files, headers and endpoints this blog writes about, and tells you what to fix first.