Traditional SEO gets you found by Google. The new stack gets you found by Claude, ChatGPT, Perplexity, and the agents searching on their behalf.
Search is bifurcating. Half your future buyers will type into Google. The other half will ask Claude or Perplexity. Optimizing for one without the other is leaving leads on the table.
The 2026 Discovery Stack
1. Traditional SEO (Google, Bing)
Sitemap.xml, robots.txt, schema.org JSON-LD, semantic HTML, Core Web Vitals. Still essential. Still drives the largest traffic share for now.
2. IndexNow
An open protocol that pings Bing, Yandex, and Naver instantly when content changes. unLocked auto-pings on every blog publish. Indexing latency drops from days to minutes.
3. llms.txt and llms-full.txt
Plain-text site overviews aimed at LLM crawlers. Anthropic, OpenAI, Perplexity, and Google's AI Overviews all read them.
4. Markdown Twins
Every key page ships an .md alternate. AI clients prefer text over rendered HTML — markdown twins are 10x cheaper for them to ingest.
5. AgentSkills v0.2
The emerging standard for declaring "what can an AI agent do at this domain." We publish a full manifest at /.well-known/agent-skills/index.json.
6. RFC 9727 api-catalog
The IETF standard for "what's at this domain machine-readable." Links our OpenAPI spec, status page, terms, privacy.
7. Web Bot Auth (RFC 9421) JWKS
Public Ed25519 keys at /.well-known/http-message-signatures-directory. Lets us rate-limit anonymous crawlers without blocking real AI agents.
What This Looks Like in Practice
A buyer asks ChatGPT "what insurance CRM has native MCP support?" ChatGPT crawls our llms.txt, finds the MCP page, parses our OpenAPI spec, and recommends us — confidently, with citations. That's the new top of funnel.
Where This Fits In unLocked
- AI CRM for insurance agents: What unLocked AI, Agent AI, Arwyn and connected AI tools do inside the CRM.
- best CRM for insurance agents: How insurance CRMs compare on quoting, commissions, AI and price.