We test how well AI agents can use your product.

Agents are already reading your docs.

When your product trips an agent up, there is no ticket. It picks the next API.

79xgrowth in AI agent traffic in 2025. HUMAN Security

66%of traffic to Mintlify-hosted docs comes from agents. Mintlify

40%of enterprise apps will include AI agents by the end of 2026. Gartner

Only1 in 4developers design their APIs with AI agents in mind. Postman

See where an agent gets stuck.

Web data is from a real audit, vendor anonymised and simplified. Voice and documents are illustrative.

A web-scraping API, from a real audit“Get this shop page as a visitor in Berlin sees it.”

docs.example-scraper.com/location

Location

Send a city to see the page as a visitor there would.

Set city as City, Region, Country.

1POST /scrape
2{
3 "url": "https://shop.example/product/48",
4 "city": "Berlin, Germany"
5}
1← 200 OK
2 "status": "success"
3 served from Tokyo, Japan
ScrutifAI agent flagged line 3
Wrong city, reported as success.

The city was slightly off the documented format. The API accepted it, served Tokyo and never said so.

The fix: return an error when you can't serve the city asked for.

A speech-to-text API, illustrative“Transcribe this sales call and label each speaker.”

docs.example-voice.com/speakers

Speaker labels

Tell each voice in a recording apart.

Set speaker_labels to true.

1POST /v1/transcribe
2{
3 "audio": "sales-call.mp3",
4 "speaker_labels": true
5}
1← 200 OK
2 Speaker 0: Thanks for joining.
3 Speaker 0: Happy to be here.
4 Speaker 0: So, about pricing…
ScrutifAI agent flagged lines 2 to 4
Setting accepted, never applied.

Two people spoke. Every line came back as one speaker, and nothing said why.

The fix: reject options you can't apply, or say they were ignored.

A document-parsing API, illustrative“Pull every line item from this scanned invoice.”

docs.example-parse.com/tables

404. This page has moved.

The quickstart links nowhere, so the agent finds an older copy through search.

Old copy: set tables to true.

1POST /v1/parse
2{
3 "file": "invoice-1182.pdf",
4 "tables": true
5}
1← 200 OK
2 "line_items": [3 items],
3 "warnings": []
ScrutifAI agent flagged line 2
Half the invoice, no warning.

The invoice has seven line items. Three came back, and the response said nothing was wrong.

The fix: flag what you couldn't read, and forward old docs addresses.

Start with a free preview.

  • One major finding in full: what the agent was asked, what came back, and how to fix it.
  • Your other findings and fixes, blurred, so you see how much there is.

Within 2 weeks, with no access to your systems.

Get your free preview report
ScrutifAIAgent integration audit, free preview

Major finding

01Docs contradict actual behaviour
We asked
Return a search's summary panel and three suggested searches.
Should return
The same section names on every run, as the docs promise.
Came back
Four identical searches, four different layouts.

FixUpdate the search docs to match live responses and state that section names can change.

More findings and fixes

Sample from a web-scraping API audit. Your preview covers your own product.

Get ready for customers who arrive through AI agents.

Get your free preview report

No commitment. We quote the full audit after the preview.

  • No access to your systems
  • Free, within 2 weeks
  • Findings shared only with you

Get your free preview report

Leave your work email and company name. We'll email you to arrange your free preview.

No commitment. Ready within 2 weeks.