We Ran Shopify's Free AI Scanner Against Three Real Shopify Stores. It Never Scanned Them.

Shopify has a free tool at shopify.com/agentic-readiness. It asks for a product page URL and promises to check "the structured data that AI agents read to answer shoppers' questions." On September 28 we ran it against product pages from three real Shopify stores, then ran the same three pages through the Parceit audit engine.

For all three Shopify stores, the tool ran zero checks. It never looked at the page.

What the scanner actually did

We entered product pages from Krave Beauty (skincare), Ritual (supplements), and Bocce's Bakery (pet treats). All three are verified Shopify stores.

All three got the same result: a card announcing "Good news" and saying the store is on Shopify, followed by two bullet points. The first says all eligible products are listed in Shopify Catalog. The second says Shopify Catalog "automatically structures, optimizes and enriches products to distribute to AI agents." There was no score, no checklist, no findings. A Login button and a Learn More button.

To confirm the tool can run a real audit, we scanned a non-Shopify page: WooCommerce's own product page for its Bookings extension. That scan worked. It returned an "Agent discoverability score" of 89/100 and ran eleven checks, from Product name and Page title through Pricing, Availability, Rating and reviews, and Crawler access. It flagged two checks as NOT DETECTED and one as FAIL. (It failed the company's own product page on Pricing, which tells you the checks are real.)

So the tool's logic is: if the store is on Shopify, skip the audit and show the reassurance card. If it is not on Shopify, run the audit and show the score, followed by ads for switching.

What the reassurance card skips

The card says you are covered because Shopify Catalog handles your product data. That is true for the catalog half of AI visibility. Google, Microsoft, ChatGPT, and Perplexity can pull your product data from Shopify Catalog and its connected feeds without ever touching your storefront. If you sell through those channels, Catalog does feed them.

Here is what "Good news" does not cover. When an AI engine answers a question on the open web, which store does it cite? That answer comes from the store's own pages: the structured data in your theme, your page structure, whether AI crawlers can reach you, and what the first lines of your page actually say. Shopify Catalog does not fix your theme.

The same three pages through the Parceit audit

We ran the same three product URLs through our audit engine the same day. Scores: Krave Beauty 77/100, Ritual 78/100, Bocce's Bakery 72/100. All three stores passed overall, and all three had problems worth fixing. Specific findings the reassurance card never mentioned:

• Krave Beauty's product page has three H1 tags instead of one, which weakens the page's main signal about what it is.
• Ritual's product pages have no review markup on the page we tested, so engines that read the page see no rating even though the store has reviews.
• Bocce's Bakery has zero sameAs links connecting its organization data to its social profiles, no rating markup, and its HTML is missing a main element.
• All three stores are missing FAQPage schema, which is how a product page tells an engine what questions it answers.

Every one of those is fixable in an afternoon. None of them will ever surface in a scan that stops at "this store is on Shopify."

What this means if you are on Shopify

The free scanner is a marketing tool, and there is nothing wrong with that. Shopify wants merchants to feel covered, and for the catalog half, they increasingly are. But "you're on Shopify" is not an audit, and "eligible products" is not the same as "your pages."

If you want to know whether AI engines can actually read and cite your store, the check has to look at your store.

Sources

• Shopify "Product Page Audit for Agentic Commerce" tool (shopify.com/agentic-readiness), scans run September 28, 2026.
• Parceit audit engine v1.4.0, same three product URLs, September 28, 2026. Raw scan data and screenshots archived at Parceit.