crawledby.
Sample dashboard. The data is made up and the store doesn’t exist.I want this for my site →
Uukazka-audioshop.cz

Website audit

In your dashboard the audit runs every week (or every day or month) and emails you when something changes. You can also run it any time.

Every week · email on change
Last audit: 6 Oct 2026, 07:001 new problem1 fixed

What changed

Audit result

Some bots can't reach your content.

We checked ukazka-audioshop.cz from the outside: robots.txt, the sitemap and how the server answers 8 specific bots.

22/22
bots allowed in robots.txt
1
bots rejected by the server even though robots.txt allows them
probably hosting or CDN
312 ms
server response time
good, under 500 ms
2860
URLs in the sitemap

What we found

Consider

The server rejects bots your robots.txt allows

robots.txt allows these bots, but when we contacted the server using their name, it answered with an error (429). The block is at the hosting, firewall or CDN level, not in robots.txt. Note: some protections also check the IP address, so they may let the real bot in and reject only us. Only ongoing monitoring gives certainty.

Affects: ClaudeBot

How to fix: Check your firewall, mod_security or hosting rules that block by user agent.

Tip

Product data is missing fields shopping assistants use

The page has structured product data, but it's missing: shippingDetails (delivery), merchantReturnDays (return window). Shopping assistants in AI tools use these fields when comparing offers.

How to fix: Add the missing fields to your product JSON-LD.

Tip

The site has no llms.txt

llms.txt is a new, optional file with a short guide for AI tools. Few read it yet, but it takes minutes to create.

How to fix: Create /llms.txt with a short description of your site and links to key pages.

Bot by bot

The robots.txt column shows what the bot is allowed. The Server response column shows what happened when we actually contacted the server using its name. When they disagree, something other than robots.txt is blocking the bot.

AI search
OAI-SearchBotOpenAI
robots.txt: Allowed (rule for *)
Server response: 200
Response: 76 ms
PerplexityBotPerplexity
robots.txt: Allowed (rule for *)
Server response: 200
Response: 73 ms
Claude-SearchBotAnthropic
robots.txt: Allowed (rule for *)
Server response: not tested
OAI-AdsBotOpenAI
robots.txt: Allowed (rule for *)
Server response: not tested
Meta-WebIndexerMeta
robots.txt: Allowed (rule for *)
Server response: not tested
People asking AI
ChatGPT-UserOpenAI
robots.txt: Allowed (rule for *)
Server response: 200
Response: 99 ms
Claude-UserAnthropic
robots.txt: Allowed (rule for *)
Server response: not tested
Perplexity-UserPerplexity
robots.txt: Allowed (rule for *)
Server response: not tested
Meta-ExternalFetcherMeta
robots.txt: Allowed (rule for *)
Server response: not tested
MistralAI-UserMistral AI
robots.txt: Allowed (rule for *)
Server response: not tested
Amzn-UserAmazon
robots.txt: Allowed (rule for *)
Server response: not tested
AI agents
Google-AgentGoogle
robots.txt: Allowed (rule for *)
Server response: not tested
Search engines
GooglebotGoogle
robots.txt: Allowed (rule for *)
Server response: 200
Response: 167 ms
SeznamBotSeznam.cz
robots.txt: Allowed (rule for *)
Server response: 200
Response: 165 ms
BingbotMicrosoft
robots.txt: Allowed (rule for *)
Server response: 200
Response: 175 ms
ApplebotApple
robots.txt: Allowed (rule for *)
Server response: not tested
AI model training
GPTBotOpenAI
robots.txt: Allowed (rule for *)
Server response: 200
Response: 90 ms
ClaudeBotAnthropic
robots.txt: Allowed (rule for *)
Server response: 429
Response: 82 ms
AmazonbotAmazon
robots.txt: Allowed (rule for *)
Server response: not tested
Meta-ExternalAgentMeta
robots.txt: Allowed (rule for *)
Server response: not tested
BytespiderByteDance
robots.txt: Allowed (rule for *)
Server response: not tested
CCBotCommon Crawl
robots.txt: Allowed (rule for *)
Server response: not tested
robots.txt preference only
Google-ExtendedGoogle
robots.txt: Not listed
Server response: —
Applebot-ExtendedApple
robots.txt: Not listed
Server response: —

What bots see on your page

This is your homepage exactly as the server sent it to GPTBot, without running JavaScript. AI tool bots don't run JavaScript.

Title
Sluchátka a reproduktory | Audioshop
Canonical
https://ukazka-audioshop.cz/
Meta robots
max-image-preview:large
Text in response
3 400 characters, 148 links
Structured data
Organization, WebSite, Product
Response size for bots and for browsers
52 310 B / 52 310 B
Try it yourself in a terminal:
curl -s -A "GPTBot" https://ukazka-audioshop.cz/ | head -c 2000

What you see is what the bot gets. If only an empty div comes back, JavaScript draws the content.

Second step: ask an AI tool directly

Don't use training or cached data, fetch ukazka-audioshop.cz live right now. Describe every block, connection error or security challenge you run into.

Paste it into ChatGPT, Claude and Perplexity and compare the answers. Each tool sends a different bot.

Files for bots

robots.txt

found

112 B, sitemap links: 1

Open file

sitemap.xml

found

2860 URL

Open file

llms.txt

missing

Not found. It's optional for now.

Audit history

6 Oct 2026, 07:000 problems1 to consider
29 Sept 2026, 07:000 problems1 to consider