Operations · Intermediate
Verified
Automated verification
- Passed every automated gate: schema, uniqueness, HTTPS and live source link, prompt-injection and safety scan, approval-step rule.
- Drafted by deepseek-flash via DeepSeek API.
- Second-model review: kimi-code/k3.1-pro (no critical or high findings).
- Verified .
- Automated checks and AI review only, not human review.
Audit blog files for AI crawler readability
Check crawler rules, markdown endpoints and request logs for gaps.
Opens BotBento with this bot ready to create. You check it, create it in one click, then connect its apps. Nothing runs until you do.
- On a scheduleWeekly site crawl review
- ThenInspect crawler rules and public files
- ResultReadability gap report
A recurring review of a blog's public files and logs to see whether AI crawlers can find and read the writing. The bot checks crawler rule groups for overrides, looks for declared machine-readable summaries, samples request logs, and reports mismatches between what is published and what crawlers actually request.
Quick answers
What does it do?
Check crawler rules, markdown endpoints and request logs for gaps. Result: Readability gap report.
What does it need?
Tools: Browser, Terminal, Docs, Spreadsheet. Intermediate: some setup. The prompt includes an approval step.
How do I run it?
On a schedule: Weekly site crawl review. Copy the prompt below into a bot in BotBento.
Prompt to start with
BotBentoRecommended
Each run, open the site's public crawler rule files and list every user-agent group and its rules. Note whether specific groups override broader groups, and check any declared machine-readable summary or markdown links. Review log samples the user provides, looking for requests to those paths, then produce a gap report in a doc and a spreadsheet. Do not change site files. Any external send, post, payment, purchase or deletion must wait for the user's approval.