Export Crawler Logs as CSV
Export the locally collected crawler records for a chosen analysis. Keep the file private when it includes optional IP information or sensitive URL paths.
Export a useful slice
- Open Bot Analytics → Crawler Logs.
- Set the bot, URL-path and date filters relevant to the question.
- Use the CSV export action and open the file in your analysis tool.
- Record the period, retention and filters alongside your interpretation.
Read the exported fields
The crawler export contains logged request information such as time, matched bot/category and URL path. Optional IP logging depends on your setting. A bot label is a User-Agent match, not proof of provider identity.
Respect collection limits
The export cannot restore records that expired or requests served before WordPress ran. Default log retention is 90 days. Treat a short or empty export as the available collection, not a complete web history.
Keep referrals separate
Human AI referrals have their own local view. Do not assume the crawler CSV is a unified export of both datasets. Compare the screens or use a separately verified data-access method for your analysis. See the log reference.
Next step
Continue with the quick start checklist, or check the common questions. For a reproducible problem, send the plugin versions, affected URL, expected result and actual response through Support. Do not include passwords, license keys or customer details.
Reviewed 6 October 2026 against citelayer® Free 1.13.5, WooCommerce add-on 1.2.19 and EDD add-on 1.2.1. Features depend on the active components and settings on your site.