Bot Disclosure

LITV-AISEOAgent-2.0 — Ethical Web Crawler

Last updated: May 2026

What is this crawler?

LITV-AISEOAgent is a web crawler operated by LadyinTechverse (LITV) to provide AI search visibility audits at seoagent.ladyintechverse.com. It fetches publicly accessible web pages to analyse how AI search platforms — ChatGPT, Perplexity, Google AI Overviews, Claude, Gemini and Bing Copilot — discover, parse and cite the page’s content.

User-Agent String

LITV-AISEOAgent/2.0 (+https://seoagent.ladyintechverse.com/bot)

Crawling Ethics

  • Respects robots.txt — crawling stops immediately if disallowed
  • Minimum 2-second delay between requests
  • Maximum 10 pages per analysis session
  • No POST requests, form submissions or login attempts
  • No private or internal IP ranges are crawled
  • Crawled HTML is held in memory only — never stored permanently
  • IP addresses are SHA-256 hashed for rate-limiting; raw IPs are never stored

How to Opt Out

Add this to your robots.txt to prevent LITV-AISEOAgent from crawling your site:

User-agent: LITV-AISEOAgent
Disallow: /

Contact

Questions or concerns: LITV AI SEO Agent Support

Legal Compliance

This crawler operates in compliance with Singapore PDPA, EU GDPR, UK GDPR and general APAC internet privacy standards. It only crawls publicly accessible URLs submitted by users. AI analysis for EU and UK users is processed exclusively via Mistral AI to ensure GDPR-compliant data residency.