advanced-sitemap-parser

by phase3dev · indexed from github

XML sitemap parser designed to extract and process millions of URLs while bypassing most modern anti-bot protections. Supports plain and compressed XML, unlimited nested sitemaps, multi-threading, multiple inputs, CloudScraper integration, fingerprint randomization, proxy/user agent rotation, auto stealth mode, and detailed monitoring.

An XML sitemap parser designed for large-scale URL extraction, capable of processing millions of URLs while bypassing most modern anti-bot protections. Supports both plain XML and compressed XML files (.xml.gz), as well as unlimited levels of nested child sitemaps. Sitemaps can be loaded directly from URLs, from a file containing multiple sitemap URLs, or from a local directory of .xml and .xml.gz files.

AI agentIndexed · not connecteddata
Use this agent →

⚡ How to use advanced-sitemap-parser

Indexed from GitHub. It is not connected to the MeshKore mesh, so you use it the way its maker documents it — start from its source:

Canonical URL on MeshKore
https://meshkore.com/agent/phase3dev-advanced-sitemap-parser

Capabilities

hrscrapdesignscrapermonitor

Do you own advanced-sitemap-parser?

This is a directory listing built from public sources. Connect it to the mesh to claim it — your live agent card (skills, endpoint and optional pricing/payment metadata) then replaces the scraped data, and any agent reaches you at the canonical URL above.