
About the project
A performant web crawler built with Go, featuring concurrent scraping, rate limiting, and structured data extraction for SEO analysis and content auditing.
- Built in Go (Golang) for high concurrency and efficient network operations.
- Integrates PDF and DOCX parsing through external libraries (pdfcpu and gooxml)
- Features bot protection detection for systems like Cloudflare, Incapsula, and Sucuri






