any4ai/AnyCrawl

AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.

★ 3.5K Stars

⑂ 373 Forks

○ 3.5K Watchers

✖ 6 Issues

TypeScript

ai-scraping aitools crawl data html-to-markdown rag scrape scraping serp webscraper

Last push: 2d ago

Created:

↗ View on GitHub

Loading additional information…