adbar/trafilatura

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

★ 7.1K Stars

⑂ 507 Forks

○ 7.1K Watchers

✖ 68 Issues

Python

article-extractor corpus-builder corpus-tools crawler html-to-markdown html2text llm news-aggregator news-crawler nlp rag readability rss-feed scraping tei text-cleaning text-extraction text-mining text-preprocessing web-scraping

Last push: 20h ago

Created:

↗ View on GitHub ↗ Homepage

Loading additional information…