List of libraries, tools and APIs for web scraping and data processing.

The All in One Framework to Build Undefeatable Scrapers

Web data extraction tool implemented as chrome extension

Web scraper, crawler and parser in C#. Designed as simple, declarative and scalable web scraping solution.

Web Data Scraper - no-code internet scraping. Extract and export to CSV, Excel, JSON, Google Sheets, and Webhook.

Instagram user's photos and videos downloader. Download all media files from any username. Working 2022!

Simple library which helps you to retrieve the source of various video streaming sites.

MCP server enabling agents to debug HTTP requests better (using powhttp)

Spin up Tor containers and then proxy HTTP requests via these Tor instances

📱 A utility for downloading Android apps from the Google Play Store and Xiaomi App Store (the Chinese App Store).

Zoominfo scraper with using of rotating proxies and headless Chrome from ScrapingAnt

🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖

Producthunt.com famous website scraper script. Scrap all offers and save in spreadsheet excel file.

An declarative and easy to use web crawler and scraper in C#

An API wrapper for Scrappey.com written in Python (cloudflare, datadome bypass & solver)

Alibaba scraper with using of rotating proxies and headless Chrome from ScrapingAnt

This project was inspired by the unclecode/crawl4ai repository. It provided valuable insights and ideas that helped shape the development of Crewzombitx64.

GPT4 Assisted Web Scraping Library

A list of libraries, tools, and APIs for web scraping and data processing. Find everything you need for extracting, managing, and processing data from the web, from HTTP libraries to browser automation tools and proxy services.

Building a dataset of Twitter replies for unsupervised learning / bot-blocking