#scraping

  1. scraper

    HTML parsing and querying with CSS selectors

    v0.25.0 1.0M #css-selectors #css #selectors #scraping
  2. dom_query

    HTML querying and manipulation with CSS selectors

    v0.25.1 3.6K #css-selectors #html-parser #css #css-parser #scraping
  3. scrape-core

    High-performance HTML parsing library core

    v0.2.3 750 #css-selectors #html-parser #scraping #dom
  4. rusaint

    SSU u-saint client

    v0.14.0 #u-saint #scraping #ssu #parser
  5. wdpe

    WebDynpro Parse Engine

    v0.4.0 #sap #parser #webdynpro #scraping
  6. dom_finder

    HTML parsing with CSS selectors

    v0.5.0 650 #css-selectors #css #scraping #html-parser #selectors
  7. recurl

    Drop-in curl replacement with automatic anti-bot bypass

    v0.1.1 #curl #anti-bot #scraping
  8. html-filter

    parse, filter, search and edit an HTML file

    v0.2.2 #html-parser #scraping #html
  9. spider-browser

    Browser automation client for Spider's pre-warmed browser fleet with smart retry and browser switching

    v0.2.0 #browser-automation #stealth #scraping #api-bindings
  10. chadselect

    Unified data extraction — Regex, XPath 1.0, CSS Selectors, and JMESPath behind one query interface

    v0.2.1 #xpath #css #jmespath #extract #scraping
  11. cari

    popular HTML parsing utility pup

    v1.0.0 #css-selectors #html-parser #command-line #scraping
  12. cloudscraper-rs

    Early-stage Cloudflare challenge solver bringing Python's Cloudscraper ideas to Rust

    v0.2.0 #cloudflare #bypass #anti-bot #challenge #scraping
  13. webpage-info

    Modern library to extract webpage metadata: title, description, OpenGraph, Schema.org, links, and more

    v1.0.1 #open-graph #metadata #html #scraping
  14. tsukiyomi-fetch

    A performance-optimized Rust-powered stats fetcher with async API calls, 24h intelligent caching, and customizable Fastfetch wrappers for platforms like GitHub, Discord, Codeforces, LeetCode, and more

    v0.1.2 #discord #cache #discord-api #scraping
  15. surfai

    Advanced browser automation library with human-like interactions and stealth capabilities for web scraping

    v0.1.2 #browser-automation #chromium #stealth #scraping
  16. accessibility-scraper

    HTML parsing and querying with CSS selectors with CSS binding styles to elements

    v0.0.14 110 #css-selectors #css #selectors #scraping
  17. atletiek_nu_api

    A scraping library for the atletiek.nu website

    v0.2.7 350 #athletics #scraping #api-bindings
  18. lbc-rs

    Unofficial client for Leboncoin API, inspired by the Python implementation etienne-hd/lbc

    v0.1.1 #api-client #leboncoin #scraping #client #api
  19. lazyanki

    workspace for Anki automation and parsing tools

    v0.1.3 #automation #scraping #cli-parser #anki
  20. nipper

    HTML manipulation with CSS seletors

    v0.1.9 2.5K #css-selectors #css #selectors #scraping
  21. klepto

    a general purpose extraction and data scraping utility

    v0.1.1 #extract #data #scraping
  22. search-api

    Search Engine Result scraping

    v0.2.3 #search-engine #scraping
  23. mlscraper-rust

    Scrape structured data from HTML documents automatically

    v0.1.2 #css #selectors #scraping
  24. easy-scraper

    HTML scraping library focused on easy to use

    v0.2.0 130 #web-scraping #html #scraping
  25. h2s

    A declarative HTML parser, which works like a deserializer from HTML to struct

    v0.18.0 #html-parser #dom #scraping
  26. blockpalettes-client

    Unofficial Rust client for BlockPalettes with built-in HTTP and scraping support

    v0.1.1 #palette #web-api #minecraft #search #scraping #nt #color-palette
  27. piconbiere

    Scrape and download media from Piccoma/ピッコマ

    v0.3.1 #piccoma #webtoon #scraping #manga
  28. htmler

    HTML parsing and querying with CSS selectors

    v0.1.1 #css #selectors #scraping
  29. scraper_forky

    HTML parsing and querying with CSS selectors

    v0.17.2-rc #css #selectors #scraping
  30. frangipani

    Scraping framework for rust

    v0.3.1 #web-scraping #continuous-crawler #web-crawler #scraper #scraping
  31. Try searching with DuckDuckGo.

  32. thirtyfour-stealth

    A stealthy, undetected implementation of thirtyfour for web automation

    v0.1.3 #web-driver #automation #stealth #selenium #scraping
  33. test_61a7cd7f28e0

    testing scraping examples

    v0.1.3-withoutpathdeps #testing #scraping #61a7cd7f28e0
  34. fast_scraper

    HTML parsing and querying with CSS selectors

    v0.14.5 #css #selectors #scraping
  35. maera

    A monitor for periodically scraping websites with genuine browser fingerprints

    v0.1.3 #fingerprinting #scraping
  36. get_user_agent

    easy to use rust CLI program and library for extracting the latest user agents of all browsers on Windows, Mac, Linux, Android, and iOS platforms

    v0.1.1 #user-agent #browser-identity #scraping
  37. hyraigne

    Web spiders to scrap various man{ga,hua;hwa}s websites

    v0.1.4 #webtoon #manga #manhwa #manhua #scraping
  38. html-extractor

    extracting data from HTML

    v1.0.0 100 #web-scraping #web #scraping
  39. rocketapi

    Unofficial RocketAPI Rust SDK for Instagram & Threads Private API 2024

    v0.1.1 180 #scraping #instagram #instagram-api #parser
  40. lanis-rs

    A API for Lanis (Schulportal Hessen)

    v0.3.0 270 #sph #schulportal #api #scraping
  41. git-spy

    command-line tool to efficiently collect github repository

    v0.1.2 #github-repository #scraping #terminal
  42. dom-manipulator

    HTML parsing, querying and serializing

    v0.1.0 #css #selectors #scraping
  43. test_7018a98a70c0

    testing scraping examples

    v0.1.1-withdocsrssettings #testing #7018a98a70c0 #scraping
  44. test_40a48f47864a

    testing scraping examples

    v0.1.1-withdocsrssettings #testing #40a48f47864a #scraping
  45. yahoo-finance-symbols

    scraping all Ticker Symbols from Yahoo Finance

    v0.1.4 370 #yahoo-finance #symbols #ticker #database #scraping
  46. lazyanki-common

    LazyAnki - Rust workspace for Anki automation and parsing tools

    v0.1.3 #automation #scraping #cli-parser #anki
  47. webscrapingapi

    API that allows scraping websites while using rotating proxies to prevent bans. This SDK for Rust makes the usage of the API easier to implement in any project you have.

    v0.1.0 #scrape #scrapingapi #scraping #proxy
  48. bibe

    CLI tool to download from various man{ga,hua;hwa}s websites

    v0.1.4 #webtoon #manhwa #manhua #scraping #manga
  49. lookout

    👀 Declarative, asynchronous scraper utility

    v0.1.1 #web-scraping #scraper #scraping
  50. ktorrent

    only for scraping korean torrent sites

    v0.2.0 #bittorrent #korean #site #scraping #find #href #user-agent
  51. github-heatmap

    A CLI tool used to scrape a Github profile and mirror the SVG contribution heatmap as Unicode

    v1.0.0 #heatmap #contributions #scraping
  52. pt_down_core

    Crossplatform (including android) telegram bot. Converts given tiktok url into video or slides. Its working by scraping Proxitok, so that means, you dont have to touch tiktok servers at all

    v1.0.1 #telegram-bot #proxitok #tiktok #scraping #android #video #slide #cross-platform
  53. pocket-prometheus

    TUI for prometheus metrics scraping

    v0.1.4 #prometheus #tui #metrics #pocket #scraping #debugging #nodejs #git-clone #event-loop
  54. dachterasse

    scraping the HPI lecture overview site

    v0.1.4 #site #lecture #hpi #scraping #overview
  55. urls2disk

    Http client to download urls to disk concurrently, optionally converting them to PDF

    v0.1.1 #pdf #scrape #scraping
  56. scrapi

    A cli tool for scraping websites

    v0.2.0 #scrape #scraping #cli