Tidox Radar

Web Scraping & Browser Automation

Headless browsers, scrapers, and web automation for agents and data collection. · 78 items · 5 this week ▲ 3 · 0 new this week

  1. 1
    vercel-labs/agent-browser
    Browser automation CLI for AI agents.
    GitHub · ★ 45,128 · Rust · first seen 2026-08-07 · hn · reddit
    heat 3.9
    3 / 5 mentions
  2. 2
    degoog-org/degoog
    Self-hosted search engine aggregator with a comprehensive plugin and extension system.
    GitHub · ★ 2,506 · TypeScript · first seen 2026-10-29 · hn · reddit
    heat 2.8
    1 / 2 mentions
  3. 3
    goodnight000/api-anything
    Turn any website into an API by learning from its frontend.
    GitHub · ★ 1,974 · TypeScript · first seen 2026-10-09 · hn · reddit
    heat 2.8
    0 / 5 mentions
  4. 4
    aloneguid/bt
    Browser proxy with rules and scripting.
    GitHub · ★ 524 · C++ · first seen 2026-07-25 · hn · reddit
    heat 2.6
    0 / 5 mentions
  5. 5
    germondai/trawl
    Self-hosted scraping engine bypassing CAPTCHAs.
    GitHub · ★ 1,092 · TypeScript · first seen 2026-09-08 · catalog · reddit
    heat 2.5
    0 / 4 mentions
  6. 6
    daijro/camoufox
    Anti-detect browser for web scraping and fingerprint evasion.
    GitHub · ★ 12,967 · Python · first seen 2026-10-31 · hn · reddit
    heat 2.1
    1 / 2 mentions
  7. 7
    arcanemachine/pw-repl
    Playwright-powered browser automation tool.
    GitHub · ★ 2 · JavaScript · first seen 2026-10-26 · hn
    heat 1.6
    0 / 2 mentions
  8. 8
    stevez/playwright-repl
    Interactive REPL for Playwright browser automation with record and replay.
    GitHub · ★ 14 · TypeScript · first seen 2026-10-26 · hn
    heat 1.6
    0 / 2 mentions
  9. 9
    shouvik12/leantext
    Web page to lean Markdown converter reducing tokens by up to 99%.
    GitHub · ★ 1 · Python · first seen 2026-11-01 · reddit
    heat 1.4
    0 / 2 mentions
  10. 10
    jnh12/doomer-agent
    AI agent that autonomously browses and scrolls social media reels.
    GitHub · ★ 6 · first seen 2026-10-30 · reddit
    heat 1.3
    0 / 2 mentions
  11. 11
    orelrevivo/agents-browser
    Open-source browser automation using multiple AI agents for everyday tasks.
    GitHub · ★ 3 · TypeScript · first seen 2026-10-30 · reddit
    heat 1.3
    0 / 2 mentions
  12. 12
    mwakidenis/webcheck-osint
    All-in-one OSINT reconnaissance tool for websites.
    GitHub · ★ 348 · TypeScript · first seen 2026-10-13 · reddit
    heat 1.3
    0 / 3 mentions
  13. 13
    tulipfarm/huntsman
    Self-hosted web scraper turning pages into clean Markdown with Firecrawl API.
    GitHub · ★ 4 · Go · first seen 2026-10-31 · hn
    heat 1.0
    0 / 1 mentions
  14. 14
    agent-labs-dev/fastbrowse
    Fast browser agent with LLM planning and cited answers.
    GitHub · ★ 173 · Rust · first seen 2026-10-30 · hn
    heat 1.0
    0 / 1 mentions
  15. 15
    y2z/monolith
    Saves complete web pages as single HTML files.
    GitHub · ★ 15,570 · Rust · first seen 2026-10-12 · hn
    heat 0.8
    0 / 2 mentions
  16. 16
    hybirdss/hycli
    Turn website tasks into verified CLI and MCP actions for AI.
    GitHub · ★ 444 · Rust · first seen 2026-10-25 · hn
    heat 0.8
    0 / 1 mentions
  17. 17
    north-web-dev/impersonate-http
    Go HTTP client with browser TLS fingerprint to bypass JA3/JA4 blocking.
    GitHub · ★ 7 · Go · first seen 2026-10-25 · hn
    heat 0.8
    0 / 1 mentions
  18. 18
    figranium/figranium
    Stack blocks visually to build browser workflows.
    GitHub · ★ 779 · HTML · first seen 2026-08-18 · hn · reddit
    heat 0.6
    0 / 6 mentions
  19. 19
    nodemaven/proxy-benchmark
    Measure and benchmark proxy providers, browser engines, and web scraping targets.
    GitHub · ★ 69 · Python · first seen 2026-09-17 · hn
    heat 0.6
    0 / 4 mentions
  20. 20
    s0cks/docker-chromium-screenshot
    Create screenshot of SPA using Playwright, Chromium and Docker.
    GitHub · ★ 5 · Go · first seen 2026-10-14 · reddit
    heat 0.6
    0 / 2 mentions
  21. 21
    PicClick
    eBay visual search engine.
    catalog · fmhy · first seen 2026-10-27 · catalog
    heat 0.6
    0 / 1 mentions
  22. 22
    dumduky/myna-browser-agent
    Open-source browser agent alternative to Claude in Chrome.
    GitHub · ★ 5 · JavaScript · first seen 2026-10-25 · reddit
    heat 0.5
    0 / 1 mentions
  23. 23
    Qovia
    API for Chinese social media data across 20+ platforms.
    catalog · chinese-indie-dev · first seen 2026-10-25 · catalog
    heat 0.5
    0 / 1 mentions
  24. 24
    c0decave/sift
    Sift everything with comprehensive search capabilities.
    GitHub · ★ 1 · Python · first seen 2026-10-16 · hn
    heat 0.5
    0 / 1 mentions
  25. 25
    masakaai/jet-browser
    Portable WebKit runtime for AI agents with reproducible benchmarks.
    GitHub · ★ 2 · JavaScript · first seen 2026-10-09 · catalog
    heat 0.5
    0 / 2 mentions
  26. 26
    ermultimidia/deepsfetch-developer-kit
    Developer tools and SDKs for DeepSFetch web scraping.
    GitHub · ★ 4 · JavaScript · first seen 2026-10-13 · hn
    heat 0.4
    0 / 1 mentions
  27. 27
    vsmutok/ytscrape
    YouTube scraper extracting video data without API keys or quotas.
    GitHub · ★ 58 · Python · first seen 2026-10-04 · reddit
    heat 0.4
    0 / 2 mentions
  28. 28
    mastro-hq/mastro-connect
    Build agent connectors for web apps with session capture and OpenAPI.
    GitHub · ★ 7 · TypeScript · first seen 2026-10-12 · hn
    heat 0.4
    0 / 1 mentions
  29. 29
    xd-mhloo/facebook-gql-scraper
    Scrapes Facebook GraphQL data without API key for profiles and posts.
    GitHub · ★ 55 · Python · first seen 2026-10-12 · hn
    heat 0.4
    0 / 1 mentions
  30. 30
    praveennimilka/hermo
    Turn website workflows into local REST APIs and MCP tools.
    GitHub · ★ 45 · JavaScript · first seen 2026-10-20 · reddit
    heat 0.4
    0 / 1 mentions
  31. 31
    coding-doctor-omar/reddrix
    Blazing-fast Reddit scraper for Python without login or API.
    GitHub · ★ 131 · Python · first seen 2026-10-19 · reddit
    heat 0.4
    0 / 1 mentions
  32. 32
    aindeev/agent-chrome-relay
    Lets AI agents control your Chrome in background tabs.
    GitHub · ★ 284 · Go · first seen 2026-10-10 · hn
    heat 0.4
    0 / 1 mentions
  33. 33
    beatapi/beatbrowser
    Chrome extension turning browser into agent automation platform
    GitHub · ★ 33 · JavaScript · first seen 2026-10-18 · catalog
    heat 0.4
    0 / 1 mentions
  34. 34
    realthalesgit/site2local
    Python tool that mirrors existing websites to localhost or external IPs.
    GitHub · ★ 9 · Python · first seen 2026-10-16 · reddit
    heat 0.3
    0 / 1 mentions
  35. 35
    zhoujungis/nanobrowser
    Ultra-light Tauri browser plus headless automation agent drivable via MCP.
    GitHub · ★ 1 · Rust · first seen 2026-10-16 · catalog
    heat 0.3
    0 / 1 mentions
  36. 36
    nodemaven/google-browser-scraper
    Self-hosted Google search scraper with MCP for agents.
    GitHub · ★ 102 · Python · first seen 2026-10-07 · hn
    heat 0.3
    0 / 1 mentions
  37. 37
    wael-sudo2/facebook-page-info-scraper
    Free Facebook pages metadata scraping library with unlimited calls.
    GitHub · ★ 70 · Python · first seen 2026-10-14 · reddit
    heat 0.3
    0 / 1 mentions
  38. 38
    yail259/frankensurf
    One read call for AI agents from 41 web tools.
    GitHub · ★ 107 · Python · first seen 2026-10-14 · reddit
    heat 0.3
    0 / 1 mentions
  39. 39
    rayoplateado/jurl
    curl wrapper that reads and summarizes web pages using LLMs.
    GitHub · ★ 3 · Rust · first seen 2026-10-05 · hn
    heat 0.3
    0 / 1 mentions
  40. 40
    xhluca/mini-web-agent
    Web agents using frontier models implemented in 400 lines Python.
    GitHub · ★ 4 · Python · first seen 2026-10-05 · hn
    heat 0.3
    0 / 1 mentions
  41. 41
    aix567/sitegrab
    Recursively mirrors websites to disk with all assets.
    GitHub · ★ 18 · C# · first seen 2026-10-12 · reddit
    heat 0.3
    0 / 1 mentions
  42. 42
    YouTube Video Finder
    Multi-archive search engines for finding archived YouTube videos.
    catalog · fmhy · first seen 2026-10-12 · catalog
    heat 0.3
    0 / 1 mentions
  43. 43
    localscreenshot
    Screenshot API turning public pages into images or PDFs.
    catalog · free-for-dev · first seen 2026-10-12 · catalog
    heat 0.3
    0 / 1 mentions
  44. 44
    ilinic/researchtube
    AI research toolkit exploring YouTube, websites and downloading media.
    GitHub · JavaScript · first seen 2026-10-10 · reddit
    heat 0.2
    0 / 1 mentions
  45. 45
    lucasdantas2701/anchor
    Web automation agent with self-healing using local LLM planning.
    GitHub · ★ 6 · Python · first seen 2026-10-10 · reddit
    heat 0.2
    0 / 1 mentions
  46. 46
    ironbee-ai/ironbee-express
    Fast cheap browser agent with Jev and deep reasoning capability.
    GitHub · ★ 14 · TypeScript · first seen 2026-10-01 · hn
    heat 0.2
    0 / 1 mentions
  47. 47
    transitive-bullshit/multipart-http-get-requests
    Allow agents to upload files using HTTP GET requests
    GitHub · ★ 1 · Python · first seen 2026-09-30 · hn
    heat 0.2
    0 / 1 mentions
  48. 48
    browserbase/stagehand
    SDK for web data extraction and browser automation with agents.
    GitHub · ★ 25,898 · TypeScript · first seen 2026-09-18 · hn
    heat 0.2
    0 / 3 mentions
  49. 49
    ianks/fast-agentic-browser
    CLI for AI agents to browse, scrape and automate the web.
    GitHub · ★ 2 · HTML · first seen 2026-09-29 · hn
    heat 0.2
    0 / 1 mentions
  50. 50
    autokeren/ghostfox
    Gecko agent browser with 71 MCP tools and native vision capabilities
    GitHub · ★ 13 · C++ · first seen 2026-09-28 · hn
    heat 0.2
    0 / 1 mentions
  51. 51
    The Crawler Zoo
    Web crawler database and bot blocking guides.
    catalog · fmhy · first seen 2026-10-06 · catalog
    heat 0.2
    0 / 1 mentions
  52. 52
    searx/searx
    Privacy-respecting metasearch engine aggregating multiple search providers.
    GitHub · ★ 13,562 · Python · first seen 2026-10-18 · hn
    heat 0.2
    0 / 1 mentions
  53. 53
    octantes/scavenger
    Extract web page components into portable HTML snippets with single-file tools.
    GitHub · ★ 10 · JavaScript · first seen 2026-09-15 · hn
    heat 0.2
    0 / 3 mentions
  54. 54
    Playwright
    Browser automation frameworks including Playwright and Selenium.
    catalog · fmhy · first seen 2026-10-02 · catalog
    heat 0.2
    0 / 1 mentions
  55. 55
    wasi-master/13ft
    Self-hosted paywall bypass tool replacing 12ft.io.
    GitHub · ★ 4,352 · Python · first seen 2026-10-11 · hn
    heat 0.1
    0 / 1 mentions
  56. 56
    URLpipe
    Read pages after JavaScript execution with metadata and audits.
    catalog · free-for-dev · first seen 2026-09-25 · catalog
    heat 0.1
    0 / 1 mentions
  57. 57
    Dembrandt
    Extract and derive website design elements.
    catalog · fmhy · first seen 2026-09-23 · catalog
    heat 0.1
    0 / 1 mentions
  58. 58
    Wyzie Subs
    Subtitle scraping API with npm package.
    catalog · fmhy · first seen 2026-09-23 · catalog
    heat 0.1
    0 / 1 mentions
  59. 59
    h4ckf0r0day/obscura
    Headless browser for AI agents and web scraping automation.
    GitHub · ★ 29,952 · Rust · first seen 2026-08-08 · hn
    heat 0.1
    0 / 3 mentions
  60. 60
    kodomoppoi/real-estate-scrapper
    Web scraper for real estate advertisements.
    GitHub · ★ 1 · Python · first seen 2026-08-31 · hn · reddit
    heat 0.1
    0 / 3 mentions
  61. 61
    luantak/mosaik
    Browser automation using reusable pieces.
    GitHub · ★ 13 · TypeScript · first seen 2026-09-08 · reddit
    heat 0.1
    0 / 2 mentions
  62. 62
    hbmartin/agent-web-search
    TypeScript search aggregation library for multiple web providers.
    GitHub · ★ 3 · TypeScript · first seen 2026-10-05 · hn
    heat 0.1
    0 / 1 mentions
  63. 63
    socai-io/jev-social
    Local-first social media research agent for Instagram, TikTok, and LinkedIn with Jev.
    GitHub · ★ 194 · JavaScript · first seen 2026-09-20 · catalog
    heat 0.1
    0 / 1 mentions
  64. 64
    puffinsoft/mousecrack
    Imitate human mouse movement with deep learning.
    GitHub · ★ 85 · TypeScript · first seen 2026-07-26 · hn · reddit
    heat 0.1
    0 / 9 mentions
  65. 65
    flaresolverr/flaresolverr
    Proxy server bypassing Cloudflare protection.
    GitHub · ★ 16,104 · Python · first seen 2026-08-31 · catalog · hn
    heat 0.1
    0 / 2 mentions
  66. 66
    only-cli/oc
    Convert websites to compact CLI for AI agent consumption.
    GitHub · ★ 547 · JavaScript · first seen 2026-08-19 · hn
    heat 0.1
    0 / 2 mentions
  67. 67
    eigenpal/openparser
    OpenParser schema, adapters and SDKs for document parsing and OCR.
    GitHub · ★ 12 · TypeScript · first seen 2026-07-29 · hn
    heat 0.1
    0 / 3 mentions
  68. 68
    thephaseless/byparr
    Get antibot cookies for web automation.
    GitHub · ★ 2,053 · Python · first seen 2026-07-26 · catalog · reddit
    heat 0.1
    0 / 2 mentions
  69. 69
    GitHub Dorks
    GitHub search tool for finding code patterns.
    catalog · fmhy · first seen 2026-09-09 · catalog
    heat 0.1
    0 / 1 mentions
  70. 70
    jsdfe
    JavaScript deobfuscator and code reverse engineer.
    catalog · fmhy · first seen 2026-09-09 · catalog
    heat 0.1
    0 / 1 mentions
  71. 71
    Virgil Software Search
    Multi-site software search engine.
    catalog · fmhy · first seen 2026-08-31 · catalog
    heat 0.0
    0 / 1 mentions
  72. 72
    panniantong/agent-reach
    AI agent reading internet from Twitter to GitHub.
    GitHub · ★ 107,556 · Python · first seen 2026-08-02 · hn
    heat 0.0
    0 / 2 mentions
  73. 73
    agentrhq/webcmd
    Self-learning agent for web browser automation.
    GitHub · ★ 2,757 · TypeScript · first seen 2026-07-28 · hn · reddit
    heat 0.0
    0 / 3 mentions
  74. 74
    briembra/slimmandje-recepten
    TikTok recipe extractor with shopping cart integration.
    GitHub · ★ 7 · TypeScript · first seen 2026-08-05 · reddit
    heat 0.0
    0 / 2 mentions
  75. 75
    mcasrom/nearme-osint
    Geographic OSINT aggregation engine.
    GitHub · ★ 1 · HTML · first seen 2026-08-01 · hn · reddit
    heat 0.0
    0 / 2 mentions
  76. 76
    mikeluu99/searxng-rust
    Metasearch engine similar to SearXNG written in Rust.
    GitHub · ★ 114 · Rust · first seen 2026-08-03 · hn
    heat 0.0
    0 / 2 mentions
  77. 77
    lexiforest/curl_cffi
    Python HTTP client impersonating browser TLS fingerprints.
    GitHub · ★ 6,808 · Python · first seen 2026-07-18 · hn
    heat 0.0
    0 / 2 mentions
  78. 78
    YouTube Metadata Search
    YouTube metadata search tool.
    catalog · fmhy · first seen 2026-08-03 · catalog
    heat 0.0
    0 / 1 mentions