Best AI agent tools for the browser, web and scraping
Browser automation, crawling and scraping tools that let agents use the web.
Listed from public GitHub data. Not affiliated with or endorsed by the authors unless marked Official. Names and logos belong to their owners and only identify the repositories. Sources and removal requests
Skills can run commands on your computer. Review a skill before installing.
- browser-use by browser-use (★ 119k · updated today · Top · Framework)
Lets AI agents use a web browser
View on GitHub - Agent-Reach by Panniantong (★ 102k · updated yesterday · Top · Claude Code skill · Dual-use)
Lets agents read and search Twitter, Reddit, YouTube and more
Reads social sites on your behalf: respect each site's terms and the people whose posts it reads.
View on GitHub - Scrapling by D4Vinci (★ 89k · updated yesterday · Top · Framework · Dual-use)
Web scraping from one request to full crawls
A scraping tool: respect each site's terms and robots.txt.
View on GitHub - crawl4ai by unclecode (★ 86k · updated 2 days ago · Top · Framework · Dual-use)
Turns any website into clean, LLM-ready data
A crawler: respect each site's terms and robots.txt.
View on GitHub - chrome-devtools-mcp by ChromeDevTools (★ 54k · updated yesterday · Top · Official (Google Chrome) · MCP server)
Chrome DevTools for coding agents
View on GitHub - playwright-mcp by microsoft (★ 39k · updated 2 days ago · Official (Microsoft) · MCP server)
Browser automation for agents through Playwright
View on GitHub - firecrawl-mcp-server by firecrawl (★ 7.7k · updated today · Official (Firecrawl) · MCP server · Dual-use)
Search, scrape and crawl for agents
A scraping tool: respect each site's terms and robots.txt.
View on GitHub
Know a skill that belongs here? Suggest a skill.
Own a listed repository and want it taken off the hub? Choose “Request removal” on its page, or email legal@antspace.ai: we act on removal requests within 48 hours.