StealIt

8 skills · 3 publishers

Claude skills for web scraping

Crawl sites and extract structured data responsibly, for research, SEO audits and competitive analysis.

The best Claude skills for web scraping

  1. 1

    Agent Browser

    Vercel 46k

    Browser automation CLI for AI agents. Use when the user needs to interact with websites, including navigating pages, filling forms, clicking buttons, taking screenshots, extracting data, testing web…

    npx skills add vercel-labs/agent-browser --skill agent-browser
  2. 2

    SEO

    Agrici Daniel 27k

    Comprehensive SEO analysis for any website or business type. Full site audits, single-page analysis, technical SEO (crawlability, indexability, Core Web Vitals with INP), schema markup, content…

    Install as a Claude Code plugin →
  3. 3

    Prospecting

    Corey Haines 58k

    When the user wants to find, qualify, and build a list of prospects to reach out to, across B2B SaaS, general B2B, or local small businesses. Also use when the user mentions "prospecting," "build a…

    npx skills add coreyhaines31/marketingskills --skill prospecting

All 8 web scraping skills

8 skills

Agent BrowserTop pick

Browser automation CLI for AI agents. Use when the user needs to interact with websites, including navigating pages, filling forms, clicking buttons, taking screenshots…

Testing & BrowserVercel46k

SEOTop pick

Comprehensive SEO analysis for any website or business type. Full site audits, single-page analysis, technical SEO (crawlability, indexability, Core Web Vitals with INP), schema…

Marketing & SEOAgrici Daniel27k

Prospecting

When the user wants to find, qualify, and build a list of prospects to reach out to, across B2B SaaS, general B2B, or local small businesses. Also use when the user mentions…

Marketing & SEOCorey Haines58k

SEO Audit

When the user wants to audit, review, or diagnose SEO issues on their site. Also use when the user mentions "SEO audit," "technical SEO," "why am I not ranking," "SEO issues,"…

Marketing & SEOCorey Haines58k

SEO GEO

Audit and improve content for AI Overviews and answer engines, including citability, entity clarity, crawler access, brand signals, and passage structure. Use when the user asks…

Marketing & SEOAgrici Daniel27k

SEO Technical

Audit technical SEO across crawlability, indexability, security, URLs, mobile, Core Web Vitals, rendering, structured data, and IndexNow. Use when the user asks for a technical…

Marketing & SEOAgrici Daniel27k

Blog GEO

Audit one blog post file for AI-citation readiness (self-contained, sourced passages, entity clarity, structure, crawler access) and score it with an internal 0-100 heuristic plus…

Marketing & SEOAgrici Daniel2.6k

Blog Locale Audit

Read-only audit of a folder of existing multilingual blog posts: translation coverage, parity, hreflang and canonical consistency, meta-tag parity, and stale translations, with a…

Marketing & SEOAgrici Daniel2.6k

About these web scraping skills

This page collects every skill in the directory that covers web scraping: 8 from 3 publishers, including official skills from Vercel. Each one links back to its original GitHub repository, so you always get the author's latest version. They span Testing & Browser and Marketing & SEO.

Publishers on this page

Questions about Claude skills for web scraping

What is the best Claude skill for web scraping?

Our top pick is Agent Browser by Vercel, from a repository with 46k GitHub stars. SEO and Prospecting round out the top three. Skills are ranked by the popularity of their source repository, with hand-picked favorites first, and official skills from Vercel carry a badge.

How do I install a Claude skill for web scraping?

Open a skill's page and run its install command in your project folder, for example npx skills add vercel-labs/agent-browser --skill agent-browser. You can also download any skill as a ZIP and add it to Claude Code or upload it to the Claude app.

Skills from claude-seo and claude-blog rely on shared scripts and agents, so install them as a Claude Code plugin. Their pages show the two commands.

The install guide walks through every method.

Are Claude skills for web scraping free?

Yes. All 8 skills on this page are open source and free to use, and most are MIT licensed. You need a Claude plan that supports skills, or a coding agent that reads SKILL.md files.

Do these skills work in Claude Code and the Claude app?

Yes. A skill is a folder with a SKILL.md file, and the same folder works in Claude Code, the Claude desktop and web apps (on paid plans with code execution turned on) and the Claude API. Many also work in other agents that support the Agent Skills format, such as Cursor and OpenAI Codex. Skills that ship scripts need somewhere Claude can run code.

How many Claude skills for web scraping are there?

We list 8 from 3 publishers, last updated November 4, 2026. The list refreshes from GitHub as publishers release new skills.

All use cases →