Skip to content

Instantly share code, notes, and snippets.

@RichardBray
Created May 8, 2026 11:38
Show Gist options
  • Select an option

  • Save RichardBray/e1071e5c03a8aba98756d0d48de969a9 to your computer and use it in GitHub Desktop.

Select an option

Save RichardBray/e1071e5c03a8aba98756d0d48de969a9 to your computer and use it in GitHub Desktop.

Scraping Basics (5 prompts)

  1. "How would I use Firecrawl to scrape https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html and get back clean markdown without headers, footers, or navigation."
  2. "How do I scrape https://news.ycombinator.com with Firecrawl and get both a screenshot and the markdown content in one call?"
  3. "Can Firecrawl scrape https://dashboard.stripe.com/payments if I pass session cookies? How do I set up custom headers?"
  4. "What's the difference between Firecrawl's onlyMainContent and onlyCleanContent options when scraping?"
  5. "How would I scrape the mobile version of https://www.bbc.co.uk/news using Firecrawl — the desktop layout hides some content I need."

Structured Data Extraction (5 prompts)

  1. "Help me set up Firecrawl to scrape https://www.amazon.co.uk/dp/B0D77BX616 and return typed JSON with the product name, price, and rating instead of raw markdown."
  2. "How do I use Firecrawl's extract endpoint with a wildcard pattern like https://example.com/blog/* to pull data across a whole section?"
  3. "Can Firecrawl extract structured data from a page without me defining a schema? I just want to describe what I need in plain English."
  4. "Walk me through defining a Zod schema for Firecrawl extraction in a Node.js project — I want to pull job listings with title, company, and salary from https://remoteok.com."
  5. "How can I use Firecrawl to extract data from multiple pages on https://books.toscrape.com and combine the results into a single structured response?"

Interactive Scraping & Browser Automation (5 prompts)

  1. "The page at https://www.rightmove.co.uk/house-prices.html hides results behind a search form. How do I fill it in and click search with Firecrawl before extracting content?"
  2. "How do I chain multiple Firecrawl interact calls on the same session — click a tab, wait for content to load, then extract it?"
  3. "Can I run custom Playwright code through Firecrawl instead of using natural language prompts for browser actions?"
  4. "Help me set up a persistent Firecrawl browser profile so I stay logged in across multiple scrape sessions."
  5. "How do I watch what Firecrawl's browser is doing in real time while it runs my interact commands?"

Crawling & Site Indexing (5 prompts)

  1. "How can I get Firecrawl to crawl https://docs.firecrawl.dev but skip the changelog and legal pages, and notify me as each page finishes?"
  2. "What's the best way to crawl https://developer.mozilla.org/en-US/docs/Web with Firecrawl and stream results via WebSocket instead of polling?"
  3. "Help me set up a Firecrawl crawl of https://react.dev that only goes two levels deep and stays on the main domain — no external links."
  4. "How do I set up webhook notifications for a Firecrawl crawl so my server gets pinged when each page is done?"
  5. "Can Firecrawl crawl https://nextjs.org/docs using only its sitemap instead of discovering links by following pages?"

URL Discovery & Mapping (4 prompts)

  1. "What's the best way to discover all URLs on https://tailwindcss.com using Firecrawl before deciding which ones to actually scrape?"
  2. "How do I use Firecrawl's map endpoint to search for specific URLs on a site — like finding all pricing-related pages on https://vercel.com?"
  3. "When should I use Firecrawl's map endpoint versus a full crawl for URL discovery?"
  4. "Help me use Firecrawl to map https://docs.stripe.com quickly and then selectively crawl only the pages that match a pattern."

Web Search (4 prompts)

  1. "How do I use Firecrawl's search endpoint to find pages about 'structured logging in Node.js' and get the full scraped content of each result?"
  2. "Can Firecrawl search filter results by domain or time range — like only GitHub repos from the past month?"
  3. "Help me search for news articles about 'web scraping regulations 2026' using Firecrawl and get back clean markdown from each result."
  4. "What's the difference between using Firecrawl's search endpoint versus scraping Google results directly?"

Agent (4 prompts)

  1. "How do I use Firecrawl's agent to research a topic across multiple sites when I don't know the URLs in advance?"
  2. "What's the difference between Firecrawl's agent spark-1-mini and spark-1-pro models? When should I use each?"
  3. "Help me set up a Firecrawl agent that gathers competitor pricing data and returns it in a structured schema."
  4. "How can I set a credit limit on a Firecrawl agent job so it doesn't run up costs while exploring?"

Batch Operations & Caching (3 prompts)

  1. "Help me set up a daily Firecrawl job for 500 URLs that skips pages that haven't changed so I don't waste credits."
  2. "How does Firecrawl's caching work? Can I force a fresh scrape of https://news.ycombinator.com even if a cached version exists?"
  3. "What's the most cost-efficient way to scrape hundreds of URLs with Firecrawl in a single call?"

Document Parsing (3 prompts)

  1. "Can Firecrawl parse a PDF I upload and return structured content from it?"
  2. "Help me use Firecrawl to extract text and data from uploaded DOCX and HTML files."
  3. "How do I use Firecrawl's parse endpoint in the Node SDK to process a local file?"

Node SDK (4 prompts)

  1. "Walk me through setting up the Firecrawl Node SDK in a TypeScript project with the API key from an environment variable."
  2. "How do I use crawlUrlAndWatch in the Firecrawl Node SDK to stream crawl results in real time?"
  3. "Help me handle errors and timeouts properly when using the Firecrawl Node SDK for scraping."
  4. "Does the Firecrawl Node SDK support async pagination? How do I control page limits when crawling?"

Python SDK (3 prompts)

  1. "How do I set up the Firecrawl Python SDK with async support for non-blocking scrape calls?"
  2. "Help me use the Firecrawl Python SDK to define a Pydantic model for structured extraction."
  3. "Does the Firecrawl Python SDK convert API responses to snake_case automatically, or do I need to handle that?"

API Reference & Auth (3 prompts)

  1. "How does Firecrawl API authentication work? Do I use a bearer token or an API key header?"
  2. "What error codes does the Firecrawl API return for rate limiting versus payment issues?"
  3. "Help me make a raw cURL request to Firecrawl's scrape endpoint with custom headers and JSON output."

LLM Frameworks & SDKs (5 prompts)

  1. "How do I give my OpenAI function-calling agent the ability to scrape web pages using Firecrawl?"
  2. "Help me set up Firecrawl as a document loader in LangChain for a RAG pipeline."
  3. "Can I use Firecrawl with the Anthropic SDK to let Claude search and read live web content?"
  4. "How do I connect Firecrawl as an MCP server so my AI assistant can scrape pages on demand?"
  5. "Help me use Firecrawl with LlamaIndex to ingest web content into a vector store."
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment