firecrawl-crawl
The firecrawl-crawl skill extracts content from multiple pages on a website by following links up to a specified depth. It supports path filtering, concurrency controls, and output to JSON files.
Is firecrawl-crawl safe to install?
Review the source first: our audit of firecrawl-crawl's source files found 3 shell commands, 0 external URLs, file reads and writes (high risk). Every command and URL listed appears verbatim in the skill's source. The skill executes shell commands via the firecrawl CLI and writes crawl results to local JSON files.
How we audit skills: our security review methodology.
Who is this skill for?
Users who need to extract data from entire website sections or multiple pages simultaneously.
What can you do with it?
- Extracting all pages from a documentation section
- Crawling an entire website
- Bulk scraping multiple pages by following internal links
How good is this skill?
Quality score: 5/10. The skill documentation is clear, provides specific command examples, and outlines necessary configuration options for effective use.
What does the skill file contain?
# firecrawl crawl Bulk extract content from a website. Crawls pages following links up to a depth/limit. ## When to use - You need content from many pages on a site (e.g., all `/docs/`) - You want to extract an entire site section - Step 4 in the [workflow escalation pattern](firecrawl-cli): search → scrape → map → **crawl** → interact ## Quick start ```bash # Crawl a docs section firecrawl crawl "<url>" --include-paths /docs --limit 50 --wait -o .firecrawl/crawl.json # Full crawl with depth limit firecrawl crawl "<url>" --max-depth 3 --wait --progress -o .firecrawl/crawl.json # Check s...
Frequently asked questions
How do I limit the crawl to a specific section of a site?
Use the --include-paths option to specify the path patterns to crawl.
Does the skill return results immediately?
The skill returns results immediately if the --wait flag is used. Otherwise, it returns a job ID for asynchronous polling.
Can I control the speed of the crawl?
Yes, use the --delay option to set a delay between requests and --max-concurrency to set the number of parallel workers.
Related skills
find-skills
2.3MUsers seeking to extend agent capabilities with specialized tools, workflows, or knowledge packages
The find-skills skill enables agents to search for, discover, and install modular packages from the open agent skills ecosystem using the Skills CLI.
agent-browser
506.7KAI agents and developers requiring programmatic web interaction, exploratory testing, or automation of Electron desktop applications
The agent-browser CLI provides browser automation for AI agents using Chrome or Chromium via CDP. It supports page navigation, form interaction, data extraction, and testing. The tool utilizes accessibility-tree snapshots and element references for interaction.
image-to-video
355.0KDevelopers and users who need to automate video generation from images using the RunComfy platform
The image-to-video skill routes user requests to specific RunComfy animation models based on intent. It selects HappyHorse 1.0 I2V for general animation, Wan 2.7 for custom-voiceover lip-sync, or Seedance 2.0 Pro for multi-modal composition. The skill executes the RunComfy CLI to process inputs and download generated video files.
video-edit
338.7KUsers of the RunComfy CLI who need to automate video editing tasks like restyling, background swapping, or motion transfer
The video-edit skill acts as a router for the RunComfy CLI, selecting between Wan 2.7 Edit-Video, Kling 2.6 Pro Motion Control, and Lucy Edit Restyle models based on user intent to perform video transformations.