just-scrape
The just-scrape skill provides a command-line interface for searching, scraping, crawling, and monitoring web pages using ScrapeGraph AI. It supports structured data extraction, recurring page monitoring, and history inspection.
Is just-scrape safe to install?
Review the source first: our audit of just-scrape's source files found 8 shell commands, 1 external URL, file reads and writes (high risk). Every command and URL listed appears verbatim in the skill's source. The skill executes shell commands, performs network requests to external APIs, and writes scraped data to local files. It handles sensitive credentials like API keys and cookies.
How we audit skills: our security review methodology.
Who is this skill for?
Developers and data analysts who need to automate web data collection, structured extraction, and site monitoring tasks.
What can you do with it?
- Search the web for information
- Scrape content from specific URLs in various formats
- Extract structured JSON data from web pages using AI prompts
- Crawl entire site sections for bulk data
- Monitor web pages for changes over time
- Validate API setup and check credit balances
How good is this skill?
Quality score: 5/10. The skill documentation is comprehensive, providing clear command references, security guidelines, and workflow patterns.
What does the skill file contain?
# just-scrape CLI Search, scrape, crawl, extract structured JSON, and monitor page changes using the just-scrape CLI. Run `just-scrape --help` or `just-scrape <command> --help` for full option details. If the task is to integrate ScrapeGraph AI into application code, add `SGAI_API_KEY` to a project, or choose endpoint usage in product code, inspect the project first and use the ScrapeGraph AI SDK/API docs directly instead of this CLI skill. ## Prerequisites Must be installed and authenticated. Check with `just-scrape validate` and `just-scrape credits`. ```bash command -v just-scrape >/d...
Frequently asked questions
What are the prerequisites for using this skill?
You must install the CLI via 'npm install -g just-scrape' and provide a valid 'SGAI_API_KEY'.
How do I handle sensitive data like session cookies?
Pass sensitive values through environment variables and avoid echoing them into logs or saved output files.
How does the skill manage output?
The skill writes results to the .just-scrape/ directory using shell redirection. You should add this directory to your .gitignore.
What is the difference between scrape and extract?
Use 'scrape' for raw formats like markdown or HTML. Use 'extract' specifically for AI-powered structured JSON output.
Related skills
find-skills
2.3MUsers seeking to extend agent capabilities with specialized tools, workflows, or knowledge packages
The find-skills skill enables agents to search for, discover, and install modular packages from the open agent skills ecosystem using the Skills CLI.
agent-browser
506.7KAI agents and developers requiring programmatic web interaction, exploratory testing, or automation of Electron desktop applications
The agent-browser CLI provides browser automation for AI agents using Chrome or Chromium via CDP. It supports page navigation, form interaction, data extraction, and testing. The tool utilizes accessibility-tree snapshots and element references for interaction.
video-edit
338.7KUsers of the RunComfy CLI who need to automate video editing tasks like restyling, background swapping, or motion transfer
The video-edit skill acts as a router for the RunComfy CLI, selecting between Wan 2.7 Edit-Video, Kling 2.6 Pro Motion Control, and Lucy Edit Restyle models based on user intent to perform video transformations.
agentspace
324.0KDevelopers and AI agent users who need to share, monitor, or collaborate on agent-generated files and workspaces in real-time
Agentspace provides a mechanism to share local agent files, logs, and artifacts via a live browser-accessible URL. It enables remote viewing, commenting, and editing of specified local paths through the ascli command-line tool.