Firecrawl officially open-source web proxy framework Web Agent, performing the "search-crawl-interact" closed-loop tasks through Plan-Act cycles and parallel sub-agents within independent browser sessions, compatible with self-hosted large models like Anthropic, OpenAI, and others. Developers can quickly generate templates using firecrawl create agent, and encapsulate complex processes as Skills through SKILL.md. The new version defaults to Claude Opus 4.7, includes a financial skill package, licensed under MIT, encouraging community Forks and secondary development.

MeNews

2026-05-21 06:23:18

Abstract generation in progress

ME News Report, April 17 (UTC+8), according to Beating Monitoring from Dongcha, Firecrawl officially open-sourced the Web Agent web proxy framework, aimed at helping developers build AI agents capable of autonomously executing "search - crawl - interaction" closed-loop tasks. The framework is based on Firecrawl's existing /agent architecture, supporting integration with Anthropic, OpenAI, or various self-hosted large models, emphasizing flexibility and self-hosting capabilities in web research scenarios. The core architecture of the framework adopts a "Plan-Act" cycle mechanism. After receiving instructions, the agent first decomposes the steps and synchronizes tasks through "Subagents" generated in parallel within independent browser sessions. This design has clear advantages when handling large-scale concurrent tasks, such as in video demonstrations where agents can extract real-time stock data and news from multiple company websites simultaneously. For developers, this tool significantly lowers the barrier to developing web proxies. By using the command firecrawl create agent, a complete proxy template based on Next.js or Express can be quickly generated. Additionally, the framework introduces a reusable "Skill Manual" (SKILL.md), allowing developers to encapsulate complex workflows (such as specific crawling logic for Yahoo Finance) as Skills, which agents can invoke directly in subsequent tasks. In the latest version, Web Agent has upgraded its default driving model to Claude Opus 4.7 and includes a specialized skill package for the financial sector. The project is currently open-sourced under the MIT license, encouraging community contributions through Forks. (Source: BlockBeats)

View Original

This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.

7 Likes

Reward
7
9
8
Share

Comment

Add a comment

ViewingNarrativesFromAHotAir

· 5h ago

The financial skills package is an Easter egg; financial report scraping and table parsing are probably built-in. I'll wait to see the source code implementation.

View OriginalReply0

PunkRiskMgr

· 5h ago

firecrawl create agent one-click generate template, beginner friendliness +10086.

View OriginalReply0

GateUser-2bbf8435

· 5h ago

Sub-agent executes in parallel, timeout tasks are directly circuit-broken, and the fault tolerance mechanism is implemented in detail.

View OriginalReply0

MirrorBallPeeking

· 5h ago

Self-hosted large model compatibility is a must-have; companies that keep data within their own environment can use it with confidence.

View OriginalReply0

LookingAtTheCandlestickChart

· 5h ago

Search–Crawl–Interaction Closed Loop—finally, you don’t have to wire up Playwright + Web Scraper + LLM yourself.

Entity alignment anomaly: new suspicious entity detected: Web Scraper; alignment_score=90
Fix hint: Please remove or verify these suspicious newly added entities: Web Scraper

View OriginalReply0

LightsInTheMistyValley

· 5h ago

Independent browser session isolation tasks are not affected by cookie contamination, making it very stable for multi-tenant scenarios.

View OriginalReply0

LimeLeverageAlert

· 5h ago

Claude Opus 4.7 is integrated by default, with the ability to switch between Anthropic and OpenAI, offering maximum flexibility.

View OriginalReply0

BluePeonyMinerDream

· 5h ago

MIT License is highly praised, and the financial skill package is ready to use directly, saving the effort of building the data pipeline from scratch.

View OriginalReply0

CliffsideAncientPineAndRolling

· 5h ago

Firecrawl's open source release this time is very timely, and the design idea of the Plan-Act cycle is very clear. The parallel processing of sub-agents can indeed solve the problem of single-thread deadlock. Planning to fork and try it this weekend.

View OriginalReply0

Trending Topics
View More
#
TradfiTradingChallenge
222.61K Popularity
#
GrayscaleBuysAndStakesOver510KHYPE
8.91M Popularity
#
DailyPolymarketHotspot
1.01M Popularity
#
SpaceXOfficiallyFilesforIPO
744.46K Popularity
#
GateSquarePizzaDay
1.7M Popularity

Pinned

Sitemap

Firecrawl Open-source Autonomous Web Proxy Framework: Supports Multiple Models and Parallel Sub-proxies, One-click Generation of Research Tools

Trending Topics

TradfiTradingChallenge

GrayscaleBuysAndStakesOver510KHYPE

DailyPolymarketHotspot

SpaceXOfficiallyFilesforIPO

GateSquarePizzaDay

Pinned