Firecrawl is a web scraping and crawling platform. The Firecrawl connector lets your RShift Sites app scrape URLs into clean markdown or structured JSON, crawl whole sites, search the web, and map site structure. It’s designed for apps that need to fetch, update, and structure information from websites rather than rely on one-time imports or static datasets.
Firecrawl is available as an app + chat connector: one shared connection that works in the project chat while you build and in your published apps.
With Firecrawl, your app can:
- Turn any web page into clean text or structured data, including pages that load their content with JavaScript
- Crawl a whole website, following its pages and sitemap
- Search the web and get the content of the pages it finds
- List every URL on a site before you crawl it
- Re-check pages on a schedule so your data stays current
Firecrawl is a good fit when your app depends on live or frequently changing website content.
Common use cases and example apps
These examples show what you can build with Firecrawl, each with a prompt to start from.
| Example app | Example prompt | Description |
|---|---|---|
| Competitor tracker | Use Firecrawl and build a competitor tracker that scrapes saved URLs on a schedule and shows what changed. | Track changes on competitor websites over time. The app re-scrapes each saved URL, stores snapshots, and highlights changes to pricing pages, product updates, documentation, or announcements. |
| Jobs aggregator | Use Firecrawl and build a jobs aggregator that pulls listings from selected companies’ careers pages and highlights new roles. | Pull job listings from multiple careers pages into one feed. The app scrapes each careers page (for example, Greenhouse, Lever, or Workday) into structured listings, keeps the feed updated, and flags roles that appeared since the last run. |
| Lead enrichment tool | Use Firecrawl and build a lead enrichment tool that crawls a company’s key pages and extracts public company details into a profile. | Enrich company profiles from public website content. The app crawls the about, team, careers, and contact pages and saves people, location, tech stack, and contact fields for each company. |
| E-commerce price monitor | Use Firecrawl and build a price monitor that checks saved product URLs on a schedule and alerts on changes. | Track product availability and pricing across stores. The app extracts price and availability from each product page, records history, and alerts when prices drop or items come back in stock. |
| Brand kit extractor | Use Firecrawl and build a brand kit extractor that pulls colors, fonts, and logos from a website URL. | Generate a lightweight brand kit from any website. The app scrapes brand-related pages and extracts fonts, colors, logos, and style tokens into a simple kit. |
| Knowledge extractor | Use Firecrawl and build a knowledge extractor that turns a pasted URL into clean markdown and metadata with re-sync. | Turn any webpage into clean, reusable content. The app converts the page into markdown, structured metadata, and tables, ready for search, summarization, or reuse. |
How to connect Firecrawl
Who can create Firecrawl connections depends on your plan and workspace settings. App + chat connectors are available by default on Free, Pro, and Business plans. On Enterprise plans, they are effectively disabled at first: Who can create connections and clients defaults to No one until an admin changes it in Connectors → Admin settings → App + chat connectors.
When adding a connection, you choose between two options:
- Managed by RShift Sites: RShift Sites provides and manages the credentials for you. No registration needed.
- Use your own credentials: connect with your own Firecrawl API key and manage billing in Firecrawl.
When the connection is created, you can link it to the projects where you want to use it. Anyone building in a project can ask RShift Sites in the project chat to link their project to it.
Follow the setup steps below for the option you want.
Managed by RShift Sites
Choose this option for the fastest setup. You don’t need a Firecrawl account or API key.
Open Firecrawl in Connectors
Open Connectors and select Firecrawl. For the other places to open the catalog from, see Where to find connectors.
Add a connection
Click Add connection.
Name the connection
In Display name, name the connection (for example, Firecrawl). This name is only used inside RShift Sites to identify the connection.
Choose Managed by RShift Sites
Under Authentication, select Managed by RShift Sites. No credential fields appear for this option.
Choose who can use this connection
Managed connections are shared with the entire workspace by default. To limit who can use the connection, click Restrict to specific people under Sharing.
See Who can use connections and clients for more information.
Connect
Click Connect.
Use your own credentials
Choose this option to use your own Firecrawl account and manage billing directly.
You can create multiple Firecrawl connections using different API keys, which is useful for separating environments (for example, development and production) or managing rate limits.
Prerequisites
Before connecting Firecrawl with your own credentials, make sure you have:
- A Firecrawl account
- A Firecrawl API key
- Permission to create connections in your RShift Sites workspace (see Who can create connections and clients)
Step 1: Get a Firecrawl API key
A Firecrawl API key lets your RShift Sites app authenticate with the Firecrawl API. You can create multiple keys for different environments.
To create a Firecrawl API key:
Open your Firecrawl account
Sign in to Firecrawl. New accounts start with free credits, enough to test the connection.
Open API keys
In the Firecrawl dashboard, open the API Keys page.
Create a key
Click Create and give the key a descriptive name, for example RShift Sites integration.
Copy the key
Copy the generated API key and store it securely. It starts with fc-.
See Firecrawl documentation for more: Firecrawl API reference.
Step 2: Connect Firecrawl to RShift Sites
You can create multiple connections using different API keys.
Open Firecrawl in Connectors
Open Connectors and select Firecrawl. For the other places to open the catalog from, see Where to find connectors.
Add a connection
Click Add connection.
Name the connection
In Display name, name the connection (for example, Firecrawl Prod). This name is only used inside RShift Sites to identify the connection.
Choose your own credentials
Under Authentication, select Use your own credentials.
Enter your API key
In API key, paste your Firecrawl API key (it starts with fc-).
Choose who can use this connection
Under Sharing, the connection is private to you by default and shows a Private label. To share it, click Share with others. Then add workspace members by email, or click Invite entire workspace to make the connection available to everyone in your RShift Sites workspace.
See Who can use connections and clients for more information.
Connect
Click Connect. RShift Sites verifies the key against the Firecrawl API before saving the connection.
When connected, anyone building in a project can ask RShift Sites in the project chat to link their project to Firecrawl (based on configured connection-level access). Your RShift Sites apps can then scrape, crawl, and keep website data up to date with Firecrawl.
Pricing
With Managed by RShift Sites and unified billing, usage costs 4 RShift Sites credits per 1,000 Firecrawl credits, or 2 RShift Sites credits on Business plans.
Firecrawl credits measure API usage, and the number consumed depends on the feature you use. See Firecrawl billing documentation for detailed pricing and credit usage by feature.
With Use your own credentials, Firecrawl bills usage directly to your Firecrawl account.
Limitations
The Firecrawl connector cannot:
- Use the Firecrawl Monitor product with Managed by RShift Sites. To use Monitor, connect with Use your own credentials and your own Firecrawl API key.
- Rotate API keys automatically for connections that use your own credentials. To rotate, create a new key in Firecrawl and update the RShift Sites connection.
- Support per-end-user Firecrawl login. Each connection represents a single Firecrawl account shared across all projects linked to it.
Manage your {connector_0} connection
Connections are managed from Connectors: select {connector_0}, then open the connection.
- Unlink projects to remove {connector_0} access from specific projects while keeping the connection available for others. See Unlink projects from a connection for the steps.
- Delete the connection to remove it from the workspace entirely. Deleting is permanent. It removes the credentials from all linked projects, and app features that use {connector_0} stop working until a new connection is added. See Delete a connection for the steps and who can delete.