2024-04-15 17:01:47 -04:00
|
|
|
# Self-hosting Firecrawl
|
2024-05-15 16:25:39 -04:00
|
|
|
*We're currently working on a more in-depth guide on how to self-host, but in the meantime, here is a simplified version.*
|
|
|
|
|
|
|
|
Refer to [CONTRIBUTING.md](https://github.com/mendableai/firecrawl/blob/main/CONTRIBUTING.md) for instructions on how to run it locally.
|
2024-04-15 17:01:47 -04:00
|
|
|
|
2024-05-10 10:38:17 -04:00
|
|
|
## Getting Started
|
|
|
|
|
|
|
|
First, clone this repository and copy the example env file from api folder `.env.example` to `.env`.
|
2024-05-05 12:03:42 -04:00
|
|
|
```bash
|
|
|
|
git clone https://github.com/mendableai/firecrawl.git
|
|
|
|
cd firecrawl
|
2024-05-10 10:38:17 -04:00
|
|
|
cp ./apps/api/.env.example ./.env
|
2024-05-05 12:03:42 -04:00
|
|
|
```
|
2024-04-15 17:01:47 -04:00
|
|
|
|
2024-05-10 10:38:17 -04:00
|
|
|
For running the simplest version of FireCrawl, edit the `USE_DB_AUTHENTICATION` on `.env` to not use the database authentication.
|
|
|
|
```yml
|
2024-05-05 12:03:42 -04:00
|
|
|
USE_DB_AUTHENTICATION=false
|
|
|
|
```
|
|
|
|
|
2024-05-13 12:47:49 -04:00
|
|
|
Update the Redis URL in the .env file to align with the Docker configuration:
|
|
|
|
```yml
|
|
|
|
REDIS_URL=redis://redis:6379
|
|
|
|
```
|
|
|
|
|
2024-05-05 12:03:42 -04:00
|
|
|
Once that's complete, you can simply run the following commands to get started:
|
|
|
|
```bash
|
|
|
|
docker compose up
|
|
|
|
```
|
|
|
|
|
2024-05-17 21:46:59 -04:00
|
|
|
|
2024-05-05 12:03:42 -04:00
|
|
|
This will run a local instance of Firecrawl which can be accessed at `http://localhost:3002`.
|
2024-06-04 14:52:08 -04:00
|
|
|
|
|
|
|
# Install Firecrawl on a Kubernetes Cluster (Simple Version)
|
|
|
|
Read the [examples/k8n/README.md](examples/k8n/README.md) for instructions on how to install Firecrawl on a Kubernetes Cluster.
|