0
v-firecrawl/examples/k8n
Jakob Stadlhuber 078d4c8d41 Add Kubernetes configuration for Firecrawl deployment
Added new files for setting up Firecrawl on a Kubernetes Cluster. The files include Kubernetes manifests for deploying API, worker, playwright service, and Redis with associated ConfigMap and Secret associated resources. Also, updated the self-host documentation to include instructions for Kubernetes deployment.
2024-06-04 20:52:08 +02:00
..
api.yaml Add Kubernetes configuration for Firecrawl deployment 2024-06-04 20:52:08 +02:00
configmap.yaml Add Kubernetes configuration for Firecrawl deployment 2024-06-04 20:52:08 +02:00
playwright-service.yaml Add Kubernetes configuration for Firecrawl deployment 2024-06-04 20:52:08 +02:00
README.md Add Kubernetes configuration for Firecrawl deployment 2024-06-04 20:52:08 +02:00
redis.yaml Add Kubernetes configuration for Firecrawl deployment 2024-06-04 20:52:08 +02:00
secret.yaml Add Kubernetes configuration for Firecrawl deployment 2024-06-04 20:52:08 +02:00
worker.yaml Add Kubernetes configuration for Firecrawl deployment 2024-06-04 20:52:08 +02:00

Install Firecrawl on a Kubernetes Cluster (Simple Version)

Before installing

  1. Set secret.yaml and configmap.yaml and do not check in secrets
  2. Build Docker images, and host it in your Docker Registry (replace the target registry with your own)
    1. API (which is also used as a worker image)
      1. docker build -t ghcr.io/winkk-dev/firecrawl-playwright:latest ../../apps/api
        docker push ghcr.io/winkk-dev/firecrawl-playwright:latest
        
    2. Playwright
      1.    docker build -t ghcr.io/winkk-dev/firecrawl:latest ../../apps/playwright-service
           docker push ghcr.io/winkk-dev/firecrawl:latest
        
  3. Replace the image in worker.yaml, api.yaml and playwright-service.yaml

Install

kubectl apply -f configmap.yaml
kubectl apply -f secret.yaml
kubectl apply -f playwright-service.yaml
kubectl apply -f api.yaml
kubectl apply -f worker.yaml
kubectl apply -f redis.yaml

Port Forwarding for Testing

kubectl port-forward svc/api 3002:3002 -n dev

Delete Firecrawl on Environment

kubectl delete -f configmap.yaml
kubectl delete -f secret.yaml
kubectl delete -f playwright-service.yaml
kubectl delete -f api.yaml
kubectl delete -f worker.yaml
kubectl delete -f redis.yaml