0

Commit Graph

  • 01783dc336 Update openapi.json Nicolas 2024-05-20 17:10:55 -0700
  • 77a79b5a79 Nick: max num tokens for llm extract (for now) + slice the max Nicolas 2024-05-20 17:07:38 -0700
  • 2644e1c029 Update .env.example Nicolas 2024-05-20 13:36:51 -0700
  • 9e61d431f0 Nick: hyper dx integration init Nicolas 2024-05-20 13:36:34 -0700
  • d5d0d48848 Merge branch 'main' of https://github.com/mendableai/firecrawl Nicolas 2024-05-20 10:06:52 -0700
  • 60002e79b8 Nick: python sdk bump Nicolas 2024-05-20 10:06:48 -0700
  • 4bb536e5b3
    Merge pull request #166 from mattjoyce/main Nicolas 2024-05-20 09:44:47 -0700
  • 7e5ef4dec4 Allow override of API URL Matt Joyce 2024-05-20 18:46:32 +1000
  • c74f757b53 Update rate-limiter.ts Nicolas 2024-05-19 13:05:36 -0700
  • 842e197fd7
    Merge pull request #151 from mendableai/feat/rate-limits Nicolas 2024-05-19 13:01:37 -0700
  • 98a39b39ab Nick: increased rate limits Nicolas 2024-05-19 12:59:29 -0700
  • 18fa15df25 Update index.test.ts Nicolas 2024-05-19 12:50:06 -0700
  • 614c073af0 Nick: improvements Nicolas 2024-05-19 12:45:46 -0700
  • f473793ba3 Merge branch 'main' into feat/rate-limits Nicolas 2024-05-19 12:23:34 -0700
  • 4efebf7a4b Merge branch 'test/load-testing' of https://github.com/mendableai/firecrawl into test/load-testing Nicolas 2024-05-19 12:22:51 -0700
  • 5792cd022c Update fly.staging.toml Nicolas 2024-05-19 12:22:49 -0700
  • 713f16fdc1
    Update README.md Nicolas 2024-05-19 00:41:12 -0700
  • 0dc108cd33
    Update README.md Nicolas 2024-05-18 11:32:13 -0700
  • 43d0309b09
    Merge pull request #160 from elimisteve/patch-1 Nicolas 2024-05-18 11:24:23 -0700
  • 81563130e3
    Update README.md: Typo fix Steve Phillips 2024-05-18 03:58:17 +0200
  • fae8954eeb
    Update SELF_HOST.md Nicolas 2024-05-17 18:46:59 -0700
  • d667e1417b added fly staging load test rafaelsideguide 2024-05-17 19:09:19 -0300
  • 7630565c26 Create fly.staging.toml Nicolas 2024-05-17 14:33:59 -0700
  • 7297b21dcd Added load testing using artillery rafaelsideguide 2024-05-17 18:32:44 -0300
  • a480595aa7 Update index.test.ts rafaelsideguide 2024-05-17 15:41:27 -0300
  • 54049be539 Added e2e tests rafaelsideguide 2024-05-17 15:37:47 -0300
  • 6feb21cc35 Update website_params.ts Nicolas 2024-05-17 11:21:26 -0700
  • 2a1f2e396a
    Merge pull request #29 from mendableai/detect-pdfs Nicolas 2024-05-17 10:47:08 -0700
  • 5be208f595 Nick: fixed Nicolas 2024-05-17 10:40:44 -0700
  • eb88447e8b Update index.test.ts Nicolas 2024-05-17 10:00:05 -0700
  • df6c3d1e7d Merge branch 'main' into detect-pdfs Nicolas 2024-05-17 09:55:51 -0700
  • 5c1e6d188c
    Merge pull request #158 from mendableai/nsc/docx-support Nicolas 2024-05-16 12:03:16 -0700
  • 9d635cb2a3 Nick: docx support Nicolas 2024-05-16 11:48:02 -0700
  • d407ec76dd Merge branch 'test/crawl-options' Nicolas 2024-05-16 11:03:43 -0700
  • bcce0544e7 Update openapi.json Nicolas 2024-05-16 11:03:32 -0700
  • a31459092e
    Merge pull request #153 from mendableai/test/crawl-options Nicolas 2024-05-15 17:40:59 -0700
  • 80250fb54f Update index.test.ts Nicolas 2024-05-15 17:40:46 -0700
  • 098db17913 Update index.ts Nicolas 2024-05-15 17:37:09 -0700
  • 93b1f0334e Update index.test.ts Nicolas 2024-05-15 17:35:06 -0700
  • 123fb784ca Update index.test.ts Nicolas 2024-05-15 17:29:22 -0700
  • 4a6cfb6097 Update index.test.ts Nicolas 2024-05-15 17:22:29 -0700
  • 6ca368327f Merge branch 'main' into test/crawl-options Nicolas 2024-05-15 17:18:25 -0700
  • 24be4866c5 Nick: Nicolas 2024-05-15 17:16:20 -0700
  • ade4e05cff Nick: working Nicolas 2024-05-15 17:13:04 -0700
  • bfccaf670d Nick: fixes most of it Nicolas 2024-05-15 15:30:37 -0700
  • d91043376c not working yet rafaelsideguide 2024-05-15 18:54:40 -0300
  • fa014defc7 Fixing child links only bug rafaelsideguide 2024-05-15 18:35:09 -0300
  • 2ba743fb1a
    Merge pull request #27 from eltociear/patch-1 Nicolas 2024-05-15 13:28:38 -0700
  • 0663d78324
    Merge pull request #119 from chand1012/main Nicolas 2024-05-15 13:27:40 -0700
  • eb36d4b3bd
    Update SELF_HOST.md Nicolas 2024-05-15 13:25:39 -0700
  • da8d94105d fixed for testing the crawl algorithm only rafaelsideguide 2024-05-15 17:16:03 -0300
  • 95ffaa2236 Update crawl.test.ts Nicolas 2024-05-15 12:58:02 -0700
  • f15b8f855e Update crawl.json Nicolas 2024-05-15 12:57:24 -0700
  • 98dd672d0a Update crawl.json Nicolas 2024-05-15 12:55:04 -0700
  • 499671c87f Update crawl.test.ts Nicolas 2024-05-15 12:50:13 -0700
  • 58053eb423 Update rate-limiter.ts Nicolas 2024-05-15 12:47:35 -0700
  • 4745d114be Update crawl.test.ts Nicolas 2024-05-15 12:42:14 -0700
  • 1601e93d69 Merge branch 'main' into test/crawl-options Nicolas 2024-05-15 12:34:47 -0700
  • 3678d3c986 Merge branch 'main' of https://github.com/mendableai/firecrawl Nicolas 2024-05-15 12:11:18 -0700
  • fd82982a31 Nick: Nicolas 2024-05-15 12:11:16 -0700
  • 4925ee59f6 added crawl test suite rafaelsideguide 2024-05-15 15:50:50 -0300
  • ed211dc7f8
    Merge pull request #149 from mendableai/nsc/speed-up-crawl-4x Nicolas 2024-05-15 11:48:32 -0700
  • 1b0d6341d3 Update index.ts Nicolas 2024-05-15 11:48:12 -0700
  • d10f81e7fe Nick: fixes Nicolas 2024-05-15 11:28:20 -0700
  • 87570bdfa1 Update index.ts Nicolas 2024-05-15 11:06:03 -0700
  • d4574851be Added rpc definition rafaelsideguide 2024-05-15 08:40:21 -0300
  • 47c20c80ab Update auth.ts rafaelsideguide 2024-05-15 08:34:49 -0300
  • e91c122c69
    Merge branch 'main' into patch-1 Ikko Eltociear Ashimine 2024-05-15 12:14:52 +0900
  • 7d8ceab6de Merge branch 'feat/rate-limits' of https://github.com/mendableai/firecrawl into feat/rate-limits Nicolas 2024-05-14 14:48:01 -0700
  • 0e0faa28b3 Update auth.ts Nicolas 2024-05-14 14:47:36 -0700
  • 672eddb999 updated rpc rafaelsideguide 2024-05-14 18:47:21 -0300
  • 4761ea510b Update rate-limiter.ts Nicolas 2024-05-14 14:26:42 -0700
  • 40ad97dee8 added rate limits rafaelsideguide 2024-05-14 18:08:31 -0300
  • 27e1e22a0a Update index.test.ts Nicolas 2024-05-14 12:28:25 -0700
  • a0fdc6f7c6 Nick: Nicolas 2024-05-14 12:12:40 -0700
  • 7f31959be7 Nick: Nicolas 2024-05-14 12:04:36 -0700
  • 8a72cf556b Nick: Nicolas 2024-05-13 21:10:58 -0700
  • 26a092f780 Update index.ts Nicolas 2024-05-13 21:04:49 -0700
  • 8101cbee37 Update index.ts Nicolas 2024-05-13 21:02:47 -0700
  • 86b8439844 Nick: Nicolas 2024-05-13 20:51:42 -0700
  • a96fc5b96d Nick: 4x speed Nicolas 2024-05-13 20:45:11 -0700
  • e26008a833 Merge branch 'main' of https://github.com/mendableai/firecrawl Nicolas 2024-05-13 19:54:13 -0700
  • 512449e1aa Nick: v21 Nicolas 2024-05-13 19:54:12 -0700
  • bd27b0e17e
    Merge pull request #142 from mendableai/doc/crawl-limit-default Nicolas 2024-05-13 18:38:09 -0700
  • aa0c8188c9 Nick: 408 handling Nicolas 2024-05-13 18:34:00 -0700
  • 999176d576 Merge branch 'main' of https://github.com/mendableai/firecrawl Nicolas 2024-05-13 13:57:34 -0700
  • f3ec21d9c4 Update runWebScraper.ts Nicolas 2024-05-13 13:57:22 -0700
  • c9133f3d15
    Merge pull request #145 from mendableai/nsc/timeout-scrape Nicolas 2024-05-13 13:07:25 -0700
  • 65d89afba9 Nick: Nicolas 2024-05-13 13:01:43 -0700
  • 3f090ffd7c
    Merge pull request #144 from mendableai/feat/gpt-4o Nicolas 2024-05-13 12:24:30 -0700
  • 4cc46d4af8 Update models.ts Eric Ciarla 2024-05-13 15:23:31 -0400
  • 8eb2e95f19 Cleaned up rafaelsideguide 2024-05-13 16:13:10 -0300
  • 2ce045912f Nick: disable vision right now Nicolas 2024-05-13 10:56:08 -0700
  • 4737fe8711 Added missing instruction rafaelsideguide 2024-05-13 13:47:49 -0300
  • f4348024c6 Added check during scraping to deal with pdfs rafaelsideguide 2024-05-13 09:13:42 -0300
  • 5cbce060ed
    chore: Update docker-compose.yaml with default values for PORT and HOST chand1012 2024-05-10 17:26:00 -0400
  • b498e9881c
    chore: Update docker-compose.yaml network configuration chand1012 2024-05-10 17:23:22 -0400
  • 2021a822ff
    chore: Add firecrawl network to docker-compose.yaml chand1012 2024-05-10 17:20:33 -0400
  • 0245066009
    chore: Update docker-compose.yaml with default values for REDIS_URL and PLAYWRIGHT_MICROSERVICE_URL chand1012 2024-05-10 17:15:32 -0400
  • 5a2712fa5a
    Merge branch 'main' into detect-pdfs Rafael Miller 2024-05-10 15:53:13 -0300