0

Commit Graph

  • bc6b929b43 [Bug] Fixing /crawl limit rafaelsideguide 2024-05-10 12:15:54 -0300
  • df16890f84 Added default value for crawlOptions.limit rafaelsideguide 2024-05-10 11:59:33 -0300
  • 18480b2005 Removed .env.example, improved docs and docker compose envs rafaelsideguide 2024-05-10 11:38:17 -0300
  • 66bd1e4020 Update website_params.ts Nicolas 2024-05-09 18:41:15 -0700
  • c02a82c282 Update main.py Nicolas 2024-05-09 18:02:34 -0700
  • efc6fcb474 Merge branch 'main' of https://github.com/mendableai/firecrawl Nicolas 2024-05-09 18:01:04 -0700
  • 73687822ad Update main.py Nicolas 2024-05-09 18:00:58 -0700
  • f94b6053ad
    Merge pull request #139 from mendableai/nsc/refactor-scraping-order Nicolas 2024-05-09 17:57:01 -0700
  • 9f2e90be97
    Update README.md Caleb Peffer 2024-05-09 17:52:57 -0700
  • d21091bb06 Update single_url.ts Nicolas 2024-05-09 17:52:46 -0700
  • be85008622 Nick: better Nicolas 2024-05-09 17:48:11 -0700
  • 73e8da9185 Merge branch 'main' into nsc/refactor-scraping-order Nicolas 2024-05-09 17:45:20 -0700
  • be5661a768 Nick: a lot better Nicolas 2024-05-09 17:45:16 -0700
  • 08d6c59a78
    Merge pull request #134 from mendableai/cjp/switch-license-to-AGPL Caleb Peffer 2024-05-09 16:47:03 -0700
  • 5ab97bbe23 Merge branch 'main' of https://github.com/mendableai/firecrawl Nicolas 2024-05-09 15:29:59 -0700
  • fce17e6beb Update credit_billing.ts Nicolas 2024-05-09 15:29:58 -0700
  • 53ab33c287
    Update README.md Nicolas 2024-05-09 10:27:10 -0700
  • 832a4f53e0
    Merge pull request #137 from mendableai/nsc/llm-extraction-zod-integration Nicolas 2024-05-09 09:24:36 -0700
  • f4d8b2c89a Updated docs rafaelsideguide 2024-05-09 10:36:56 -0300
  • c02d7aeebd
    Merge pull request #135 from mendableai/nsc/llm-extraction-zod-integration Nicolas 2024-05-08 18:15:12 -0700
  • d6b4904ef1 Update README.md Nicolas 2024-05-08 18:10:43 -0700
  • 3b5f71c1e8 Update README.md Nicolas 2024-05-08 17:46:35 -0700
  • 1033034201 Update README.md Nicolas 2024-05-08 17:45:19 -0700
  • aa6b84c5fa Nick: readme Nicolas 2024-05-08 17:41:15 -0700
  • d9da4b53f8 Update example.py Nicolas 2024-05-08 17:36:40 -0700
  • 4c88d5da66 Nick: v8 python Nicolas 2024-05-08 17:35:16 -0700
  • e6dbbf1bab Nick: fixes js and pydantic implementation Nicolas 2024-05-08 17:16:59 -0700
  • c89964b230 Nick: Nicolas 2024-05-08 16:38:49 -0700
  • 9541ff6b30 Nick: 429 addressed Nicolas 2024-05-08 15:14:39 -0700
  • 3bfef646e0 Update index.test.ts Nicolas 2024-05-08 13:23:53 -0700
  • 6ced8e73a7 Update index.test.ts Nicolas 2024-05-08 13:13:38 -0700
  • c50076c377 Update websites.json Nicolas 2024-05-08 13:04:17 -0700
  • 1296928879 Update index.test.ts Nicolas 2024-05-08 13:00:20 -0700
  • 9578856c8a Update fly.yml Nicolas 2024-05-08 12:50:55 -0700
  • 6d6617d96b Merge branch 'feat/test-suite' Nicolas 2024-05-08 12:50:10 -0700
  • 1c45951190 Nick: Nicolas 2024-05-08 12:50:02 -0700
  • 58efb6e96a Update test_suite.yml Nicolas 2024-05-08 12:48:20 -0700
  • 4a5f87623c
    Merge pull request #118 from mendableai/feat/test-suite Nicolas 2024-05-08 12:47:17 -0700
  • 0fae15a464 Update fly.yml Nicolas 2024-05-08 12:47:01 -0700
  • fb7a8fd73f Delete test_screenshot.png Nicolas 2024-05-08 12:39:32 -0700
  • c635688ddb Nick: test suite Nicolas 2024-05-08 12:36:54 -0700
  • d34b4de6ac Update websites.json Nicolas 2024-05-08 12:27:45 -0700
  • a0a67f124a Update index.test.ts Nicolas 2024-05-08 12:26:04 -0700
  • b7e3104c7b Ni Nicolas 2024-05-08 12:18:53 -0700
  • ad58bc2820 Nick: test suite init Nicolas 2024-05-08 11:38:46 -0700
  • dc977577c9
    Update LICENSE Caleb Peffer 2024-05-07 13:24:36 -0700
  • 3f460af6c5 Added idempotency key to crawl route rafaelsideguide 2024-05-07 15:29:27 -0300
  • 6956e5016d
    Merge pull request #131 from mendableai/feat/key-auth Nicolas 2024-05-07 10:54:56 -0700
  • d280bcadf3 Add keyAuth Eric Ciarla 2024-05-07 13:52:42 -0400
  • 056b0ec24d Merge branch 'main' into feat/test-suite Nicolas 2024-05-07 10:41:09 -0700
  • b9fb49c8e1
    Merge pull request #130 from mendableai/feat/max-depth Nicolas 2024-05-07 10:21:02 -0700
  • dcedb8d798 Merge branch 'main' into feat/max-depth Nicolas 2024-05-07 10:20:49 -0700
  • 6505bf6bf2 Merge branch 'main' into feat/max-depth Nicolas 2024-05-07 10:20:44 -0700
  • 3459b77f70
    Merge pull request #129 from mendableai/nsc/cancel-job Nicolas 2024-05-07 10:17:57 -0700
  • bdbee963f7 Merge branch 'main' into nsc/cancel-job Nicolas 2024-05-07 10:13:43 -0700
  • f1eb6c5f9c
    Merge pull request #126 from mendableai/feat/to-markdown Nicolas 2024-05-07 10:11:51 -0700
  • 61d615c04b Added tests rafaelsideguide 2024-05-07 14:03:00 -0300
  • e1f52c538f nested includeHtml inside pageOptions rafaelsideguide 2024-05-07 13:40:24 -0300
  • f46bf19fa5 Nick: Nicolas 2024-05-07 09:26:52 -0700
  • 83f3408634 Added max depth option rafaelsideguide 2024-05-07 11:06:26 -0300
  • 2e3ff85509 Update crawl-cancel.ts Nicolas 2024-05-06 17:22:16 -0700
  • 6d5da358cc Nick: cancel job Nicolas 2024-05-06 17:16:43 -0700
  • 509250c4ef changed to includeHtml rafaelsideguide 2024-05-06 19:45:56 -0300
  • 538355f1af Added toMarkdown option rafaelsideguide 2024-05-06 11:36:44 -0300
  • 6913fda710
    Update README.md Nicolas 2024-05-05 10:13:22 -0700
  • b32057ec89
    Update SELF_HOST.md chand1012 2024-05-05 12:03:42 -0400
  • 438925358a Merge branch 'nsc/initial-web-refac' Nicolas 2024-05-04 13:49:18 -0700
  • d1b6f6dcde Update fly.toml Nicolas 2024-05-04 13:49:09 -0700
  • 797a7338ea
    Update README.md Nicolas 2024-05-04 13:26:18 -0700
  • 3156e0ca15
    Merge pull request #120 from mendableai/nsc/initial-web-refac Nicolas 2024-05-04 13:15:25 -0700
  • cd9a0840b5 Update search.ts Nicolas 2024-05-04 13:13:15 -0700
  • 5229a4902b Update search.ts Nicolas 2024-05-04 13:09:11 -0700
  • ce7bab7b35 Update status.ts Nicolas 2024-05-04 13:00:38 -0700
  • 15b774e974 Update index.ts Nicolas 2024-05-04 12:44:30 -0700
  • 67f135a5b6 Update crawl-status.ts Nicolas 2024-05-04 12:31:28 -0700
  • 2aa09a3000 Nick: partial docs working, cleaner Nicolas 2024-05-04 12:30:12 -0700
  • 5a352b2b4f
    Remove selfhost api key chand1012 2024-05-04 15:13:51 -0400
  • 07012ca19c
    Add docker compose file for self hosting chand1012 2024-05-04 15:12:17 -0400
  • 00373228fa Update index.ts Nicolas 2024-05-04 11:53:16 -0700
  • fbb4c63a1a [Test] Added integration tests suite rafaelsideguide 2024-05-03 17:23:25 -0300
  • ef6db3b7c2
    Update README.md Nicolas 2024-05-03 09:19:12 -0700
  • 784b81e6d6
    Merge pull request #109 from mendableai/feat/posthog-logging Nicolas 2024-05-03 09:09:08 -0700
  • 97288a3829
    Merge pull request #110 from bllchmbrs/patch-1 Nicolas 2024-05-02 20:07:35 -0700
  • f4cc2dbd96
    Update README.md Bill Chambers 2024-05-02 19:57:55 -0700
  • 3748f8e322
    Update README.md Nicolas 2024-05-02 13:26:46 -0700
  • 21cdaf5996
    Update log_job.ts Nicolas 2024-05-02 12:40:49 -0700
  • caf3f9eede Add Posthog Logging Eric Ciarla 2024-05-02 15:30:22 -0400
  • 3c81ff1937
    Update README.md Nicolas 2024-05-01 13:38:57 -0700
  • 469c15def3
    Update README.md Eric Ciarla 2024-05-01 16:22:01 -0400
  • 8a95cb42f0 Update models.ts Nicolas 2024-04-30 18:36:21 -0700
  • 4967536501 Update index.ts Nicolas 2024-04-30 18:19:55 -0700
  • f88c728568
    Update README.md Nicolas 2024-04-30 17:03:41 -0700
  • 2f2b83b5ee
    Merge pull request #90 from mendableai/llm-extraction Nicolas 2024-04-30 16:57:54 -0700
  • 768166b066 Update single_url.ts Nicolas 2024-04-30 16:57:44 -0700
  • a386259511 Update scrape.ts Nicolas 2024-04-30 16:35:44 -0700
  • dfcf39f4c0 Update scrape.ts Nicolas 2024-04-30 16:19:59 -0700
  • 3c7030dbb1 Nick: improvements Nicolas 2024-04-30 16:19:32 -0700
  • cbd9e88b77 Merge branch 'main' into llm-extraction Nicolas 2024-04-30 14:49:20 -0700
  • 5ae05bda1d Update contradiction-testing-using-llms.mdx Eric Ciarla 2024-04-30 16:05:33 -0400
  • 4f526cff92 Nick: cleanup Nicolas 2024-04-30 12:19:43 -0700