Nicolas
2ce045912f
Nick: disable vision right now
2024-05-13 10:56:08 -07:00
rafaelsideguide
4737fe8711
Added missing instruction
2024-05-13 13:47:49 -03:00
rafaelsideguide
f4348024c6
Added check during scraping to deal with pdfs
...
Checks if the URL is a PDF during the scraping process (single_url.ts).
TODO: Run integration tests - Does this strat affect the running time?
ps. Some comments need to be removed if we decide to proceed with this strategy.
2024-05-13 09:13:42 -03:00
chand1012
5cbce060ed
chore: Update docker-compose.yaml with default values for PORT and HOST
2024-05-10 17:26:00 -04:00
chand1012
b498e9881c
chore: Update docker-compose.yaml network configuration
2024-05-10 17:23:22 -04:00
chand1012
2021a822ff
chore: Add firecrawl network to docker-compose.yaml
2024-05-10 17:20:33 -04:00
chand1012
0245066009
chore: Update docker-compose.yaml with default values for REDIS_URL and PLAYWRIGHT_MICROSERVICE_URL
2024-05-10 17:15:32 -04:00
Rafael Miller
5a2712fa5a
Merge branch 'main' into detect-pdfs
2024-05-10 15:53:13 -03:00
rafaelsideguide
bc6b929b43
[Bug] Fixing /crawl limit
2024-05-10 12:15:54 -03:00
rafaelsideguide
df16890f84
Added default value for crawlOptions.limit
2024-05-10 11:59:33 -03:00
rafaelsideguide
18480b2005
Removed .env.example, improved docs and docker compose envs
2024-05-10 11:38:17 -03:00
Nicolas
66bd1e4020
Update website_params.ts
2024-05-09 18:41:15 -07:00
Nicolas
c02a82c282
Update main.py
2024-05-09 18:02:34 -07:00
Nicolas
efc6fcb474
Merge branch 'main' of https://github.com/mendableai/firecrawl
2024-05-09 18:01:04 -07:00
Nicolas
73687822ad
Update main.py
2024-05-09 18:00:58 -07:00
Nicolas
f94b6053ad
Merge pull request #139 from mendableai/nsc/refactor-scraping-order
...
Nsc/refactor scraping order
2024-05-09 17:57:01 -07:00
Caleb Peffer
9f2e90be97
Update README.md
...
Adding keywords to readme to improve github seo. Based on => https://bookface.ycombinator.com/posts/77363
2024-05-09 17:52:57 -07:00
Nicolas
d21091bb06
Update single_url.ts
2024-05-09 17:52:46 -07:00
Nicolas
be85008622
Nick: better
2024-05-09 17:48:11 -07:00
Nicolas
73e8da9185
Merge branch 'main' into nsc/refactor-scraping-order
2024-05-09 17:45:20 -07:00
Nicolas
be5661a768
Nick: a lot better
2024-05-09 17:45:16 -07:00
Caleb Peffer
08d6c59a78
Merge pull request #134 from mendableai/cjp/switch-license-to-AGPL
...
Switching to AGPL - We Need Your Consent!
2024-05-09 16:47:03 -07:00
Nicolas
5ab97bbe23
Merge branch 'main' of https://github.com/mendableai/firecrawl
2024-05-09 15:29:59 -07:00
Nicolas
fce17e6beb
Update credit_billing.ts
2024-05-09 15:29:58 -07:00
Nicolas
53ab33c287
Update README.md
2024-05-09 10:27:10 -07:00
Nicolas
832a4f53e0
Merge pull request #137 from mendableai/nsc/llm-extraction-zod-integration
...
[Docs] Updated examples
2024-05-09 09:24:36 -07:00
rafaelsideguide
f4d8b2c89a
Updated docs
2024-05-09 10:36:56 -03:00
Nicolas
c02d7aeebd
Merge pull request #135 from mendableai/nsc/llm-extraction-zod-integration
...
Adds Zod Integration for LLM Extraction in the Firecrawl JS SDK
2024-05-08 18:15:12 -07:00
Nicolas
d6b4904ef1
Update README.md
2024-05-08 18:10:43 -07:00
Nicolas
3b5f71c1e8
Update README.md
2024-05-08 17:46:35 -07:00
Nicolas
1033034201
Update README.md
2024-05-08 17:45:19 -07:00
Nicolas
aa6b84c5fa
Nick: readme
2024-05-08 17:41:15 -07:00
Nicolas
d9da4b53f8
Update example.py
2024-05-08 17:36:40 -07:00
Nicolas
4c88d5da66
Nick: v8 python
2024-05-08 17:35:16 -07:00
Nicolas
e6dbbf1bab
Nick: fixes js and pydantic implementation
2024-05-08 17:16:59 -07:00
Nicolas
c89964b230
Nick:
2024-05-08 16:38:49 -07:00
Nicolas
9541ff6b30
Nick: 429 addressed
2024-05-08 15:14:39 -07:00
Nicolas
3bfef646e0
Update index.test.ts
2024-05-08 13:23:53 -07:00
Nicolas
6ced8e73a7
Update index.test.ts
2024-05-08 13:13:38 -07:00
Nicolas
c50076c377
Update websites.json
2024-05-08 13:04:17 -07:00
Nicolas
1296928879
Update index.test.ts
2024-05-08 13:00:20 -07:00
Nicolas
9578856c8a
Update fly.yml
2024-05-08 12:50:55 -07:00
Nicolas
6d6617d96b
Merge branch 'feat/test-suite'
2024-05-08 12:50:10 -07:00
Nicolas
1c45951190
Nick:
2024-05-08 12:50:02 -07:00
Nicolas
58efb6e96a
Update test_suite.yml
2024-05-08 12:48:20 -07:00
Nicolas
4a5f87623c
Merge pull request #118 from mendableai/feat/test-suite
...
[Test] Added integration tests suite
2024-05-08 12:47:17 -07:00
Nicolas
0fae15a464
Update fly.yml
2024-05-08 12:47:01 -07:00
Nicolas
fb7a8fd73f
Delete test_screenshot.png
2024-05-08 12:39:32 -07:00
Nicolas
c635688ddb
Nick: test suite
2024-05-08 12:36:54 -07:00
Nicolas
d34b4de6ac
Update websites.json
2024-05-08 12:27:45 -07:00
