Nicolas
|
4bb536e5b3
|
Merge pull request #166 from mattjoyce/main
Allow override of API URL
|
2024-05-20 09:44:47 -07:00 |
|
Matt Joyce
|
7e5ef4dec4
|
Allow override of API URL
Allows python sdk to be used with local installs.
|
2024-05-20 18:46:32 +10:00 |
|
Nicolas
|
c74f757b53
|
Update rate-limiter.ts
|
2024-05-19 13:05:36 -07:00 |
|
Nicolas
|
842e197fd7
|
Merge pull request #151 from mendableai/feat/rate-limits
[Feat] Added rate limits
|
2024-05-19 13:01:37 -07:00 |
|
Nicolas
|
98a39b39ab
|
Nick: increased rate limits
|
2024-05-19 12:59:29 -07:00 |
|
Nicolas
|
18fa15df25
|
Update index.test.ts
|
2024-05-19 12:50:06 -07:00 |
|
Nicolas
|
614c073af0
|
Nick: improvements
|
2024-05-19 12:45:46 -07:00 |
|
Nicolas
|
f473793ba3
|
Merge branch 'main' into feat/rate-limits
|
2024-05-19 12:23:34 -07:00 |
|
Nicolas
|
4efebf7a4b
|
Merge branch 'test/load-testing' of https://github.com/mendableai/firecrawl into test/load-testing
|
2024-05-19 12:22:51 -07:00 |
|
Nicolas
|
5792cd022c
|
Update fly.staging.toml
|
2024-05-19 12:22:49 -07:00 |
|
Nicolas
|
713f16fdc1
|
Update README.md
|
2024-05-19 00:41:12 -07:00 |
|
Nicolas
|
0dc108cd33
|
Update README.md
|
2024-05-18 11:32:13 -07:00 |
|
Nicolas
|
43d0309b09
|
Merge pull request #160 from elimisteve/patch-1
Update README.md: Typo fix
|
2024-05-18 11:24:23 -07:00 |
|
Steve Phillips
|
81563130e3
|
Update README.md: Typo fix
Don't scrap, scrape!
|
2024-05-18 03:58:17 +02:00 |
|
Nicolas
|
fae8954eeb
|
Update SELF_HOST.md
|
2024-05-17 18:46:59 -07:00 |
|
rafaelsideguide
|
d667e1417b
|
added fly staging load test
- being rate limited. Need to add the token to the rate-limit functions
|
2024-05-17 19:09:19 -03:00 |
|
Nicolas
|
7630565c26
|
Create fly.staging.toml
|
2024-05-17 14:33:59 -07:00 |
|
rafaelsideguide
|
7297b21dcd
|
Added load testing using artillery
|
2024-05-17 18:32:44 -03:00 |
|
rafaelsideguide
|
a480595aa7
|
Update index.test.ts
|
2024-05-17 15:41:27 -03:00 |
|
rafaelsideguide
|
54049be539
|
Added e2e tests
|
2024-05-17 15:37:47 -03:00 |
|
Nicolas
|
6feb21cc35
|
Update website_params.ts
|
2024-05-17 11:21:26 -07:00 |
|
Nicolas
|
2a1f2e396a
|
Merge pull request #29 from mendableai/detect-pdfs
Fixes pdfs not found if .pdf is not present
|
2024-05-17 10:47:08 -07:00 |
|
Nicolas
|
5be208f595
|
Nick: fixed
|
2024-05-17 10:40:44 -07:00 |
|
Nicolas
|
eb88447e8b
|
Update index.test.ts
|
2024-05-17 10:00:05 -07:00 |
|
Nicolas
|
df6c3d1e7d
|
Merge branch 'main' into detect-pdfs
|
2024-05-17 09:55:51 -07:00 |
|
Nicolas
|
5c1e6d188c
|
Merge pull request #158 from mendableai/nsc/docx-support
feat: Docx Support
|
2024-05-16 12:03:16 -07:00 |
|
Nicolas
|
9d635cb2a3
|
Nick: docx support
|
2024-05-16 11:48:02 -07:00 |
|
Nicolas
|
d407ec76dd
|
Merge branch 'test/crawl-options'
|
2024-05-16 11:03:43 -07:00 |
|
Nicolas
|
bcce0544e7
|
Update openapi.json
|
2024-05-16 11:03:32 -07:00 |
|
Nicolas
|
a31459092e
|
Merge pull request #153 from mendableai/test/crawl-options
[Tests] Added crawl test suite -> crawl improvements
|
2024-05-15 17:40:59 -07:00 |
|
Nicolas
|
80250fb54f
|
Update index.test.ts
|
2024-05-15 17:40:46 -07:00 |
|
Nicolas
|
098db17913
|
Update index.ts
|
2024-05-15 17:37:09 -07:00 |
|
Nicolas
|
93b1f0334e
|
Update index.test.ts
|
2024-05-15 17:35:06 -07:00 |
|
Nicolas
|
123fb784ca
|
Update index.test.ts
|
2024-05-15 17:29:22 -07:00 |
|
Nicolas
|
4a6cfb6097
|
Update index.test.ts
|
2024-05-15 17:22:29 -07:00 |
|
Nicolas
|
6ca368327f
|
Merge branch 'main' into test/crawl-options
|
2024-05-15 17:18:25 -07:00 |
|
Nicolas
|
24be4866c5
|
Nick:
|
2024-05-15 17:16:20 -07:00 |
|
Nicolas
|
ade4e05cff
|
Nick: working
|
2024-05-15 17:13:04 -07:00 |
|
Nicolas
|
bfccaf670d
|
Nick: fixes most of it
|
2024-05-15 15:30:37 -07:00 |
|
rafaelsideguide
|
d91043376c
|
not working yet
|
2024-05-15 18:54:40 -03:00 |
|
rafaelsideguide
|
fa014defc7
|
Fixing child links only bug
|
2024-05-15 18:35:09 -03:00 |
|
Nicolas
|
2ba743fb1a
|
Merge pull request #27 from eltociear/patch-1
refactor: fix typo in WebScraper/index.ts
|
2024-05-15 13:28:38 -07:00 |
|
Nicolas
|
0663d78324
|
Merge pull request #119 from chand1012/main
Add Docker Compose for easy self hosting
|
2024-05-15 13:27:40 -07:00 |
|
Nicolas
|
eb36d4b3bd
|
Update SELF_HOST.md
|
2024-05-15 13:25:39 -07:00 |
|
rafaelsideguide
|
da8d94105d
|
fixed for testing the crawl algorithm only
|
2024-05-15 17:16:03 -03:00 |
|
Nicolas
|
95ffaa2236
|
Update crawl.test.ts
|
2024-05-15 12:58:02 -07:00 |
|
Nicolas
|
f15b8f855e
|
Update crawl.json
|
2024-05-15 12:57:24 -07:00 |
|
Nicolas
|
98dd672d0a
|
Update crawl.json
|
2024-05-15 12:55:04 -07:00 |
|
Nicolas
|
499671c87f
|
Update crawl.test.ts
|
2024-05-15 12:50:13 -07:00 |
|
Nicolas
|
58053eb423
|
Update rate-limiter.ts
|
2024-05-15 12:47:35 -07:00 |
|
