Eric Ciarla
|
a6b7197737
|
Fix for maxDepth
|
2024-06-14 19:40:37 -04:00 |
|
Nicolas
|
4ec863718b
|
Merge pull request #283 from mendableai/nsc/crawler-fixes
Fixes crawler getting confused with base paths that contain www.
|
2024-06-14 13:50:32 -07:00 |
|
Nicolas
|
43767360d8
|
Merge branch 'main' into nsc/rate-limiter-tests
|
2024-06-14 13:50:21 -07:00 |
|
Nicolas
|
e88cb314c8
|
Update crawler.ts
|
2024-06-14 13:44:54 -07:00 |
|
Rafael Miller
|
361cba4119
|
Merge pull request #175 from mendableai/test/load-testing
Test/load testing
|
2024-06-14 17:39:01 -03:00 |
|
Nicolas
|
7b11ace87d
|
Create rate-limiter.test.ts
|
2024-06-14 12:31:42 -07:00 |
|
rafaelsideguide
|
e369d1dd0e
|
Update index.test.ts
|
2024-06-14 16:17:54 -03:00 |
|
Nicolas
|
e37aa3db57
|
Nick: fixed rate limit on status
|
2024-06-14 12:13:02 -07:00 |
|
rafaelsideguide
|
a6ed2e693f
|
Update index.test.ts
|
2024-06-14 15:22:52 -03:00 |
|
rafaelsideguide
|
ad7795f973
|
Merge remote-tracking branch 'origin/main' into test/load-testing
|
2024-06-14 15:14:01 -03:00 |
|
Rafael Miller
|
0ec26576d6
|
Merge pull request #277 from mendableai/feat/maxDepthRelative
Make maxDepth relative to the entered url
|
2024-06-14 13:07:23 -03:00 |
|
rafaelsideguide
|
354712a8a3
|
just changed the name for the test?
|
2024-06-14 13:02:04 -03:00 |
|
Eric Ciarla
|
2c5f5c0ea2
|
Merge branch 'main' into feat/maxDepthRelative
|
2024-06-14 11:49:12 -04:00 |
|
Eric Ciarla
|
80c10393b4
|
Update index.test.ts
|
2024-06-14 11:32:30 -04:00 |
|
Eric Ciarla
|
42ed1f4479
|
Update index.test.ts
|
2024-06-14 11:20:24 -04:00 |
|
Rafael Miller
|
52d6201c42
|
Merge pull request #276 from mendableai/feat/issue-266
[Feat] Added metadata.pageStatusCode and metadata.pageError properties
|
2024-06-14 12:19:24 -03:00 |
|
Eric Ciarla
|
8830acce07
|
Update index.test.ts
|
2024-06-14 11:11:58 -04:00 |
|
Eric Ciarla
|
278bb311cb
|
Update index.test.ts
|
2024-06-14 11:02:39 -04:00 |
|
Eric Ciarla
|
36a62727b8
|
Update index.test.ts
|
2024-06-14 10:52:43 -04:00 |
|
Rafael Miller
|
f9c7ca9388
|
Merge branch 'main' into feat/issue-266
|
2024-06-14 11:47:58 -03:00 |
|
Rafael Miller
|
2c0a2c742a
|
Merge pull request #271 from mendableai/feat/issue-205
[Feat] Added parsePDF option to pageOptions
|
2024-06-14 11:29:26 -03:00 |
|
Rafael Miller
|
3e2e76311c
|
Merge branch 'main' into feat/issue-205
|
2024-06-14 11:25:20 -03:00 |
|
Eric Ciarla
|
59451754f5
|
Add tests
|
2024-06-14 10:14:07 -04:00 |
|
Rafael Miller
|
5fd228f9ec
|
Merge pull request #253 from mattjoyce/py-sdk-improve-response-handling
Python sdk improve response handling
|
2024-06-14 11:12:16 -03:00 |
|
rafaelsideguide
|
afee5684a3
|
Fixed tests' message and updated version
|
2024-06-14 11:05:19 -03:00 |
|
Eric Ciarla
|
9b254c1cd0
|
Update index.test.ts
|
2024-06-14 09:48:14 -04:00 |
|
Rafael Miller
|
5a5c532bea
|
Merge branch 'main' into py-sdk-improve-response-handling
|
2024-06-14 10:42:51 -03:00 |
|
Eric Ciarla
|
9aba451b18
|
Update index.test.ts
|
2024-06-14 09:33:43 -04:00 |
|
Rafael Miller
|
cc2e3f05b0
|
Merge pull request #256 from mattjoyce/feat-254-sdk-py-logging
Added logging to python sdk FIRECRAWL_LOGGING_LEVEL
|
2024-06-14 10:22:40 -03:00 |
|
rafaelsideguide
|
6963a490f1
|
Updated version
|
2024-06-14 10:21:44 -03:00 |
|
rafaelsideguide
|
5dd18ca79b
|
fixed edge cases
|
2024-06-14 09:46:55 -03:00 |
|
Eric Ciarla
|
ab9de0f5ab
|
Update maxDepth tests
|
2024-06-13 18:46:30 -04:00 |
|
Eric Ciarla
|
393bd45237
|
Update index.test.ts
|
2024-06-13 18:13:15 -04:00 |
|
Eric Ciarla
|
71c98d8b80
|
Update logic
|
2024-06-13 18:00:52 -04:00 |
|
Eric Ciarla
|
095951aa4d
|
Update test
|
2024-06-13 17:40:00 -04:00 |
|
Eric Ciarla
|
5e8aa92788
|
Update index.ts
|
2024-06-13 17:33:13 -04:00 |
|
Eric Ciarla
|
bf10e9d392
|
Update index.test.ts
|
2024-06-13 17:28:59 -04:00 |
|
Eric Ciarla
|
65d63bae45
|
Update index.ts
|
2024-06-13 17:17:44 -04:00 |
|
Eric Ciarla
|
32e814bedc
|
Update index.ts
|
2024-06-13 17:02:30 -04:00 |
|
Nicolas
|
6fc1ee32fd
|
Merge pull request #275 from mendableai/feat/issue-273
Added pageOptions.removeTags
|
2024-06-13 13:27:01 -07:00 |
|
rafaelsideguide
|
bb859ae9a7
|
Added metadata.pageStatusCode and metadata.pageError properties to the responses
|
2024-06-13 17:08:40 -03:00 |
|
rafaelsideguide
|
676d6e8ab5
|
Added pageOptions.removeTags
|
2024-06-13 10:51:05 -03:00 |
|
Nicolas
|
d48c0df6c5
|
Merge pull request #274 from mendableai/nsc/clusters
Clusters support to scale our API to # of CPUs running
|
2024-06-12 18:09:26 -07:00 |
|
Nicolas
|
182f8d4d6c
|
Update index.ts
|
2024-06-12 18:07:05 -07:00 |
|
Nicolas
|
11b6d5afa5
|
Update fly.toml
|
2024-06-12 18:00:22 -07:00 |
|
Nicolas
|
67dc46b454
|
Nick: clusters
|
2024-06-12 17:53:04 -07:00 |
|
Nicolas
|
bad0f57134
|
Merge pull request #272 from mendableai/bug/issue-258
[Feat] Added jobId to webhook data
|
2024-06-12 12:29:50 -07:00 |
|
rafaelsideguide
|
d20af257ba
|
Added jobId to webhook data
|
2024-06-12 15:38:41 -03:00 |
|
rafaelsideguide
|
e37d151404
|
added parsePDF option to pageOptions
user can decide if they are going to let us take care of the parse or they are going to parse the pdf by themselves
|
2024-06-12 15:06:47 -03:00 |
|
Rafael Miller
|
48f6c19a05
|
Merge pull request #269 from mendableai/feat/allowbackwardcrawling-option
[Feat] Added allowBackwardCrawling option
|
2024-06-12 11:34:39 -03:00 |
|
