0
Commit Graph

612 Commits

Author SHA1 Message Date
Matt Joyce
14896a9fdd Fix PLAYWRIGHT_MICROSERVICE_URL
It needs to end in html, otherwise scrape will 404
2024-06-01 19:03:16 +10:00
Matt Joyce
1eacad4ef3 Clarifying wait type and name 2024-06-01 18:53:03 +10:00
Matt Joyce
c516140bfb Various Linting
Pylint
C0114: Missing module docstring
C0115: Missing class docstring
C0116: Missing function or method docstring
C0303: Trailing whitespace
Import ordering
2024-06-01 18:53:03 +10:00
Matt Joyce
2a39b5382b Add timeout to class and provide default. 2024-06-01 18:52:42 +10:00
Nicolas
c7d5a9ad48 Merge branch 'main' into nsc/fwd-header-auth 2024-05-31 18:19:20 -07:00
Nicolas
8cb62dde92 Update website_params.ts 2024-05-31 16:09:39 -07:00
Nicolas
3b8059edb6 Update single_url.ts 2024-05-31 15:43:06 -07:00
Nicolas
6bea803120 Nick: 2024-05-31 15:39:54 -07:00
Nicolas
03ba4a9fa7
Merge pull request #218 from mendableai/nsc/python-sdk-waiting-fixes
[sdk] Fixes waiting status not being present on check status
2024-05-31 11:54:27 -07:00
Nicolas
2139129296 Nick: v12 2024-05-31 11:39:55 -07:00
Nicolas
260e31c68b Merge branch 'nsc/new-pricing' 2024-05-30 16:08:31 -07:00
Nicolas
aa8133ca7f Update load-testing-example.ts 2024-05-30 16:07:14 -07:00
Nicolas
0c115c6181
Merge pull request #216 from mendableai/nsc/new-pricing
feat: New pricing/limits changes
2024-05-30 15:36:59 -07:00
Nicolas
d486d7da1c
Merge pull request #207 from mendableai/feat/screenshot-support
Feat/screenshot support
2024-05-30 15:36:09 -07:00
Nicolas
6860ace4af Nick: 2024-05-30 15:07:49 -07:00
Nicolas
6ceb7ff50a Nick: 2024-05-30 14:46:55 -07:00
Nicolas
33f10a7f91 Nick: fixes 2024-05-30 14:42:32 -07:00
Nicolas
ace46f340b Nick: new limits, new pricing 2024-05-30 14:31:36 -07:00
Matt Joyce
677102e676 Script to check local vs published versions
This script is for use with Github workflows
2024-05-30 22:05:21 +10:00
rafaelsideguide
2b763d848b improved js response and test for getting partial_data 2024-05-30 08:44:38 -03:00
rafaelsideguide
5b8b6902e7 Update index.ts 2024-05-30 08:25:13 -03:00
Nicolas
6c939d534d Nick: small refactor 2024-05-29 19:43:51 -07:00
Eric Ciarla
37915e11e8 Final push 2024-05-29 21:18:24 -04:00
Eric Ciarla
a0e404f94e init commit 2024-05-29 18:56:57 -04:00
Nicolas
51b0b88cd4
Merge pull request #204 from mendableai/feat/custom-scraping-readme
[Feat] Added custom scraping conditions for readme docs
2024-05-29 10:00:24 -07:00
rafaelsideguide
ee9a2184e2 Added custom scraping conditions for readme docs 2024-05-29 13:39:43 -03:00
Nicolas
8911ddf10c Merge branch 'nsc/wait-for-param' 2024-05-28 17:17:29 -07:00
Nicolas
c20c38721d Update index.test.ts 2024-05-28 17:17:20 -07:00
Nicolas
0f43a12906 Update index.test.ts 2024-05-28 17:17:12 -07:00
Nicolas
7187eaef87
Merge pull request #200 from mendableai/nsc/wait-for-param
Allow users to manually set the waitFor param on /scrape
2024-05-28 16:59:26 -07:00
Nicolas
f53d25efac Merge branch 'main' into nsc/wait-for-param 2024-05-28 12:56:28 -07:00
Nicolas
1b3547dcf2 Nick: 2024-05-28 12:56:24 -07:00
Nicolas
9b5e5b8722
Merge pull request #183 from mendableai/test-sdks
[Test] Added sdk e2e tests
2024-05-28 11:32:29 -07:00
Nicolas
41b98f15a8
Update README.md 2024-05-27 22:57:13 -07:00
rafaelsideguide
71187b03a2 added timeout 2024-05-27 16:48:08 -03:00
rafaelsideguide
d5c83803cd fixing idempotency test 2024-05-27 16:35:01 -03:00
rafaelsideguide
41c4ef6a82 dotenv was missing 2024-05-27 16:23:57 -03:00
rafaelsideguide
6b58da1c96 jest 2024-05-27 16:01:48 -03:00
rafaelsideguide
e87d39e6ec typo 2024-05-27 15:55:48 -03:00
rafaelsideguide
127d2db1dd added js/ts sdk tests 2024-05-27 15:54:09 -03:00
rafaelsideguide
d0c4b24a0e missing redis 2024-05-27 14:36:32 -03:00
rafaelsideguide
952ccd8755 envs 2024-05-27 14:34:39 -03:00
rafaelsideguide
f32c16258a missing node setup 2024-05-27 14:32:34 -03:00
rafaelsideguide
a9b68d95d8 Update test.py 2024-05-27 14:28:44 -03:00
rafaelsideguide
c410dbe5bd Update python-tests.yml 2024-05-27 14:24:30 -03:00
rafaelsideguide
667d3e4c4f Merge branch 'test-sdks' of https://github.com/mendableai/firecrawl into test-sdks 2024-05-27 14:23:39 -03:00
rafaelsideguide
19decd1062 fixing workflow 2024-05-27 14:21:33 -03:00
Rafael Miller
3c8edf683c
Merge branch 'main' into test-sdks 2024-05-27 14:15:18 -03:00
rafaelsideguide
63772ea711 added github action workflow 2024-05-27 14:14:00 -03:00
Nicolas
1ef307cb6f Nick: checks 2024-05-27 10:01:12 -07:00