0
Commit Graph

76 Commits

Author SHA1 Message Date
Nicolas
f3c190c21c Nick: 2024-04-23 16:47:24 -07:00
rafaelsideguide
849c0b6ebf [Feat] Added blocklist for social media urls 2024-04-23 18:50:35 -03:00
rafaelsideguide
9b01dc6281 Changed from active to waiting jobs 2024-04-23 16:07:22 -03:00
rafaelsideguide
a680c7ce84 [Feat] Server health check + slack message 2024-04-23 15:46:29 -03:00
Nicolas
306cfe4ce1 Nick: 2024-04-23 11:15:11 -07:00
Nicolas
de7e1f501b Update openapi.json 2024-04-22 08:41:54 -07:00
Nicolas
001bf0c504 Update package.json 2024-04-21 12:05:12 -07:00
Nicolas
6560c968e1 Update types.ts 2024-04-21 12:02:11 -07:00
Nicolas
52620bab16 Nick: prod and local-no-auth tests 2024-04-21 11:39:36 -07:00
Nicolas
749bd5f44d Merge branch 'cjp/contributors-guide-and' of https://github.com/mendableai/firecrawl into cjp/contributors-guide-and 2024-04-21 11:27:37 -07:00
Nicolas
898d729a84 Nick: tests 2024-04-21 11:27:31 -07:00
Caleb Peffer
ef4ffd3a18 Adding contributors guide 2024-04-21 10:56:30 -07:00
Nicolas
5cdbf3a0ac Nick: cleaner functions to handle authenticated requests that dont require ifs everywhere 2024-04-21 10:36:48 -07:00
Nicolas
aa89e2e8b5 Merge branch 'main' into cjp/contributors-guide-and 2024-04-21 10:10:05 -07:00
Caleb Peffer
be75aaa195 Caleb: first version of supabase proxy to make db authentication optional 2024-04-21 09:31:22 -07:00
Caleb Peffer
ad7951a679 Merge branch 'main' of https://github.com/mendableai/firecrawl into cjp/contributors-guide-and 2024-04-20 19:56:55 -07:00
Nicolas
d2f808a5fd Update queue-worker.ts 2024-04-20 19:54:37 -07:00
Caleb Peffer
e6b46178dd Caleb: added .env.example 2024-04-20 19:53:27 -07:00
Caleb Peffer
b361a76282 Caleb: added logging improvement 2024-04-20 19:53:04 -07:00
Nicolas
9b31e68a7e Update queue-worker.ts 2024-04-20 19:38:44 -07:00
Nicolas
0db0874b00 Nick: 2024-04-20 19:37:45 -07:00
Nicolas
4543c57e4e Nick: 2024-04-20 19:04:27 -07:00
Nicolas
5b8aed26dd Update scrape.ts 2024-04-20 18:55:39 -07:00
Nicolas
23b2190e5d Nick: 2024-04-20 16:38:05 -07:00
Nicolas
acec76680a
Merge pull request #35 from mendableai/nsc/job-logs
Better logging
2024-04-20 14:12:44 -07:00
Nicolas
5b3c75b06e Nick: 2024-04-20 14:10:29 -07:00
Nicolas
43c2e877e7 Update index.ts 2024-04-20 14:05:01 -07:00
Nicolas
408c7a479f Nick: rate limit fixes 2024-04-20 14:02:22 -07:00
Nicolas
6aa3cc3ce8 Nick: 2024-04-20 13:53:11 -07:00
rafaelsideguide
37ef8a015c fixing scrape preview test 2024-04-19 17:55:35 -03:00
Nicolas
15cfc01f5d Merge branch 'main' of https://github.com/mendableai/firecrawl 2024-04-19 12:23:14 -07:00
Nicolas
a144e13e30 Update rate-limiter.ts 2024-04-19 12:23:13 -07:00
rafaelsideguide
72e1dadccd adding option to replace all relative paths with absolute paths 2024-04-19 11:47:20 -03:00
Nicolas
2c0660653d Merge branch 'main' of https://github.com/mendableai/firecrawl 2024-04-18 13:56:25 -07:00
Nicolas
be35b32306 Nick: preview token tests 2024-04-18 13:55:55 -07:00
rafaelsideguide
c627d22179 all working now 2024-04-18 17:41:23 -03:00
rafaelsideguide
dab0568c43 testing tests 2024-04-18 17:38:12 -03:00
rafaelsideguide
3f833737f3 fixing test 2024-04-18 17:25:25 -03:00
rafaelsideguide
efbb4e8905 fixing jest parameters 2024-04-18 17:18:15 -03:00
rafaelsideguide
ddb3b25171 adding ci-cd workflow 2024-04-18 16:28:01 -03:00
Nicolas
3e9e24aaf1 Update index.ts 2024-04-18 11:01:24 -07:00
Nicolas
0f7ab4107f Update index.ts 2024-04-18 10:41:06 -07:00
Nicolas
6112cc1c2c Update index.ts 2024-04-18 10:34:41 -07:00
rafaelsideguide
c4cc4b9262 fixing document response 2024-04-18 14:12:39 -03:00
Rafael Miller
704a059448
Update index.ts 2024-04-18 13:53:11 -03:00
rafaelsideguide
57e5b36014 [Feat] Adding pdf parser 2024-04-18 11:43:57 -03:00
Nicolas
e3a6bc4de7 Create openapi.json 2024-04-17 22:23:10 -07:00
Nicolas
ca2bf9cc12 Update single_url.ts 2024-04-17 18:27:08 -07:00
Nicolas
36abe0f7f9 Nick: 2024-04-17 18:24:46 -07:00
Nicolas
460763ba5f
Merge pull request #11 from mendableai/feat/parse-to-markdown-tables
[Feat] Added html to markdown table parser
2024-04-17 15:52:43 -04:00