Mark Percival
|
e8b8150b56
|
Chore: Add some basic jest tests
|
2024-04-25 14:30:33 +00:00 |
|
Mark Percival
|
a7be09e479
|
Fix: Remove dotenv from npm module
|
2024-04-25 14:16:14 +00:00 |
|
rafaelsideguide
|
d3ab2ea926
|
[Feat] Implemented retry attempts to handle 502 errors
|
2024-04-25 10:51:01 -03:00 |
|
rafaelsideguide
|
9c481e5e83
|
[Feat] Coupon system
WIP. Idea for solving #57
|
2024-04-25 10:05:53 -03:00 |
|
Rafael Miller
|
abf6918642
|
Merge pull request #64 from mendableai/feat/allowed-urls
[Feat] Added allowed urls
|
2024-04-25 08:43:16 -03:00 |
|
rafaelsideguide
|
75597f72a1
|
[Feat] Added allowed urls
FireCrawl should be able to scrape LinkedIn Articles (/pulse/*)
|
2024-04-25 08:39:45 -03:00 |
|
Nicolas
|
75e82869ed
|
Merge pull request #62 from mendableai/nsc/serper-params
Serper params
|
2024-04-24 18:13:30 -07:00 |
|
Nicolas
|
a59ddf1855
|
Nick: default to serper
|
2024-04-24 18:00:25 -07:00 |
|
Roger M
|
f2690f6909
|
Support for tbs, filter, lang, country and location with Serper search.
|
2024-04-25 01:35:17 +01:00 |
|
Nicolas
|
26c861db5a
|
Update README.md
|
2024-04-24 16:13:29 -07:00 |
|
Nicolas
|
d0a70de062
|
Update README.md
|
2024-04-24 11:46:25 -07:00 |
|
Nicolas
|
427f658c44
|
Update README.md
|
2024-04-24 10:40:07 -07:00 |
|
Nicolas
|
e7d385ad32
|
Update search.ts
|
2024-04-24 10:23:26 -07:00 |
|
Nicolas
|
3d18f2f7a0
|
Update README.md
|
2024-04-24 10:16:23 -07:00 |
|
Nicolas
|
877af4231b
|
Update openapi.json
|
2024-04-24 10:11:44 -07:00 |
|
Nicolas
|
307ea6f5ec
|
Nick: improvements to search
|
2024-04-24 10:11:01 -07:00 |
|
Rafael Miller
|
f189589da4
|
Merge pull request #34 from mendableai/nsc/returnOnlyUrls
Implements the ability for the crawler to output all the links it found, without scraping
|
2024-04-24 10:34:42 -03:00 |
|
rafaelsideguide
|
07e93ee5fd
|
Update requests.http
|
2024-04-24 10:32:35 -03:00 |
|
Rafael Miller
|
523dd15aac
|
Merge pull request #13 from mendableai/bugfix/lowercase-all-urls
[Bugfix] Trim and Lowercase all urls
|
2024-04-24 10:14:58 -03:00 |
|
Rafael Miller
|
68cb9e60c0
|
Merge branch 'main' into bugfix/lowercase-all-urls
|
2024-04-24 10:07:35 -03:00 |
|
rafaelsideguide
|
942ac3b41c
|
Resolved merge conflicts between feat/added-anthropic-vision-api and main
|
2024-04-24 09:57:45 -03:00 |
|
Nicolas
|
3b5b868d0d
|
Update requests.http
|
2024-04-23 18:13:58 -07:00 |
|
Nicolas
|
8939ca570b
|
Merge branch 'main' into nsc/returnOnlyUrls
|
2024-04-23 18:05:48 -07:00 |
|
Nicolas
|
56c810947e
|
Merge branch 'nsc/mvp-search'
|
2024-04-23 17:46:43 -07:00 |
|
Nicolas
|
479fa2f7f8
|
Nick:
|
2024-04-23 17:46:32 -07:00 |
|
Nicolas
|
dda77dce05
|
Merge pull request #56 from mendableai/nsc/mvp-search
[Feat:mvp] Search Endpoint => serp api + firecrawl => 🔥 🔍
|
2024-04-23 17:17:40 -07:00 |
|
Nicolas
|
fdb2789eaa
|
Nick: added url as return param
|
2024-04-23 17:14:34 -07:00 |
|
Nicolas
|
3abfd6b4c1
|
Update search.ts
|
2024-04-23 17:06:48 -07:00 |
|
Nicolas
|
53cc4c396f
|
Update search.ts
|
2024-04-23 17:05:58 -07:00 |
|
Nicolas
|
734c76fc56
|
Merge branch 'main' into nsc/mvp-search
|
2024-04-23 17:04:31 -07:00 |
|
Nicolas
|
f0695c7123
|
Update single_url.ts
|
2024-04-23 17:04:10 -07:00 |
|
Nicolas
|
4328a68ec1
|
Nick:
|
2024-04-23 16:57:53 -07:00 |
|
Nicolas
|
e6779aff68
|
Nick: tests
|
2024-04-23 16:56:09 -07:00 |
|
Nicolas
|
9ded75adb7
|
Merge branch 'main' into nsc/mvp-search
|
2024-04-23 16:52:40 -07:00 |
|
Nicolas
|
6a1c7d48ae
|
Merge pull request #55 from mendableai/feat/blocklist-social-media
[Feat] Added blocklist for social media urls
|
2024-04-23 16:52:17 -07:00 |
|
Nicolas
|
f3c190c21c
|
Nick:
|
2024-04-23 16:47:24 -07:00 |
|
Nicolas
|
41263bb4b6
|
Nick: serper support
|
2024-04-23 16:45:06 -07:00 |
|
Nicolas
|
8cb5d7955a
|
Update googlesearch.ts
|
2024-04-23 15:49:05 -07:00 |
|
Caleb Peffer
|
841279c74d
|
Update README.md
Added a reminder to star the repo with a graphic.
|
2024-04-23 15:49:00 -07:00 |
|
Nicolas
|
495adc9a3f
|
Update googlesearch.ts
|
2024-04-23 15:48:37 -07:00 |
|
Nicolas
|
5e3e2ec966
|
Nick:
|
2024-04-23 15:44:11 -07:00 |
|
Nicolas
|
0146157876
|
Nick: mvp
|
2024-04-23 15:28:32 -07:00 |
|
rafaelsideguide
|
849c0b6ebf
|
[Feat] Added blocklist for social media urls
|
2024-04-23 18:50:35 -03:00 |
|
Nicolas
|
b7f6b9be13
|
Merge pull request #53 from mendableai/feat/server-health-check-slack-message
[Feat] Server health check + slack message
|
2024-04-23 12:22:59 -07:00 |
|
rafaelsideguide
|
9b01dc6281
|
Changed from active to waiting jobs
|
2024-04-23 16:07:22 -03:00 |
|
rafaelsideguide
|
a680c7ce84
|
[Feat] Server health check + slack message
|
2024-04-23 15:46:29 -03:00 |
|
Nicolas
|
c70bc08d73
|
Merge pull request #52 from mendableai/nsc/fix-tables
Fixes table parsing for websites such as news.ycombinator.com (HN)
|
2024-04-23 11:18:22 -07:00 |
|
Nicolas
|
306cfe4ce1
|
Nick:
|
2024-04-23 11:15:11 -07:00 |
|
Nicolas
|
357914c07d
|
Merge branch 'main' of https://github.com/mendableai/firecrawl
|
2024-04-23 10:55:42 -07:00 |
|
Nicolas
|
bf2df7a853
|
Nick: fix js-sdk
|
2024-04-23 10:55:40 -07:00 |
|
