GyDi(@zzzgydi) 's Twitter Profile Photo

分享一个开源项目,github.com/zzzgydi/webscr…
用于在RAG应用中将链接转成LLM友好的文本,也是zbyai.com 应用中的一个依赖模块。

原理:使用无头浏览器或者直接GET请求,然后用Readability优化,然后html转markdown。

可以直接点击下方链接查看效果:scraper.zbyai.com/?u=https://git…

account_circle
Web Scraping Coach(@WebScraper_Pro) 's Twitter Profile Photo

I'm a web scraping expert, a top-rated freelancer on Upwork with a 100% Job Success Score. If you need this scraper or want another one developed, or need web data extracted from any site, please contact me.

account_circle
Web Scraping Coach(@WebScraper_Pro) 's Twitter Profile Photo

I've added advanced features like customizing search locations, displaying total property listings for each location, scrolling pages, and displaying a progress bar. It ensures 100% accurate data extraction. I'm happy to share the scraper's results and randomly verify them.

account_circle