v/examples/web_crawler
mir.zhou 6425000ce4
example: fix the tuicool.com crawler example (changed html structure) (#13962)
2022-04-07 18:18:10 +03:00
..
README.md examples: add web_crawler and get_weather (#10084) 2021-05-14 11:09:21 +03:00
web_crawler.v example: fix the tuicool.com crawler example (changed html structure) (#13962) 2022-04-07 18:18:10 +03:00

README.md

web_crawler

web_crawler is a very simple web crawler.
This web crawler fetches news from tuicool.com, (a chinese site similar to hacker-news.firebaseio.com).

Compile and Run

Use this to generate an executable, and then launch the web crawler:

v web_crawler.v
./web_crawler

And this to compile and launch the web crawler directly:

v run web_crawler.v

This project shows how to use http.fetch() to get http.Response, and then html.parse() to parse the returned html.

It's easy, isn't it?