web.csv is csv file containing urls and their titles + image urls as presented in html files
search
search example, multiple words "download debian"
image search
(searchimg searches from web.csv, *tmp commands search from web-tmp.csv)
crawl
you can stop crawling at any time you wish with ctlr+c
after crawling, update web.csv
upload & generate new link
you can generate data uri as well for better decentralization
install
- download webcsv
- download web.csv.gz into ~/webcsv/
there is no single place which guarantees best file, here is one link to web.csv.gz, but you might have better one, use which ever version you want
- gzip -dc web.csv.gz > web.csv