8 Commits (cd81a8c97b1a891e22f1b5663c5ff5fbe2637472)

Author	SHA1	Message	Date
Thibaut Courouble	bf003669ba	Simplify file scraper setup; scrape files in the "docs/[slug]" directory	6 years ago
Thibaut	3eb5ccb7ea	Raise error and stop scraping on 4xx/5xx status code	9 years ago
Thibaut	6939865137	Finish Dojo scraper	9 years ago
ShaneQful	3465933543	Added dojo to devdocs & ability to define headers in scraper requests	9 years ago
Thibaut	5e69d6df5e	Make Docs::FileScraper#request_all accept an array of URLs	11 years ago
Thibaut	cd6057e392	Make Docs::UrlScraper#request_all accept an array of URLs	11 years ago
Thibaut	9089d03211	Set the default FileScraper::base_url to localhost	11 years ago
Thibaut	18986c1814	Going open source	12 years ago