From 01f225245c6ea32a71d7d328263e264946236219 Mon Sep 17 00:00:00 2001 From: Thibaut Courouble Date: Sun, 17 Nov 2013 01:40:46 -0800 Subject: [PATCH] Updated Scraper Reference (markdown) --- Scraper-Reference.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/Scraper-Reference.md b/Scraper-Reference.md index ea0c206e..59d0c69b 100644 --- a/Scraper-Reference.md +++ b/Scraper-Reference.md @@ -59,7 +59,7 @@ Configuration is done via class attributes and divided into three main categorie * `base_url` [String] **(required in `UrlScraper`)** The documents' location. Only URLs _inside_ the `base_url` will be scraped. "inside" more or less means "starting with" except that `/docs` is outside `/doc` (but `/doc/` is inside). - Defaults to `localhost` in `FileScraper`. (Note: any iframe, image, or skipped link pointing to localhost will be removed by the `CleanLocalUrls` filter; the value should be overridden if the documents are available online.) + Defaults to `localhost` in `FileScraper`. _(Note: any iframe, image, or skipped link pointing to localhost will be removed by the `CleanLocalUrls` filter; the value should be overridden if the documents are available online.)_ Unless `root_path` is set, the root/initial URL is equal to `base_url`. * `root_path` [String] **(inherited)**