Commit Graph

29 Commits (ddf87bb0b8749fd5366ce850009880d85b7749d1)

Author SHA1 Message Date
Thibaut 6939865137 Finish Dojo scraper 9 years ago
ShaneQful 3465933543 Added dojo to devdocs & ability to define headers in scraper requests 9 years ago
Thibaut 7de19cf800 Make EntryIndex a unique index (don't add the same entry twice) 10 years ago
Thibaut b29d6ca002 Move doc links to manifest 10 years ago
Thibaut cf7f446738 Change home_url to a list of links 10 years ago
Thu Trang Pham 642c1cff7d Make sure that home_url can be nil 10 years ago
Thibaut a59ef1cdb6 Add db_size attribute in doc manifest 10 years ago
Thibaut bc5488faa2 Make docs mtime the greatest of the index and db files' mtime 10 years ago
Thibaut ca7ff6086e Exclude docs without a db file from the manifest 10 years ago
Thibaut ca61a2b746 Add Doc#db_path 10 years ago
Thibaut 5c46eabc67 Output a JSON file containing all the pages' content 10 years ago
Thibaut e9125c6ec2 Refactor Doc.store_pages 10 years ago
Thibaut ecf774e22c Add EntryIndex#blank? 10 years ago
Thibaut 1655a00fb6 Refactor Doc.store_page 10 years ago
Thibaut a9c8c228bc Fix default argument assignment for Ruby 2.2 10 years ago
Thibaut c0be178556 Auto-require gems in the "docs" bundle 11 years ago
Thibaut b92db88506 Refactor Docs::Scraper 11 years ago
Thibaut ca06cc7ad9 Implement Docs::Filter#initial_page? 11 years ago
Thibaut f8298181e9 Implement initial_paths scraper option 11 years ago
Thibaut 5e69d6df5e Make Docs::FileScraper#request_all accept an array of URLs 11 years ago
Thibaut cd6057e392 Make Docs::UrlScraper#request_all accept an array of URLs 11 years ago
Thibaut c6be9b6ae4 Make Docs:Requester#request accept an array of URLs 11 years ago
Thibaut 562a4c74fe Fix failing Docs::Requester test 11 years ago
Thibaut 706270d89c Don't store pages with no entries 11 years ago
Thibaut 9089d03211 Set the default FileScraper::base_url to localhost 11 years ago
Thibaut d964fd4ca9 Make Docs::URL#relative_path_to work with unqualified URLs 11 years ago
Thibaut 4df387d475 Make Docs::URL#subpath_to work with unqualified URLs 11 years ago
Thibaut 1204390f81 Make Docs::Scraper.root_path inheritable 11 years ago
Thibaut 18986c1814 Going open source 12 years ago