Commit Graph

36 Commits (1fd1ed9d2360cfa8f0933af486199156fc0e09b3)

Author SHA1 Message Date
Thibaut Courouble c7a10efe5b Add ParseCfEmail filter to the default stack used by all scrapers 7 years ago
Thibaut Courouble f7580a8b52 Download images by default 8 years ago
Thibaut Courouble 2efce74521 Finish OpenJDK scraper 8 years ago
Thibaut Courouble 509fb443e6 Remove leftover debug log 8 years ago
Thibaut Courouble 476c69e419 Improve MDN scrapers 8 years ago
Thibaut Courouble 8ddb812035 Pass response object to Scraper#parse method 8 years ago
Thibaut Courouble 4e41ed9f25 Add <base> support 8 years ago
Thibaut Courouble 8147f9f90a Update TensorFlow documentation (0.12) 8 years ago
Thibaut Courouble 0c8ca4e5fa Add SQLite documentation 8 years ago
Thibaut Courouble 46a9ed16f6 Refactor scrapers with multiple base URLs 9 years ago
Thibaut Courouble 64eb1c86fc Log errors instead of exiting when scraping docs 9 years ago
Thibaut Courouble b279f84a4c Update and version Meteor documentation 9 years ago
Thibaut Courouble adba5c1cac Update URL stubs 9 years ago
Thibaut Courouble 5f7005729c Update Meteor documentation (1.3.0) and add new URL stubbing mechanism 9 years ago
Thibaut Courouble 1fa82430b0 Finish Chef documentation 9 years ago
Thibaut Courouble 44e1f216c4 Update and improve PHP documentation (7.0.3) 9 years ago
Thibaut Courouble b8658d9708 Refactor FixRedirectionsBehavior 9 years ago
Thibaut c69136056e Log current URL on scraper error 10 years ago
Thibaut 018628ea7d Add two-pass redirection rewriter 10 years ago
Thibaut 9ecb1f9498 Refactor StubRootPage 10 years ago
Thibaut b29d6ca002 Move doc links to manifest 10 years ago
Thibaut cf7f446738 Change home_url to a list of links 10 years ago
Thu Trang Pham ab85da334d home_url must be applied after inner_html 10 years ago
Thu Trang Pham 642c1cff7d Make sure that home_url can be nil 10 years ago
Thu Trang Pham 42910c62ce Adding home_url to scraper 10 years ago
Thu Trang Pham 5d7ad301ea Give scrapper access to home_url 10 years ago
Thu Trang Pham 610e49119f Renamed official_url to home_url 10 years ago
Thu Trang Pham 0dc8cfd5d3 Adding Official Url for url scrapped documentations 10 years ago
Thibaut e0556365a8 Remove deprecated Kernel#quietly calls 10 years ago
Thibaut 1fa81b8461 Silence Nokogiri warnings 10 years ago
Thibaut c0be178556 Auto-require gems in the "docs" bundle 11 years ago
Thibaut b92db88506 Refactor Docs::Scraper 11 years ago
Thibaut f8298181e9 Implement initial_paths scraper option 11 years ago
Thibaut 5c4775201b Move code in scraper.rb 11 years ago
Thibaut 1204390f81 Make Docs::Scraper.root_path inheritable 11 years ago
Thibaut 18986c1814 Going open source 12 years ago