Commit Graph

40 Commits (cd43632a2c44a1ac49d696a5267227b9b76503e1)

Author SHA1 Message Date
Jasper van Merle cd43632a2c Check for updates based on modified date for scrapers without release
6 years ago
Jasper van Merle 3dc17a9b29 Finish get_latest_version for 81 scrapers and add uploading functionality
6 years ago
Jasper van Merle 2d1e8aa00c Add better logging and get_latest_version implementations for 10 scrapers
6 years ago
Jasper van Merle d0300dd585 Create command to check for updates
6 years ago
Thibaut Courouble c7a10efe5b Add ParseCfEmail filter to the default stack used by all scrapers
7 years ago
Thibaut Courouble f7580a8b52 Download images by default
8 years ago
Thibaut Courouble 2efce74521 Finish OpenJDK scraper
8 years ago
Thibaut Courouble 509fb443e6 Remove leftover debug log
8 years ago
Thibaut Courouble 476c69e419 Improve MDN scrapers
8 years ago
Thibaut Courouble 8ddb812035 Pass response object to Scraper#parse method
8 years ago
Thibaut Courouble 4e41ed9f25 Add <base> support
8 years ago
Thibaut Courouble 8147f9f90a Update TensorFlow documentation (0.12)
8 years ago
Thibaut Courouble 0c8ca4e5fa Add SQLite documentation
8 years ago
Thibaut Courouble 46a9ed16f6 Refactor scrapers with multiple base URLs
8 years ago
Thibaut Courouble 64eb1c86fc Log errors instead of exiting when scraping docs
9 years ago
Thibaut Courouble b279f84a4c Update and version Meteor documentation
9 years ago
Thibaut Courouble adba5c1cac Update URL stubs
9 years ago
Thibaut Courouble 5f7005729c Update Meteor documentation (1.3.0) and add new URL stubbing mechanism
9 years ago
Thibaut Courouble 1fa82430b0 Finish Chef documentation
9 years ago
Thibaut Courouble 44e1f216c4 Update and improve PHP documentation (7.0.3)
9 years ago
Thibaut Courouble b8658d9708 Refactor FixRedirectionsBehavior
9 years ago
Thibaut c69136056e Log current URL on scraper error
10 years ago
Thibaut 018628ea7d Add two-pass redirection rewriter
10 years ago
Thibaut 9ecb1f9498 Refactor StubRootPage
10 years ago
Thibaut b29d6ca002 Move doc links to manifest
10 years ago
Thibaut cf7f446738 Change home_url to a list of links
10 years ago
Thu Trang Pham ab85da334d home_url must be applied after inner_html
10 years ago
Thu Trang Pham 642c1cff7d Make sure that home_url can be nil
10 years ago
Thu Trang Pham 42910c62ce Adding home_url to scraper
10 years ago
Thu Trang Pham 5d7ad301ea Give scrapper access to home_url
10 years ago
Thu Trang Pham 610e49119f Renamed official_url to home_url
10 years ago
Thu Trang Pham 0dc8cfd5d3 Adding Official Url for url scrapped documentations
10 years ago
Thibaut e0556365a8 Remove deprecated Kernel#quietly calls
10 years ago
Thibaut 1fa81b8461 Silence Nokogiri warnings
10 years ago
Thibaut c0be178556 Auto-require gems in the "docs" bundle
11 years ago
Thibaut b92db88506 Refactor Docs::Scraper
11 years ago
Thibaut f8298181e9 Implement initial_paths scraper option
11 years ago
Thibaut 5c4775201b Move code in scraper.rb
11 years ago
Thibaut 1204390f81 Make Docs::Scraper.root_path inheritable
11 years ago
Thibaut 18986c1814 Going open source
11 years ago