Commit Graph

106 Commits (9a6448f122d02804950d61e32b270cb36d87356b)

Author SHA1 Message Date
Thibaut Courouble c7a10efe5b Add ParseCfEmail filter to the default stack used by all scrapers
7 years ago
Jed Fox 608853bd2e Convert the `decode_cloudflare_email` helper to a dedicated filter class
7 years ago
Thibaut Courouble 68b80bce36 Generate pretty JSON in docs.json manifest
7 years ago
Thibaut Courouble 0095779b3f Instrument FileScraper read errors rather than use puts
7 years ago
Thibaut Courouble 0725a69af5 Store docs' metadata in meta.json files
7 years ago
Thibaut Courouble e3ef139111 Fix path encoding issues in C/C++ scraper
7 years ago
Thibaut Courouble 472f03d5b0 Update C/C++ documentation
7 years ago
Thibaut Courouble ad9276e901 Add rate limiter
7 years ago
Thibaut Courouble 914100a657 Improve error message on failed requests
7 years ago
Thibaut Courouble 3f43c03dbc Update Angular documentation (4.3.2)
8 years ago
Thibaut Courouble 65e8236ab5 Switch to headless Chrome for capybara/selenium scraping
8 years ago
Thibaut Courouble ec3bb9169d Properly disable http pipelining
8 years ago
Thibaut Courouble f7580a8b52 Download images by default
8 years ago
Thibaut Courouble a6855329e8 Add image scraping and optimization filter
8 years ago
Thibaut Courouble 6fc48db8af Improve error logging
8 years ago
Thibaut Courouble 8ef3502cb3 Throw an error when response code == 0
8 years ago
Thibaut Courouble ee21c0bf29 Add frozen_string_literal to subscriber files"
8 years ago
Thibaut Courouble 2efce74521 Finish OpenJDK scraper
8 years ago
Thibaut Courouble 057a3a9ce9 Ensure root page is processed first for docs with multiple base urls
8 years ago
Thibaut Courouble 509fb443e6 Remove leftover debug log
8 years ago
Thibaut Courouble c1ebb7a0b9 Improve Doc#name and Doc#slug
8 years ago
Andreas Stenius b36f3f8095 core/doc: make sure name is usable as slug.
8 years ago
Thibaut Courouble 476c69e419 Improve MDN scrapers
8 years ago
Thibaut Courouble 8ddb812035 Pass response object to Scraper#parse method
8 years ago
Thibaut Courouble 4e41ed9f25 Add <base> support
8 years ago
Thibaut Courouble 6f0214eaf3 Make Docs::Parser return the entire document instead of <body>
8 years ago
Thibaut Courouble 8147f9f90a Update TensorFlow documentation (0.12)
8 years ago
Thibaut Courouble 0c8ca4e5fa Add SQLite documentation
8 years ago
Thibaut Courouble 0d4c6b51bb Update TensorFlow documentation (0.11)
8 years ago
Thibaut Courouble 721adf8e21 Don't rewrite data URIs
8 years ago
Thibaut Courouble 6fdf81e649 Update Elixir documentation (1.3.3)
8 years ago
Thibaut Courouble 46a9ed16f6 Refactor scrapers with multiple base URLs
8 years ago
Thibaut Courouble 64eb1c86fc Log errors instead of exiting when scraping docs
9 years ago
Thibaut Courouble 82d0725747 Improve ordering of entries and types
9 years ago
Thibaut Courouble b279f84a4c Update and version Meteor documentation
9 years ago
Thibaut Courouble d7726f98b1 Fix exception when trying to find a version of a doc that has no versions
9 years ago
Thibaut Courouble f6530eddcf Update Angular.js documentation (1.5.6)
9 years ago
Thibaut Courouble 5bb96f804a Require all entries to have a name, path and type
9 years ago
Thibaut Courouble 1a4bea8510 Change User-Agent to 'DevDocs'
9 years ago
nucular 034ecfae72 Replace File.basename in URL#relative_path_to because it doesn't handle special characters in URLs well
9 years ago
Thibaut Courouble 2813cf9be3 Fix internal paths with ':' characters not getting clean up properly
9 years ago
Thibaut Courouble e2b7004078 Update Laravel documentation (5.2.31, 5.1.33)
9 years ago
Thibaut Courouble 70b19c238a Sort types/categories by number when they start with a number
9 years ago
Thibaut Courouble d366e14ea7 Fix Docs::Parse#document? when document has no doctype
9 years ago
Thibaut Courouble adba5c1cac Update URL stubs
9 years ago
Thibaut Courouble 5f7005729c Update Meteor documentation (1.3.0) and add new URL stubbing mechanism
9 years ago
Thibaut Courouble fbbf9d5d09 Finish Haxe documentation
9 years ago
Thibaut Courouble 2bec61a1a7 Finish TensorFlow scraper
9 years ago
Thibaut Courouble 1fa82430b0 Finish Chef documentation
9 years ago
Thibaut Courouble 5f2d9cde50 Finish CakePHP documentation
9 years ago