Simon Legner
961bbeb92b
fix: replace calls to `Dir.exists?` with `Dir.exist?`
2 years ago
Simon Legner
965be77c03
Image scraping: evaluate Content-Length header
2 years ago
Simon Legner
d5147162fe
docs:page: report entries
...
```
> thor docs:page vue /guide/introduction.html --debug
Entries: (1 KB, +1 KB)
Updated: 0
Created: 1
+ 1. Introduction (Getting Started)
Deleted: 0
Types:
Updated: 0
Created: 1
+ Guide
Deleted: 0
Files: (0.1 MB, +0.1 MB)
Updated: 0
Created: 1
+ guide/introduction
Deleted: 0
Done
```
3 years ago
Simon Legner
200e39ce90
outdated_state: omit 0. and 1. versions
3 years ago
Simon Legner
bf248f0dff
Update Vuex documentation (3.6.2 and 4.0.0-rc.2)
4 years ago
Simon Legner
cb6865b0a8
thor updates:check group major/minor updates
4 years ago
Phil Scherer
5780aeef6f
Add support for retrieving tags from GitLab repos
...
Implement and document a new utility method for getting tags from
projects hosted on GitLab. This method supports GitLab.com as well as
projects hosted on independent servers.
4 years ago
Simon Legner
c10516cc62
doc.is_outdated: split on [-.], add unit tests
4 years ago
Simon Legner
c25fbb4b3c
doc.fetch: read GITHUB_TOKEN also from ENV
5 years ago
Jasper van Merle
c88ae2c1e1
reactivex: implement get_latest_version
6 years ago
Jasper van Merle
6e917001ce
Fix merge conflicts
6 years ago
Jasper van Merle
8325ed78ef
Fix OpenJDK scraper
6 years ago
Jasper van Merle
7084d9f082
Improve get_latest_github_release
6 years ago
Jasper van Merle
3cb97f71b3
fetching -> connecting to
6 years ago
Jasper van Merle
11eeadbc0a
Better error handling and added a 15s timeout on HTTP requests
6 years ago
Jasper van Merle
41e0a138a6
Refactoring and cleaning up
6 years ago
Jasper van Merle
cd43632a2c
Check for updates based on modified date for scrapers without release
6 years ago
Jasper van Merle
3dc17a9b29
Finish get_latest_version for 81 scrapers and add uploading functionality
6 years ago
Jasper van Merle
2d1e8aa00c
Add better logging and get_latest_version implementations for 10 scrapers
6 years ago
Jasper van Merle
d0300dd585
Create command to check for updates
6 years ago
Thibaut Courouble
2eb865442c
Bump Ruby 2.6.0
6 years ago
Thibaut Courouble
bf003669ba
Simplify file scraper setup; scrape files in the "docs/[slug]" directory
6 years ago
Thibaut Courouble
9e37ff5c8a
Add instrumentation for slow response processing
6 years ago
Thibaut Courouble
c7a10efe5b
Add ParseCfEmail filter to the default stack used by all scrapers
7 years ago
Jed Fox
608853bd2e
Convert the `decode_cloudflare_email` helper to a dedicated filter class
7 years ago
Thibaut Courouble
68b80bce36
Generate pretty JSON in docs.json manifest
...
To make it easier to track changes in Git.
7 years ago
Thibaut Courouble
0095779b3f
Instrument FileScraper read errors rather than use puts
7 years ago
Thibaut Courouble
0725a69af5
Store docs' metadata in meta.json files
...
To avoid relying on the filesystem for modified times.
7 years ago
Thibaut Courouble
e3ef139111
Fix path encoding issues in C/C++ scraper
...
Fixes #767 .
7 years ago
Thibaut Courouble
472f03d5b0
Update C/C++ documentation
...
Fixes #688 .
Fixes #736 .
7 years ago
Thibaut Courouble
ad9276e901
Add rate limiter
7 years ago
Thibaut Courouble
914100a657
Improve error message on failed requests
7 years ago
Thibaut Courouble
3f43c03dbc
Update Angular documentation (4.3.2)
8 years ago
Thibaut Courouble
65e8236ab5
Switch to headless Chrome for capybara/selenium scraping
8 years ago
Thibaut Courouble
ec3bb9169d
Properly disable http pipelining
...
It's causing memory corruption issues along with image optimization.
Rel: #633
8 years ago
Thibaut Courouble
f7580a8b52
Download images by default
...
Rel: #633
8 years ago
Thibaut Courouble
a6855329e8
Add image scraping and optimization filter
...
Rel: #633
8 years ago
Thibaut Courouble
6fc48db8af
Improve error logging
8 years ago
Thibaut Courouble
8ef3502cb3
Throw an error when response code == 0
8 years ago
Thibaut Courouble
ee21c0bf29
Add frozen_string_literal to subscriber files"
8 years ago
Thibaut Courouble
2efce74521
Finish OpenJDK scraper
8 years ago
Thibaut Courouble
057a3a9ce9
Ensure root page is processed first for docs with multiple base urls
8 years ago
Thibaut Courouble
509fb443e6
Remove leftover debug log
8 years ago
Thibaut Courouble
c1ebb7a0b9
Improve Doc#name and Doc#slug
8 years ago
Andreas Stenius
b36f3f8095
core/doc: make sure name is usable as slug.
8 years ago
Thibaut Courouble
476c69e419
Improve MDN scrapers
...
Closes #488 .
Closes #572 .
8 years ago
Thibaut Courouble
8ddb812035
Pass response object to Scraper#parse method
8 years ago
Thibaut Courouble
4e41ed9f25
Add <base> support
8 years ago
Thibaut Courouble
6f0214eaf3
Make Docs::Parser return the entire document instead of <body>
8 years ago
Thibaut Courouble
8147f9f90a
Update TensorFlow documentation (0.12)
8 years ago