Commit Graph

87 Commits (main)

Author SHA1 Message Date
Simon Legner ce09955658 Update manifest_test for Ruby 3.4.1
2 weeks ago
Simon Legner 9967bef8db Fix manifest_test.rb
2 months ago
Dave Powers ed116eb795 Update and fix manifest test
3 months ago
Nicholas La Roux 02467b5ac2
Upgrade minitest from 5.18.1 to 5.20.0
1 year ago
Simon Legner 47707f31fc Merge branch 'origin/main' into ruby_3.1.2
2 years ago
Simon Legner ce248cebd0 Fix manifest db_size
2 years ago
Simon Legner 5a8f952568 manifest: fix attribution
2 years ago
Simon Legner eac7f96cdb /about: Obtain credits from docs metadata
2 years ago
Paul Sernatinger 2da05d74db Specs all passing
2 years ago
Simon Legner 965be77c03 Image scraping: evaluate Content-Length header
2 years ago
Simon Legner 200e39ce90 outdated_state: omit 0. and 1. versions
3 years ago
Simon Legner cb6865b0a8 thor updates:check group major/minor updates
4 years ago
Simon Legner fbfa9de39c parse_cf_email.rb: fix URI.unescape is obsolete
4 years ago
Simon Legner c10516cc62 doc.is_outdated: split on [-.], add unit tests
4 years ago
Jasper van Merle b31dc9d0c2 Fix tests
6 years ago
Thibaut Courouble bf003669ba Simplify file scraper setup; scrape files in the "docs/[slug]" directory
6 years ago
Thibaut Courouble 68b80bce36 Generate pretty JSON in docs.json manifest
7 years ago
Thibaut Courouble 0725a69af5 Store docs' metadata in meta.json files
7 years ago
Thibaut Courouble dd8c80060a Fix :follow_links option not doing anything when set to false
8 years ago
Thibaut Courouble 6fc48db8af Improve error logging
8 years ago
Thibaut Courouble ed5a5cadd9 Fix handling of invalid iframe URLs
8 years ago
Thibaut Courouble c1ebb7a0b9 Improve Doc#name and Doc#slug
8 years ago
Andreas Stenius b36f3f8095 core/doc: make sure name is usable as slug.
8 years ago
Thibaut Courouble 94470251fe Bump Ruby 2.4.0
8 years ago
Thibaut Courouble 4e41ed9f25 Add <base> support
8 years ago
Thibaut Courouble 6f0214eaf3 Make Docs::Parser return the entire document instead of <body>
8 years ago
Thibaut Courouble 0c8ca4e5fa Add SQLite documentation
8 years ago
Thibaut Courouble 721adf8e21 Don't rewrite data URIs
8 years ago
Thibaut Courouble 82d0725747 Improve ordering of entries and types
9 years ago
Thibaut Courouble 5bb96f804a Require all entries to have a name, path and type
9 years ago
nucular 034ecfae72 Replace File.basename in URL#relative_path_to because it doesn't handle special characters in URLs well
9 years ago
Thibaut Courouble 9e1b9ca2a9 Improve MDN/JavaScript scraper
9 years ago
Thibaut Courouble 70b19c238a Sort types/categories by number when they start with a number
9 years ago
Thibaut Courouble d366e14ea7 Fix Docs::Parse#document? when document has no doctype
9 years ago
Thibaut Courouble 6c9fc464c2 Add :fix_urls_before_parse option for Angular doc
9 years ago
Thibaut Courouble 63c77322d3 Handle unencoded spaces in link hrefs
9 years ago
Thibaut Courouble c3b9502657 Set version attributes before evaluating block
9 years ago
Thibaut Courouble 3df9cfff98 Add support for blank and non-number version names
9 years ago
Thibaut Courouble 16ddcb100c Simplify version path separator
9 years ago
Thibaut Courouble b67a02ed35 Add version to doc manifest
9 years ago
Thibaut Courouble b2d2066d96 Multi-version support
9 years ago
Thibaut Courouble bd6e27eca2 Optionally include 'release' and 'links' in docs manifest
9 years ago
Thibaut Courouble a639aedcd9 Remove index_path and db_path from docs manifest
9 years ago
Thibaut Courouble e1c0218230 Rename version -> release
9 years ago
Thibaut 3eb5ccb7ea Raise error and stop scraping on 4xx/5xx status code
9 years ago
Thibaut 6939865137 Finish Dojo scraper
9 years ago
ShaneQful 3465933543 Added dojo to devdocs & ability to define headers in scraper requests
9 years ago
Thibaut 7de19cf800 Make EntryIndex a unique index (don't add the same entry twice)
10 years ago
Thibaut 018628ea7d Add two-pass redirection rewriter
10 years ago
Thibaut b29d6ca002 Move doc links to manifest
10 years ago