update github scraper

tweak github scraper to work again after GitHub UI update which gives back JSON data
pull/2015/head
ClasherKasten 2 years ago
parent f8161058c7
commit 8034fd960d

@ -4,5 +4,20 @@ module Docs
self.type = 'github'
html_filters.push 'github/clean_html'
def process_response?(response)
if super(response)
return true
end
JSON.parse(response.body)
true
rescue JSON::ParserError, TypeError => e
false
end
def parse(response)
parsed = JSON.parse(response.response_body)
[parsed['payload']['blob']['richText'], parsed['title']]
end
end
end

Loading…
Cancel
Save