pictuga/morss
1
1
Fork 0
Code Issues Pull Requests Actions Packages Releases Activity

Only use full feed for articles & feedify

Browse Source 
Sometimes using referrer and/or useragent makes some dumb websites return diferent content (hello feedburner)
This commit is contained in:
pictuga 2017-03-18 23:43:28 -10:00
parent 0b6e553054
commit 5e61686373
1 changed files with 1 additions and 1 deletions

2
morss/morss.py

@ -348,7 +348,7 @@ def FeedFetch(url, options):
delay = 0
try:
con = crawler.custom_handler('xml', True, delay, options.encoding).open(url, timeout=TIMEOUT * 2)
con = crawler.custom_handler('xml', True, delay, options.encoding, not feedify.supported(url)).open(url, timeout=TIMEOUT * 2) # feedify.supported(url) to use full crawler if using feedify
xml = con.read()
except (IOError, HTTPException):