pictuga/morss
1
1
Fork 0
Code Issues Pull Requests Actions Packages Releases Activity

crawler: move UAHandler to basic

Browse Source 
Fuck u feedburner
This commit is contained in:
pictuga 2017-03-19 01:49:17 -10:00
parent 5e61686373
commit 9c331300eb
1 changed files with 1 additions and 1 deletions

2
morss/crawler.py

@ -39,9 +39,9 @@ def custom_handler(accept=None, strict=False, delay=None, encoding=None, basic=F
handlers.append(GZIPHandler())
handlers.append(HTTPEquivHandler())
handlers.append(HTTPRefreshHandler())
handlers.append(UAHandler(DEFAULT_UA))
if not basic:
handlers.append(UAHandler(DEFAULT_UA))
handlers.append(AutoRefererHandler())
handlers.append(EncodingFixHandler(encoding))