Commit Graph

978 Commits (7885ab48dfc04311110997a53bc0a8542333c5e8)
 

Author SHA1 Message Date
pictuga 5422d4e14c Move away from gevent
continuous-integration/drone/push Build is failing Details
Might not be that reliable
2021-11-25 21:21:59 +01:00
pictuga 1837eda25f heroku: add WORKERS to env vars
continuous-integration/drone/push Build is failing Details
2021-11-24 21:40:46 +01:00
pictuga 321763710d heroku: make env var customizable 2021-11-24 21:40:34 +01:00
pictuga e79c426c6e Add ability to change workers count for gunicorn 2021-11-24 21:36:28 +01:00
pictuga 92a28be0b0 drone: add gevent dep
continuous-integration/drone/push Build is passing Details
2021-11-24 21:25:29 +01:00
pictuga 70db524664 docker: allow sh run
continuous-integration/drone/push Build is failing Details
2021-11-24 21:23:16 +01:00
pictuga d8cc07223e readabilite: fix bug when nothing above threshold
continuous-integration/drone/push Build is failing Details
2021-11-23 20:53:00 +01:00
pictuga 37e08f8b4c Include gunicorn and gevent in [full]
continuous-integration/drone/push Build is failing Details
2021-11-23 20:32:22 +01:00
pictuga 8f576adb64 Add gevents deps
continuous-integration/drone/push Build is passing Details
2021-11-23 20:22:47 +01:00
pictuga 528b3448e4 Get gevents from pkgs (long to build)
continuous-integration/drone/push Build is passing Details
2021-11-23 20:14:22 +01:00
pictuga f627f1b12b cloud-init: rename py3 packages for ubuntu 2021-11-23 20:13:40 +01:00
pictuga 53fd97651e Fix [full] install instructions 2021-11-23 20:09:52 +01:00
pictuga 4dd77b4bcc Add gevent to for deployment to get the latest one
continuous-integration/drone/push Build is passing Details
2021-11-23 20:07:56 +01:00
pictuga deffeebd85 gunicorn: use more aggressive multi-threading settings
continuous-integration/drone/push Build is passing Details
2021-11-23 20:00:10 +01:00
pictuga 765e0ba728 Pass py error msg in http headers
continuous-integration/drone/push Build is passing Details
2021-11-22 23:22:13 +01:00
pictuga 12073ac7d8 Simplify cloud-init code
continuous-integration/drone/push Build is passing Details
2021-11-22 21:53:18 +01:00
pictuga 6d049935e3 More cloud instructions
continuous-integration/drone/push Build is passing Details
2021-11-21 22:38:26 +01:00
pictuga 7b64c963c4 README: nicer links 2021-11-21 22:37:25 +01:00
pictuga 6900b9053c Heroku click to deploy
continuous-integration/drone/push Build is passing Details
incl. workaround for their weird use of entrypoint
2021-11-21 21:57:06 +01:00
pictuga 6ec3fb47d1 readabilite: .strip() first to save time
continuous-integration/drone/push Build is passing Details
2021-11-15 21:54:07 +01:00
pictuga 1083f3ffbc crawler: make sure to use HTTPMessage
continuous-integration/drone/push Build is passing Details
2021-11-11 10:21:48 +01:00
pictuga 7eeb1d696c crawler: clean up code
continuous-integration/drone/push Build is passing Details
2021-11-10 23:25:03 +01:00
pictuga e42df98f83 crawler: fix regression brought with 44a6b2591
continuous-integration/drone/push Build is passing Details
2021-11-10 23:08:31 +01:00
pictuga cb21871c35 crawler: clean up caching code
continuous-integration/drone/push Build is passing Details
2021-11-08 22:02:23 +01:00
pictuga c71cf5d5ce caching: fix diskcache implementation 2021-11-08 21:57:43 +01:00
pictuga 44a6b2591d crawler: cleaner http header object import 2021-11-07 19:44:36 +01:00
pictuga a890536601 morss: comment code a bit 2021-11-07 18:26:07 +01:00
pictuga 8de309f2d4 caching: add diskcache backend 2021-11-07 18:15:20 +01:00
pictuga cbf7b3f77b caching: simplify sqlite code 2021-11-07 18:14:18 +01:00
pictuga 1ff7e4103c Docker: make it possible to use it as cli
continuous-integration/drone/push Build is passing Details
2021-10-31 17:15:08 +01:00
pictuga 3f12258e98 Docker: default to non-root exec
continuous-integration/drone/push Build is passing Details
2021-10-19 22:20:44 +02:00
pictuga d023ec8d73 Change default port to 8000 2021-10-19 22:19:59 +02:00
pictuga 5473b77416 Post-clean up isort
continuous-integration/drone/push Build is passing Details
2021-09-21 08:11:04 +02:00
pictuga 0365232a73 readabilite: custom xpath for article detection
continuous-integration/drone/push Build is failing Details
2021-09-21 08:04:45 +02:00
pictuga a523518ae8 cache: avoid name collision 2021-09-21 08:04:45 +02:00
pictuga 52c48b899f readability: better var names 2021-09-21 08:04:45 +02:00
pictuga 9649cabb1b morss: do not crash on empty pages 2021-09-21 08:04:45 +02:00
pictuga 0c29102788 drone: full module install 2021-09-21 08:04:45 +02:00
pictuga 10535a17c5 cache: fix isort 2021-09-21 08:04:45 +02:00
pictuga 7d86972e58 Add Redis cache backend 2021-09-21 08:04:45 +02:00
pictuga 62e04549ac Optdeps in REAMDE and Dockerfile 2021-09-21 08:04:45 +02:00
pictuga 5da7121a77 Fix Options class behaviour 2021-09-21 08:04:45 +02:00
pictuga bb82902ad1 Move cache code to its own file 2021-09-21 08:04:45 +02:00
pictuga 04afa28fe7 crawler: cache pickle'd array 2021-09-21 08:04:45 +02:00
pictuga 75bb69f0fd Make mysql optdep 2021-09-21 08:04:45 +02:00
pictuga 97d9dda547 crawler: support 308 redirects 2021-09-21 08:04:45 +02:00
pictuga 0c31d9f6db ci: add spell check dict 2021-09-21 08:04:45 +02:00
pictuga 49e29208ef ci: fix spell check 2021-09-21 08:04:45 +02:00
pictuga d8d608a4de ci: fix pylint install 2021-09-21 08:04:45 +02:00
pictuga 5437e40a15 drone: use alpine image (to benefit from pkgs) 2021-09-21 08:04:45 +02:00