Commit Graph

1036 Commits (8b26797e93226d3bca8183a678991f6399646f2b)
 

Author SHA1 Message Date
pictuga bb82902ad1 Move cache code to its own file 2021-09-21 08:04:45 +02:00
pictuga 04afa28fe7 crawler: cache pickle'd array 2021-09-21 08:04:45 +02:00
pictuga 75bb69f0fd Make mysql optdep 2021-09-21 08:04:45 +02:00
pictuga 97d9dda547 crawler: support 308 redirects 2021-09-21 08:04:45 +02:00
pictuga 0c31d9f6db ci: add spell check dict 2021-09-21 08:04:45 +02:00
pictuga 49e29208ef ci: fix spell check 2021-09-21 08:04:45 +02:00
pictuga d8d608a4de ci: fix pylint install 2021-09-21 08:04:45 +02:00
pictuga 5437e40a15 drone: use alpine image (to benefit from pkgs) 2021-09-21 08:04:45 +02:00
pictuga 6c1f8da692 ci: added pylint (triggered upon error w/ score < 8 only) 2021-09-21 08:04:45 +02:00
pictuga a1a26d8209 README: add ci badge 2021-09-21 08:04:45 +02:00
pictuga edbb580f33 ci/cd: fix isort args 2021-09-21 08:04:45 +02:00
pictuga 4fd730b983 Further isort implementation 2021-09-21 08:04:45 +02:00
pictuga 198353d6b9 ci/cd attempt 2021-09-21 08:04:45 +02:00
pictuga 0b3e6d7749 Apply isort 2021-09-21 08:04:23 +02:00
pictuga 06e0ada95b Allow POST requests 2021-09-08 20:43:21 +02:00
pictuga 71d9c7a027 README: updated ttrss link 2021-09-07 20:30:18 +02:00
pictuga 37f5a92b05 wsgi: fix apache / workload 2021-09-06 22:01:48 +02:00
pictuga 24c26d3850 wsgi: handle url decoding 2021-08-31 21:51:21 +02:00
pictuga 8f24214915 crawler: better name for custom fns 2021-08-29 00:22:40 +02:00
pictuga d5942fe5a7 feeds: fix issues when mode not explicited in ruleset 2021-08-29 00:20:29 +02:00
pictuga 6f50443995 morss: Options return None instead of False if no match
Better for default fn values
2021-08-29 00:19:09 +02:00
pictuga 5582fbef31 crawler: comment 2021-08-29 00:18:50 +02:00
pictuga da5442a1dc feedify: support any type (json, xml, html) 2021-08-29 00:17:28 +02:00
pictuga f9d7794bcc feedifi.ini: json time zone handling 2021-04-23 20:43:00 +02:00
pictuga e37c8346d0 feeds: add fallback for time parser 2021-04-22 21:57:16 +02:00
pictuga 3a1d564992 feeds: fix time zone handling 2021-04-22 21:51:00 +02:00
pictuga 6880a443e0 crawler: improve CacheHandler code 2021-03-25 23:54:08 +01:00
pictuga 7342ab26d2 crawler: comment on how urllib works 2021-03-25 23:49:58 +01:00
pictuga 981da9e66a crawler: SQLITE_PATH point to .db file instead of folder 2021-03-25 23:48:21 +01:00
pictuga 6ea9d012a2 readme: fix newsreader hook 2021-01-23 21:40:46 +01:00
pictuga 95d6143636 docker: log to stdout 2021-01-15 23:31:27 +01:00
pictuga 03cad120d0 README: comment on http timeout 2021-01-14 22:34:57 +01:00
pictuga 01a7667032 Fix error due to remaining log force code 2021-01-14 00:51:47 +01:00
pictuga 3e886caaab crawler: drop encoding setting 2020-10-30 22:41:16 +01:00
pictuga ad927e03a7 crawler: use regex instead of lxml
Less reliable but should be faster
2020-10-30 22:21:19 +01:00
pictuga 0efb096fa7 crawler: shift gzip & encoding-fix to intermediary handler 2020-10-30 22:16:51 +01:00
pictuga 9ab2e488ef crawler: add intermediary handlers 2020-10-30 22:15:35 +01:00
pictuga b525ab0d26 crawler: fix typo 2020-10-30 22:12:43 +01:00
pictuga fb19b1241f sheet.xsl: update to :format 2020-10-11 22:49:33 +02:00
pictuga 9d062ef24b README: indicate time unit for env vars 2020-10-03 22:22:20 +02:00
pictuga 447f62dc45 README: indicate to use build --no-cache --pull by default 2020-10-03 22:18:51 +02:00
pictuga 18ec10fe44 Use hopefully more-up-to-date pip gunicorn 2020-10-03 21:59:43 +02:00
pictuga 891c385b69 Dockerfile: no cache for pip to save space 2020-10-03 21:59:17 +02:00
pictuga 0629bb98fb dockerfile: add python wheel 2020-10-03 21:16:04 +02:00
pictuga ae7ba458ce README fixes 2020-10-03 20:56:40 +02:00
pictuga bd0bca69fc crawler: ignore ssl via env var 2020-10-03 19:57:08 +02:00
pictuga 8abd951d40 More sensible default values for cache autotrim (1k entries, 1min) 2020-10-03 19:55:57 +02:00
pictuga 2514fabd38 Replace memory-leak-prone Uniq with @uniq_wrapper 2020-10-03 19:43:55 +02:00
pictuga 8cb7002fe6 feeds: make it possible to append empty items
And return the newly appended items, to make it easy to edit them
2020-10-03 16:56:07 +02:00
pictuga 6966e03bef Clean up itemClass code
To avoid globals()
2020-10-03 16:25:29 +02:00