Commit Graph

910 Commits (51eb1c53af42f9e4326b6ab590c77aaa3329ccdc)
 

Author SHA1 Message Date
pictuga 6880a443e0 crawler: improve CacheHandler code 2021-03-25 23:54:08 +01:00
pictuga 7342ab26d2 crawler: comment on how urllib works 2021-03-25 23:49:58 +01:00
pictuga 981da9e66a crawler: SQLITE_PATH point to .db file instead of folder 2021-03-25 23:48:21 +01:00
pictuga 6ea9d012a2 readme: fix newsreader hook 2021-01-23 21:40:46 +01:00
pictuga 95d6143636 docker: log to stdout 2021-01-15 23:31:27 +01:00
pictuga 03cad120d0 README: comment on http timeout 2021-01-14 22:34:57 +01:00
pictuga 01a7667032 Fix error due to remaining log force code 2021-01-14 00:51:47 +01:00
pictuga 3e886caaab crawler: drop encoding setting 2020-10-30 22:41:16 +01:00
pictuga ad927e03a7 crawler: use regex instead of lxml
Less reliable but should be faster
2020-10-30 22:21:19 +01:00
pictuga 0efb096fa7 crawler: shift gzip & encoding-fix to intermediary handler 2020-10-30 22:16:51 +01:00
pictuga 9ab2e488ef crawler: add intermediary handlers 2020-10-30 22:15:35 +01:00
pictuga b525ab0d26 crawler: fix typo 2020-10-30 22:12:43 +01:00
pictuga fb19b1241f sheet.xsl: update to :format 2020-10-11 22:49:33 +02:00
pictuga 9d062ef24b README: indicate time unit for env vars 2020-10-03 22:22:20 +02:00
pictuga 447f62dc45 README: indicate to use build --no-cache --pull by default 2020-10-03 22:18:51 +02:00
pictuga 18ec10fe44 Use hopefully more-up-to-date pip gunicorn 2020-10-03 21:59:43 +02:00
pictuga 891c385b69 Dockerfile: no cache for pip to save space 2020-10-03 21:59:17 +02:00
pictuga 0629bb98fb dockerfile: add python wheel 2020-10-03 21:16:04 +02:00
pictuga ae7ba458ce README fixes 2020-10-03 20:56:40 +02:00
pictuga bd0bca69fc crawler: ignore ssl via env var 2020-10-03 19:57:08 +02:00
pictuga 8abd951d40 More sensible default values for cache autotrim (1k entries, 1min) 2020-10-03 19:55:57 +02:00
pictuga 2514fabd38 Replace memory-leak-prone Uniq with @uniq_wrapper 2020-10-03 19:43:55 +02:00
pictuga 8cb7002fe6 feeds: make it possible to append empty items
And return the newly appended items, to make it easy to edit them
2020-10-03 16:56:07 +02:00
pictuga 6966e03bef Clean up itemClass code
To avoid globals()
2020-10-03 16:25:29 +02:00
pictuga 03a122c41f Dockerfile: add --no-cache to save some space 2020-10-01 22:33:29 +02:00
pictuga 5cd6c22d73 Reorganise the README file 2020-10-01 22:25:53 +02:00
pictuga e1b41b5f64 Typo in README 2020-10-01 00:18:48 +02:00
pictuga 9ce6acba20 Fix gunicorn related typo 2020-10-01 00:07:41 +02:00
pictuga 6192ff4081 gunicorn with --preload
To only load the code once (and start autotrim once)
2020-10-01 00:05:39 +02:00
pictuga 056a1b143f crawler: autotrim: make ctrl+c working 2020-10-01 00:04:36 +02:00
pictuga eed949736a crawler: add ability to limit cache size 2020-09-30 23:59:55 +02:00
pictuga 2fc7cd391c Shift __main__'s wsgi code where it belongs 2020-09-30 23:24:51 +02:00
pictuga d9f46b23a6 crawler: default value for MYSQL_HOST (localhost) 2020-09-30 13:17:02 +02:00
pictuga bbada0436a Quick guide to ignore SSL certs 2020-09-27 16:48:22 +02:00
pictuga 039a672f4e wsgi: clean up url reconstruction 2020-09-27 16:28:26 +02:00
pictuga b290568e14 README: decent line length
Obtained from the output of:
python -m morss --help | cat
2020-09-15 23:01:42 +02:00
pictuga 9ecf856f10 Add :resolve to remove (some?) tracking links 2020-09-15 22:57:52 +02:00
pictuga 504ede624d Logo CC BY-NC-SA 4.0 2020-09-03 13:17:58 +02:00
pictuga 0d89f0e6f2 Add a logo
B&W edition of the logo at https://morss.it/
2020-08-28 21:28:07 +02:00
pictuga 56e0c2391d Missing import for served files 2020-08-28 20:53:03 +02:00
pictuga 679f406a12 Default mimetype for served files 2020-08-28 20:52:43 +02:00
pictuga f6d641eeef Serve any file in www/
Also fixes #41
2020-08-28 20:45:39 +02:00
pictuga 2456dd9bbc Fix broken pieces
Including #43
2020-08-28 19:38:48 +02:00
pictuga 0f33db248a Add license info in each file 2020-08-26 20:08:22 +02:00
pictuga d57f543c7b README: remove todo 2020-08-24 21:17:31 +02:00
pictuga fba112147c README: make it clear that the internal server is _very_ basic 2020-08-24 21:14:48 +02:00
pictuga 8697c3f0df Remove remaining --debug from README 2020-08-24 19:39:27 +02:00
pictuga 75935114e4 Remove leftover code 2020-08-23 19:07:12 +02:00
pictuga 5bd2557619 Fix typo in provided .htaccess 2020-08-23 19:01:34 +02:00
pictuga 598a2591f1 Dockerfile: remove confusing one-liner code 2020-08-23 18:59:16 +02:00