 pictuga
|
ea2ebedfcb
|
Added systemd service file
Fixing #94
|
3 months ago |
|
pictuga
|
438c32a312
|
Remove sqlite & mysql cache backends
Obsoleted since the introduction of diskcache & redis
|
3 months ago |
|
pictuga
|
8b26797e93
|
README: add recommended install way
Part of discussions on #94
|
3 months ago |
|
pictuga
|
e1ed33f320
|
crawler: improve html iter code
Ignores tags without attributes. Avoids bug with unclosed tags.
|
1 year ago |
|
pictuga
|
b65272daab
|
crawler: accept more meta redirects
|
1 year ago |
|
pictuga
|
4d64afe9cb
|
crawler: fix regression from d6b90448f3
|
1 year ago |
|
pictuga
|
d3b623482d
|
pytest: crawler
|
1 year ago |
|
pictuga
|
32645548c2
|
pytest: first batch with test_feeds
And multiple related fixes
|
1 year ago |
|
pictuga
|
d6b90448f3
|
crawler: improve handling of non-ascii urls
|
1 year ago |
|
pictuga
|
da81edc651
|
log to stderr
|
1 year ago |
|
pictuga
|
4f2895f931
|
cli: update `--help`
|
1 year ago |
|
pictuga
|
b2b04691d6
|
Ability to pass custom data_files location
|
1 year ago |
|
pictuga
|
bfaf7b0fac
|
feeds: clean up default `item_link`
To be supported by feeds' `_rule_parse`
|
1 year ago |
|
pictuga
|
32d9bc9d9d
|
feeds: proceed with conversion when rules do not match
|
1 year ago |
|
pictuga
|
b138f11771
|
util: support more `data_files` location
|
1 year ago |
|
pictuga
|
a01258700d
|
More ordering options
|
1 year ago |
|
pictuga
|
4d6d3c9239
|
wsgi: limit supported mimetypes & return actual mimetype
|
1 year ago |
|
pictuga
|
e81f6b173f
|
readabilite: remove code duplicate
|
1 year ago |
|
pictuga
|
fe5dbf1ce0
|
wsgi: reuse mimetype table from crawler
|
1 year ago |
|
pictuga
|
fdf9acd32b
|
helper: fix reload code
|
1 year ago |
|
pictuga
|
d05706e056
|
crawler: fix typo
|
1 year ago |
|
pictuga
|
e88a823ada
|
feeds: better handle rulesets without a 'mode' specified
|
1 year ago |
|
pictuga
|
750850c162
|
crawler: avoid too many .append()
|
1 year ago |
|
pictuga
|
c8669002e4
|
feeds: exotic xpath in html as well
|
1 year ago |
|
pictuga
|
c524e54d2d
|
feeds: support some exotic xpath rules returning a single string
|
1 year ago |
|
pictuga
|
ef14567d87
|
Handle `morss-helper` with `setup.py`
|
1 year ago |
|
pictuga
|
fb643f5ef1
|
readabilite: remove unneeded reference to `features` (overriden by `builder`)
|
1 year ago |
|
pictuga
|
dbdca910d8
|
readabilite: fix new parser code & drop PIs
|
1 year ago |
|
pictuga
|
9eb19fac04
|
readabilite: use custom html parser within bs4's lxml parser
Solves the following obscure error:
ValueError: Invalid PI name 'b'xml''
|
1 year ago |
|
pictuga
|
d424e394d1
|
readabilite: use lxml bs4 parser for speed
|
1 year ago |
|
pictuga
|
3f92787b38
|
readabilite: limit html comments related issues
|
1 year ago |
|
pictuga
|
afc31eb6e9
|
readabilite: avoid double parsing of html
|
1 year ago |
|
pictuga
|
87d2fe772d
|
wsgi: fix py2 compatibility
|
1 year ago |
|
pictuga
|
917aa0fbc5
|
crawler: do not re-save cached response
Otherwise cache never gets invalidated!
|
1 year ago |
|
pictuga
|
3e2b81286f
|
xsl: add link to favicon
To limit error output when failing to fetch favicon.ico
|
1 year ago |
|
pictuga
|
15430a2b83
|
helper: restore run if no param passed
|
1 year ago |
|
pictuga
|
ecdb74812d
|
Make helper & main.py executable
|
1 year ago |
|
pictuga
|
2c7844942c
|
drone: re order deploy commands
|
1 year ago |
|
pictuga
|
e12cb4567a
|
helper: more debug options
|
1 year ago |
|
pictuga
|
b74365b121
|
Make helper more posix compliant
|
1 year ago |
|
pictuga
|
2020543469
|
Make morss-helper executable
|
1 year ago |
|
pictuga
|
676be4a4fe
|
helper: work around for systems only having py3 binary
|
1 year ago |
|
pictuga
|
8870400a6e
|
Clean up morss-helper
|
1 year ago |
|
pictuga
|
8e9cc541b0
|
Turns out exec array is not supported in HEALTHCHECK
|
1 year ago |
|
pictuga
|
2a7a1b83ec
|
Use alpine:edge to have up-to-date py packages
|
1 year ago |
|
pictuga
|
106f59afa1
|
docker: shift HEALTHCHECK to helper
|
1 year ago |
|
pictuga
|
ee514e2da3
|
helper: remove unneeded sudo
|
1 year ago |
|
pictuga
|
e7578e859a
|
Clean up install/exec
|
1 year ago |
|
pictuga
|
3bcb8db974
|
Improve cloud-init (append & env var)
|
1 year ago |
|
pictuga
|
7751792942
|
Shift htaccess to README
|
1 year ago |
