 pictuga
|
7c3091d64c
|
morss: code spacing
One of those commits that make me feel useful
|
2020-03-21 23:41:46 +01:00 |
|
pictuga
|
37b4e144a9
|
morss: small fixes
Includes dropping off ftp support
|
2020-03-21 23:30:18 +01:00 |
|
pictuga
|
bd4b7b5bb2
|
morss: convert HTML feeds to XML ones for completeness
|
2020-03-21 23:27:42 +01:00 |
|
pictuga
|
68d920d4b5
|
morss: make FeedFormat more flexible with encoding
|
2020-03-21 23:26:35 +01:00 |
|
pictuga
|
758ff404a8
|
morss: fix cgi_app silent output
*Must* return sth
|
2020-03-21 23:25:25 +01:00 |
|
pictuga
|
463530f02c
|
morss: middleware to enforce encoding
bytes are always expected
|
2020-03-21 23:23:50 +01:00 |
|
pictuga
|
ec0a28a91d
|
morss: use middleware for wsgi apps
|
2020-03-21 23:23:21 +01:00 |
|
pictuga
|
421acb439d
|
morss: make errors more readable over http
|
2020-03-21 23:08:29 +01:00 |
|
pictuga
|
42c5d09ccb
|
morss: split "options" var into "raw_options" & "options"
To make it clearer who-is-what
|
2020-03-21 23:07:07 +01:00 |
|
pictuga
|
056de12484
|
morss: add sheet.xsl to file handled by http server
|
2020-03-21 23:06:28 +01:00 |
|
pictuga
|
961a31141f
|
morss: fix url fixing
|
2020-03-21 17:28:00 +01:00 |
|
pictuga
|
d24734110a
|
morss: convert all feeds to RSS
As html feeds might not contain some feeds, leading to data loss
|
2020-03-20 12:26:34 +01:00 |
|
pictuga
|
a41c2a3a62
|
morss: fix twitter link detection
|
2020-03-20 12:26:19 +01:00 |
|
pictuga
|
dd2651061f
|
feeds & morss: clean up comments/empty lines
|
2020-03-20 12:25:48 +01:00 |
|
pictuga
|
5865af64f9
|
Fix indent output for html/xml
|
2020-03-20 12:18:13 +01:00 |
|
pictuga
|
b3b90c067a
|
morss.py: remove "useless" functions
Have to keep the code clean
|
2020-03-20 11:19:06 +01:00 |
|
pictuga
|
bda51b0fc7
|
feeds & morss: many encoding/tostring fixes
|
2020-03-19 12:53:25 +01:00 |
|
pictuga
|
d26795dce8
|
morss: from feedify to feeds
Also scrap obsolete feedify code
|
2020-03-19 10:27:44 +01:00 |
|
pictuga
|
9dbe061fd6
|
Remove markdown-related code
Time to clean up the code and stop with those non-core features
They just make the code harder to maintain
|
2020-03-18 16:47:00 +01:00 |
|
pictuga
|
e606c5eefb
|
feeds: various small cleanup/fixes
|
2018-11-18 15:14:38 +01:00 |
|
pictuga
|
3581f34db7
|
Various feeds.py related fixes
|
2018-11-11 16:46:23 +01:00 |
|
pictuga
|
679628c7fa
|
Small code clean up
|
2018-11-11 16:11:00 +01:00 |
|
pictuga
|
399e867c94
|
morss: add py2 indication
|
2018-11-11 16:07:25 +01:00 |
|
pictuga
|
221e1f85ad
|
feeds: fix implementation in morss
|
2018-11-11 15:26:09 +01:00 |
|
pictuga
|
4e144487db
|
Test for feedify support first
Otherwise might never be called if the content-type is also supported
|
2018-10-25 01:17:24 +02:00 |
|
pictuga
|
e72ca3f984
|
morss: improved output type
|
2018-09-30 22:02:29 +02:00 |
|
pictuga
|
2ccf36617a
|
morss: improve http parameter parsing
|
2018-09-30 22:01:19 +02:00 |
|
pictuga
|
2d5bf7b38b
|
Fix xml detection regex
Also (dirtily) fixes #18 for now
|
2017-11-04 14:21:05 +01:00 |
|
pictuga
|
194465544a
|
crawler: separate CacheHander and actual caching
Default cache is now just an in-memory {}
|
2017-11-04 12:41:56 +01:00 |
|
pictuga
|
2d7d0fcdca
|
morss: fix cgi in python 3
Needs explicit [] in py3
|
2017-11-04 12:27:47 +01:00 |
|
pictuga
|
f563040809
|
readabilite: threshold to detect if it contains an article
Useful for videos/images-based images
|
2017-10-28 01:30:21 +02:00 |
|
pictuga
|
64babd6713
|
morss: make readabilite links absolute
|
2017-07-29 14:37:37 +02:00 |
|
pictuga
|
d3bc2926fc
|
Remove :hungry
Mostly usless. If you need it, you might as well not need to use morss in the first place...
|
2017-03-25 13:52:58 -10:00 |
|
pictuga
|
167e3e4a15
|
feedify: accept xpath rules passed as parameters
|
2017-03-20 20:56:48 -10:00 |
|
pictuga
|
08f08ef704
|
improve morss url detection regex
|
2017-03-20 20:51:13 -10:00 |
|
pictuga
|
1b4341f741
|
accept query_string in morss cgi
|
2017-03-20 20:50:04 -10:00 |
|
pictuga
|
5e61686373
|
Only use full feed for articles & feedify
Sometimes using referrer and/or useragent makes some dumb websites return diferent content (hello feedburner)
|
2017-03-18 23:43:28 -10:00 |
|
pictuga
|
0b6e553054
|
Move iTunes code to feedify.py
|
2017-03-18 23:41:37 -10:00 |
|
pictuga
|
d4937812a8
|
Remove HTTPError code
Only used to look nice but useless (inherits from IOError anyway)
|
2017-03-18 23:39:32 -10:00 |
|
pictuga
|
67f5a21019
|
Move build_opener to crawler
Forgotten
|
2017-03-18 23:03:04 -10:00 |
|
pictuga
|
2003e2760b
|
Move custom_handler to crawler
Makes more sense. Easier to reuse. Also cleaned up a bit the code
|
2017-03-18 22:51:27 -10:00 |
|
pictuga
|
f4abc4e8a4
|
Detect encoding (using crawler) before readabilite
|
2017-03-11 02:30:57 -10:00 |
|
pictuga
|
385f9eb39a
|
morss: use crawler strict accept for feed
|
2017-03-08 19:05:48 -10:00 |
Florian Muenchbach
|
993ac638a3
|
Added override for auto-detected character encoding of parsed pages.
|
2017-03-08 18:45:20 -10:00 |
|
pictuga
|
627163abff
|
Make cache settings in morss nicer
|
2017-03-08 18:09:24 -10:00 |
|
pictuga
|
e5f8e43659
|
Shifted the <link rel='alternate'/> redirect to crawler
Now using MIMETYPE var from crawler within morss.py
|
2017-03-08 18:03:34 -10:00 |
|
pictuga
|
a8ac2ed1ca
|
Turn FeedBefore/After into ItemBefore/After
To reduce the number of loops
|
2017-02-28 23:24:32 -10:00 |
|
pictuga
|
fcc5e8a076
|
Add "Feed/Item" in functions name
To make it instantly clearer what they work on
|
2017-02-28 23:23:15 -10:00 |
|
pictuga
|
60e3311e97
|
Use readabilite properly
Not thru some weird wrapper anymore
|
2017-02-28 22:45:26 -10:00 |
|
pictuga
|
dc8423550f
|
Support xml starting with \s
|
2017-02-25 19:04:32 -10:00 |