 pictuga
|
e6811138fd
|
morss: use redirected url in :getpage
Still have to find how to do the same thing with feeds...
|
2020-04-04 20:04:57 +02:00 |
|
pictuga
|
35b702fffd
|
morss: default values for feed creation
|
2020-04-04 19:39:32 +02:00 |
|
pictuga
|
4a88886767
|
morss: get_page to act as a basic proxy (for iframes)
|
2020-04-04 16:37:15 +02:00 |
|
pictuga
|
1653394cf7
|
morss: cgi_dispatcher to be able to create extra functions
|
2020-04-04 16:35:16 +02:00 |
|
pictuga
|
a8a90cf414
|
morss: move url/options parsing to own function
For future re-use
|
2020-04-04 16:33:52 +02:00 |
|
pictuga
|
bdbaf0f8a7
|
morss/cgi: fix handling of special chars in url
|
2020-04-04 16:21:37 +02:00 |
|
pictuga
|
d0e447a2a6
|
ItemFix: clean up Pocket links
|
2020-04-04 16:20:39 +02:00 |
|
pictuga
|
7c3091d64c
|
morss: code spacing
One of those commits that make me feel useful
|
2020-03-21 23:41:46 +01:00 |
|
pictuga
|
37b4e144a9
|
morss: small fixes
Includes dropping off ftp support
|
2020-03-21 23:30:18 +01:00 |
|
pictuga
|
bd4b7b5bb2
|
morss: convert HTML feeds to XML ones for completeness
|
2020-03-21 23:27:42 +01:00 |
|
pictuga
|
68d920d4b5
|
morss: make FeedFormat more flexible with encoding
|
2020-03-21 23:26:35 +01:00 |
|
pictuga
|
758ff404a8
|
morss: fix cgi_app silent output
*Must* return sth
|
2020-03-21 23:25:25 +01:00 |
|
pictuga
|
463530f02c
|
morss: middleware to enforce encoding
bytes are always expected
|
2020-03-21 23:23:50 +01:00 |
|
pictuga
|
ec0a28a91d
|
morss: use middleware for wsgi apps
|
2020-03-21 23:23:21 +01:00 |
|
pictuga
|
421acb439d
|
morss: make errors more readable over http
|
2020-03-21 23:08:29 +01:00 |
|
pictuga
|
42c5d09ccb
|
morss: split "options" var into "raw_options" & "options"
To make it clearer who-is-what
|
2020-03-21 23:07:07 +01:00 |
|
pictuga
|
056de12484
|
morss: add sheet.xsl to file handled by http server
|
2020-03-21 23:06:28 +01:00 |
|
pictuga
|
961a31141f
|
morss: fix url fixing
|
2020-03-21 17:28:00 +01:00 |
|
pictuga
|
d24734110a
|
morss: convert all feeds to RSS
As html feeds might not contain some feeds, leading to data loss
|
2020-03-20 12:26:34 +01:00 |
|
pictuga
|
a41c2a3a62
|
morss: fix twitter link detection
|
2020-03-20 12:26:19 +01:00 |
|
pictuga
|
dd2651061f
|
feeds & morss: clean up comments/empty lines
|
2020-03-20 12:25:48 +01:00 |
|
pictuga
|
5865af64f9
|
Fix indent output for html/xml
|
2020-03-20 12:18:13 +01:00 |
|
pictuga
|
b3b90c067a
|
morss.py: remove "useless" functions
Have to keep the code clean
|
2020-03-20 11:19:06 +01:00 |
|
pictuga
|
bda51b0fc7
|
feeds & morss: many encoding/tostring fixes
|
2020-03-19 12:53:25 +01:00 |
|
pictuga
|
d26795dce8
|
morss: from feedify to feeds
Also scrap obsolete feedify code
|
2020-03-19 10:27:44 +01:00 |
|
pictuga
|
9dbe061fd6
|
Remove markdown-related code
Time to clean up the code and stop with those non-core features
They just make the code harder to maintain
|
2020-03-18 16:47:00 +01:00 |
|
pictuga
|
e606c5eefb
|
feeds: various small cleanup/fixes
|
2018-11-18 15:14:38 +01:00 |
|
pictuga
|
3581f34db7
|
Various feeds.py related fixes
|
2018-11-11 16:46:23 +01:00 |
|
pictuga
|
679628c7fa
|
Small code clean up
|
2018-11-11 16:11:00 +01:00 |
|
pictuga
|
399e867c94
|
morss: add py2 indication
|
2018-11-11 16:07:25 +01:00 |
|
pictuga
|
221e1f85ad
|
feeds: fix implementation in morss
|
2018-11-11 15:26:09 +01:00 |
|
pictuga
|
4e144487db
|
Test for feedify support first
Otherwise might never be called if the content-type is also supported
|
2018-10-25 01:17:24 +02:00 |
|
pictuga
|
e72ca3f984
|
morss: improved output type
|
2018-09-30 22:02:29 +02:00 |
|
pictuga
|
2ccf36617a
|
morss: improve http parameter parsing
|
2018-09-30 22:01:19 +02:00 |
|
pictuga
|
2d5bf7b38b
|
Fix xml detection regex
Also (dirtily) fixes #18 for now
|
2017-11-04 14:21:05 +01:00 |
|
pictuga
|
194465544a
|
crawler: separate CacheHander and actual caching
Default cache is now just an in-memory {}
|
2017-11-04 12:41:56 +01:00 |
|
pictuga
|
2d7d0fcdca
|
morss: fix cgi in python 3
Needs explicit [] in py3
|
2017-11-04 12:27:47 +01:00 |
|
pictuga
|
f563040809
|
readabilite: threshold to detect if it contains an article
Useful for videos/images-based images
|
2017-10-28 01:30:21 +02:00 |
|
pictuga
|
64babd6713
|
morss: make readabilite links absolute
|
2017-07-29 14:37:37 +02:00 |
|
pictuga
|
d3bc2926fc
|
Remove :hungry
Mostly usless. If you need it, you might as well not need to use morss in the first place...
|
2017-03-25 13:52:58 -10:00 |
|
pictuga
|
167e3e4a15
|
feedify: accept xpath rules passed as parameters
|
2017-03-20 20:56:48 -10:00 |
|
pictuga
|
08f08ef704
|
improve morss url detection regex
|
2017-03-20 20:51:13 -10:00 |
|
pictuga
|
1b4341f741
|
accept query_string in morss cgi
|
2017-03-20 20:50:04 -10:00 |
|
pictuga
|
5e61686373
|
Only use full feed for articles & feedify
Sometimes using referrer and/or useragent makes some dumb websites return diferent content (hello feedburner)
|
2017-03-18 23:43:28 -10:00 |
|
pictuga
|
0b6e553054
|
Move iTunes code to feedify.py
|
2017-03-18 23:41:37 -10:00 |
|
pictuga
|
d4937812a8
|
Remove HTTPError code
Only used to look nice but useless (inherits from IOError anyway)
|
2017-03-18 23:39:32 -10:00 |
|
pictuga
|
67f5a21019
|
Move build_opener to crawler
Forgotten
|
2017-03-18 23:03:04 -10:00 |
|
pictuga
|
2003e2760b
|
Move custom_handler to crawler
Makes more sense. Easier to reuse. Also cleaned up a bit the code
|
2017-03-18 22:51:27 -10:00 |
|
pictuga
|
f4abc4e8a4
|
Detect encoding (using crawler) before readabilite
|
2017-03-11 02:30:57 -10:00 |
|
pictuga
|
385f9eb39a
|
morss: use crawler strict accept for feed
|
2017-03-08 19:05:48 -10:00 |