Commit Graph

1046 Commits (master)
 

Author SHA1 Message Date
pictuga 363014ee4c User IOError to catch errors
Most http related exceptions inherit from that one
2013-11-30 17:33:57 +01:00
pictuga 7156dd5522 Support for non-textual gzipped http content 2013-11-24 21:55:07 +01:00
pictuga ecc18dc4ab Thread Gather()
Twice faster. Ctrl-C no longer works in terminal. Don't know how to fix it. Using threading.active_count() or sth didn't work as expected. New settings (THREADS) to change the number of threads to use.
2013-11-24 20:52:53 +01:00
pictuga 8832611a05 Fix MAX_ITEM condition 2013-11-24 20:49:14 +01:00
pictuga 1274df4e1d Yet another feedburner workaround
This one really drove me mad. When the "Referer" is feedburner itself, it just will show html page (with Google Reader Add buttons), instead of the regular feed. Itself adding "?format=xml" at the end of the url also solves it, but users don't know about that...
2013-11-24 20:43:09 +01:00
pictuga d3db04332e Don't run Fix() on dropped elements 2013-11-24 17:36:38 +01:00
pictuga 35fba5ffad Toggle isPermaLing when changing item url 2013-11-16 19:08:08 +01:00
pictuga 91251ec306 isPermaLink in feeds.py (RSS only) 2013-11-16 19:07:25 +01:00
pictuga 68768dd6e4 Add FeedBool in feeds.py
To handle boolean values
2013-11-16 19:06:35 +01:00
pictuga 610334dca9 Use self.nname in descriptor to store preformated 2013-11-16 19:05:57 +01:00
pictuga 03884be1bd Update README
LIM_TIME, arguments, CLI use case, facebook api, feedify, arguments explanation
2013-11-16 17:48:21 +01:00
pictuga f94bc4545e Add "LIM_TIME" to drop elements based on time
Also this value and the similars, all take -1 as unlimited value
2013-11-16 16:02:35 +01:00
pictuga 417609c1f0 Fix crash on empty html pages
Was due to "chardet" returning "None", which then crashed "str.replace"
2013-11-16 16:00:07 +01:00
pictuga 6975772ef9 Revert "Improve facebook and feedburner workarounds"
This PARTIALLY reverts commit 8a5202efd5 (only the feedburner part).
2013-11-15 16:54:41 +01:00
pictuga 3a784be93e End of typo fox in cachePath 2013-11-11 00:34:32 +01:00
pictuga 8a367f2251 Feedify support for DuckDuckGo
Trying to work around google's bann
2013-11-11 00:33:43 +01:00
pictuga ddc9e4e3cb Fix typo around cachePath
Identation was wrong in if/else statement
2013-11-10 23:55:44 +01:00
pictuga ee24702360 Remove left-over logging line in feedify 2013-11-10 23:55:01 +01:00
pictuga 88e7694de9 Add "proxy" mode: does't make the feed full-text
Useful for feedify (twitter, facebook, etc) and for bad written rss feeds in not-strong-enough news readers (eg. TPB on tt-rss). Uses "persistent" in Cache() so as not to empty the cache because of that (cause Cache() drops items not asked for).
2013-11-10 23:52:04 +01:00
pictuga 66197a4f0e Twitter: show full- and nickname 2013-11-10 23:51:13 +01:00
pictuga 3664879d92 Add full FB API (Graph API) support 2013-11-09 18:48:06 +01:00
pictuga e5fc9786f6 Set urlPath var earlier 2013-11-09 18:43:16 +01:00
pictuga 4ece739722 "redirect" and "url" in cache to control end url
Allow redirection, while keeping the same cache object
2013-11-09 18:40:23 +01:00
pictuga 6c72a6e583 Added "persistent" mode in Cache
Keep not-reused vars in cache
2013-11-09 18:38:02 +01:00
pictuga d18de37c38 Update feedify api mode & url 2013-11-09 18:32:14 +01:00
pictuga f52e2871ac Allow get() on new values in Cache()
Previously, it was only possible to access already-cached values via Cache.get(), this restriction is now gone. Also, data is now kept raw (not base64). It's also possible from now on to pass the type of var wanted (such as int).
2013-11-03 20:18:43 +01:00
pictuga 22d12a769c Fix Atom item's link discovery 2013-11-03 13:38:56 +01:00
pictuga f756a4d834 Use more obvious varname for cache path 2013-11-03 13:32:24 +01:00
pictuga a0c75238b9 Add ability to redirect feeds
Useful for websites with API (facebook). Will be in use later.
2013-11-03 13:30:16 +01:00
pictuga 7504cfed2a Add 'theforce' option to redownload xml
Useful for debugging
2013-11-03 13:29:35 +01:00
pictuga 5737adc253 Improve Cache()
Add the ability to create new Cache() objects from the current one (in the same directory). Allow the storage of int() (via str()). Don't store the key in the feed (useless, and not keeping it might make this service a little more less privacy-infrighting).
2013-11-03 13:26:56 +01:00
pictuga 09ba8ca644 Use HOLD in log()
So as not to write to the output when using on an HTTP server, during the writing of headers
2013-11-03 13:24:27 +01:00
pictuga 97acdd9530 Custom "getopt" as Class
Easier to use, an can now take value:
* CLI: morss key=value http://...
* HTTP: http://path/to/morss/:key=value/http://...
2013-11-03 13:18:09 +01:00
pictuga 53c9b07d19 Split Fill() into Fix and Fill
Fix improves links and suck things
2013-10-22 20:55:24 +02:00
pictuga d0360e5285 Remove delItems setItems in feeds.py
That part is actually done in the FeedList class
2013-10-21 21:31:38 +02:00
pictuga 71f20c8b29 Don't fill facebook for now 2013-10-21 21:31:02 +02:00
pictuga 8a5202efd5 Improve facebook and feedburner workarounds 2013-10-21 21:30:31 +02:00
pictuga 6bf7f60a3b Add support for facebook API
Still lacks a mechanism to fetch "extended tokens", so for now, it's somehow useless
2013-10-21 21:29:23 +02:00
pictuga 1f40f2a099 Add support for JSON APIs in feedify 2013-10-21 21:28:43 +02:00
pictuga 1802827d31 Fix decoding
Was dropped in previous commit by mistake
2013-10-21 21:24:19 +02:00
pictuga a1f9fe24c8 Use one single urllib2 handler
Makes feedify on html pages more powerful
2013-10-21 21:17:52 +02:00
pictuga 4d2d17f9e1 Tell about dateutil in readme 2013-10-12 23:43:09 +02:00
pictuga c1d410267b Fix two function in case of None element 2013-10-12 23:36:43 +02:00
pictuga 0d1f1fdcc0 Support for (gu)id 2013-10-12 23:36:00 +02:00
pictuga e98617c320 Time in twitter feedify 2013-10-09 00:50:10 +02:00
pictuga 12d48918d8 Add time handling in feeds.py
Lots of time format can be passed as a value (RSS/Atom time strings, timestamp, anything supported by dateutil.parser). Implemented in twitter feedify hook.
2013-10-09 00:48:05 +02:00
pictuga 16b5e4b018 Fix .htaccess for no-gzip when in 'progress' mode 2013-10-09 00:45:11 +02:00
pictuga 76b81a31ec Drop desc by default
Arguably the reason is that users tend to believe the program does nothing, cause Firefox (and others?) only shows the description in the feed preview. The "keep" parameter keeps the description in place.
2013-10-02 12:06:14 +02:00
pictuga ae22104831 Center "* * *" in clip mode 2013-10-02 12:05:52 +02:00
pictuga 196400967d Type of self.xdel in feeds 2013-10-02 11:33:40 +02:00