pictuga/morss
1
1
Fork 0
Code Issues Pull Requests Actions Packages Releases Activity
256 Commits 1 Branch 2 Tags
6c33bb6e1c
Commit Graph

256 Commits

Author SHA1 Message Date
pictuga
a1f9fe24c8 Use one single urllib2 handler 
Makes feedify on html pages more powerful
 2013-10-21 21:17:52 +02:00
pictuga
4d2d17f9e1 Tell about dateutil in readme 2013-10-12 23:43:09 +02:00
pictuga
c1d410267b Fix two function in case of None element 2013-10-12 23:36:43 +02:00
pictuga
0d1f1fdcc0 Support for (gu)id 2013-10-12 23:36:00 +02:00
pictuga
e98617c320 Time in twitter feedify 2013-10-09 00:50:10 +02:00
pictuga
12d48918d8 Add time handling in feeds.py 
Lots of time format can be passed as a value (RSS/Atom time strings, timestamp, anything supported by dateutil.parser). Implemented in twitter feedify hook.
 2013-10-09 00:48:05 +02:00
pictuga
16b5e4b018 Fix .htaccess for no-gzip when in 'progress' mode 2013-10-09 00:45:11 +02:00
pictuga
76b81a31ec Drop desc by default 
Arguably the reason is that users tend to believe the program does nothing, cause Firefox (and others?) only shows the description in the feed preview. The "keep" parameter keeps the description in place.
 2013-10-02 12:06:14 +02:00
pictuga
ae22104831 Center "* * *" in clip mode 2013-10-02 12:05:52 +02:00
pictuga
196400967d Type of self.xdel in feeds 2013-10-02 11:33:40 +02:00
pictuga
60fb90eb01 Add google support in feedify 2013-10-01 20:19:17 +02:00
pictuga
685bc7988e Improve feedify string grabbing 2013-10-01 20:18:55 +02:00
pictuga
050be7690d Ability to delete desc, content, title in feeds 2013-10-01 19:52:21 +02:00
pictuga
145f59b546 Fix already-filled feeds 
By pulling the content from "content" when needed
 2013-10-01 19:50:28 +02:00
pictuga
ae5e947417 Add support for facebook, google links 2013-10-01 19:49:53 +02:00
pictuga
cf5040020e Use desktop browser UA for xml 
Convenient for rss links detection and "feedify"
 2013-10-01 19:47:45 +02:00
pictuga
e3c1cd8619 Accept more types as "text" before readability 2013-10-01 19:47:06 +02:00
pictuga
78706952fe Remove "clip" from Fill 
Put that in Gather. Also removed from feeds.py. "alone" mode was also added (it removes the description).
 2013-10-01 19:45:54 +02:00
pictuga
1b7fe8fbee Use "options" in Gather instead of "progress" 
Also made it possible to toggle Fill's toggle through parameters
 2013-09-29 15:32:58 +02:00
pictuga
a5a327388a Add ability not to fetch an item's article 2013-09-25 13:47:05 +02:00
pictuga
9f22402dca Twitter: use pahe <title> as feed title 2013-09-25 12:48:50 +02:00
pictuga
0657077191 Add support for twitter 
Grabs "feed" from the html page, clips tweet and article together.
 2013-09-25 12:37:14 +02:00
pictuga
da14242bcf Add feedify, and use it in morss 2013-09-25 12:36:21 +02:00
pictuga
9bc4417be3 More flexible xml caching 
New includes a 'type' var, to remember what we did out of it (normal, nothing, grabbed xml link, etc). xml/html mimetype are now saved in a dict, for easier editing, and consistency.
 2013-09-25 12:32:40 +02:00
pictuga
edff54a016 Add pushContent in feeds.py 
Useful for twitter (later) for it's "clip" toggle, which keeps the original desc/content above the article. Makes changing the content, while keeping the original stub in place, easier.
 2013-09-25 12:18:22 +02:00
pictuga
208d70d3db Use separate var in Fill for final url 
That way the url can be changed altogether for the article-fetching part, without changing the item link itself. Useful for upcoming twitter feeds.
 2013-09-25 11:51:48 +02:00
pictuga
fd1501a0c0 Check relative url earlier 2013-09-25 11:49:45 +02:00
pictuga
1e621099e0 Log cache hash in Gather 2013-09-25 11:15:11 +02:00
pictuga
3d6d7e70b6 Remove useless "as" in error catch 2013-09-25 11:14:22 +02:00
pictuga
e73cbf56c2 Add 'html' option, usefull to see error on server 2013-09-25 11:13:33 +02:00
pictuga
03014a8cbf Typo in UA_HTML var name 2013-09-25 11:11:11 +02:00
pictuga
4a5cbcfd18 Move httplib in common code 
Needed for error catch
 2013-09-25 11:10:16 +02:00
pictuga
3fd34ff1a6 decodeHTML works without connection object 2013-09-25 11:08:58 +02:00
pictuga
e759cd46c6 Add set/getLinks in FeedItem (base) 2013-09-17 00:45:15 +02:00
pictuga
355bfa5efd Adding items, creating feeds now possible 
Both hakish to do, but works
 2013-09-17 00:44:10 +02:00
pictuga
658f51e5a9 Support feeds handed out as text/html 
<http://www.pro-linux.de/rss/index1.xml> and <http://tehrantimes.com/index.php?option=com_ninjarsssyndicator&feed_id=1&format=raw> are on an equal footing…
 2013-09-16 00:33:24 +02:00
pictuga
8eb2f7c249 Added another letter to feedsportal table 2013-09-15 19:38:59 +02:00
pictuga
23246ca6c1 Save the key in cache file 2013-09-15 19:20:51 +02:00
pictuga
1b7777c331 Find RSS links within html pages' <head> 
And cache those links
 2013-09-15 19:19:50 +02:00
pictuga
1bd17f1365 Faster relative link resolution 2013-09-15 19:18:39 +02:00
pictuga
7575291f8f Log url in Gather 
Useful for upcoming commits
 2013-09-15 18:53:35 +02:00
pictuga
532852a408 Use cleaner http error catch 
One error type was inheriting from another one
 2013-09-15 18:52:34 +02:00
pictuga
2eb6e69b5a full-text with a dash in README 2013-09-15 17:59:17 +02:00
pictuga
43bf021f23 Catch more http exceptions 
Such as InvalidURL. Subclasses of httplib.HTTPException
 2013-09-15 17:19:33 +02:00
pictuga
9252e75923 Ensure var in parseOptions are defined 
Caused a bug on morss.it's server
 2013-09-15 15:56:08 +02:00
pictuga
75b51fc2c2 Add ability to bypass ETag support 
Add the ":force" argument over http to bypass ETag support, which is convenient to debug code
 2013-09-15 15:54:42 +02:00
pictuga
d2de6cf23d Extra doc for DELAY, for xml cache, & now for etag 2013-09-15 15:45:15 +02:00
pictuga
89187ab6a6 Log generation time 2013-09-15 15:44:25 +02:00
pictuga
04840d9843 More flexible parameters can be passed 
Multiple parameters can now be passed. HTTP "API" has been improved, and url now have to be like "http://<path to morss>/:<param1>:<param2>/<url>". The code handling the parameters parsing is now way cleaner. Debug toggle is now a var, which can be changed with parameters. Also http logging is no longer done into a file, which tended to grow way too fast, while lacking an "error 403 protection", but instead the parameter ":debug" can be passed in the url, and the page will be delivered as "text/plain" with the debug written into it. Therefore some logging had to be moved around, so as not to output anything during http headers definition.
 2013-09-15 15:38:03 +02:00
pictuga
c25aec7107 Only perform <meta> redirects on html pages 2013-09-15 15:33:14 +02:00