248 Commits

Author SHA1 Message Date
7fbe728f93 Feeds: allow json, csv export
Uses OrderedDict
2014-01-13 00:08:03 +01:00
ec55f5e856 Use smarter order for RSS.dict 2014-01-13 00:07:04 +01:00
3d78cfb638 Fix HTTP bug when returning empty page 2014-01-11 18:21:37 +01:00
840b0b1ded Remove yet another silly log message 2014-01-11 18:18:02 +01:00
8209f243bb Fix rss-redirection code
And add log, which was lost when splitting functions (which made this fix needed)
2014-01-11 18:15:36 +01:00
3b3ac4c8a6 Remove batch of useless imports 2014-01-11 17:31:27 +01:00
ca72c397fb Update setup.py
Deprecated var name (stupid google), add feedify.ini (still not sure what to do with .htaccess)
2014-01-11 17:29:06 +01:00
5feb061bf7 First attempt at decent folder structure
Use setup.py, subfolder for code.
2014-01-11 17:11:57 +01:00
4038033336 Update README
New settings (eg. al, txt, silent), included HTTP server, new todo item (readability rewrite)
2014-01-09 20:34:12 +01:00
bb6a3b3d4d Update README todo
JSON output and own HTTP server have been implemented
2014-01-09 19:57:03 +01:00
84377a3f36 Commit "id" in feedify
Has been there for a while, never bothered to commit.
2014-01-08 01:49:44 +01:00
3e2c4de833 Fix bug in parseOptions with values 2014-01-08 01:48:39 +01:00
bd1c6a5be6 Huge commit: wsgiref-like. "Progress" dropped.
Can now run as HTTP server. Main functions split again (Init, Fetch). LIM/MAX_STUFF moved to function body (this still has to be improved). "progress" too hard to get to work with wsgiref, dropped. This whole thing should make it easier to maintain code (no more ifs everywhere).
2014-01-08 01:44:45 +01:00
f12031cbdb More usefull except logging 2014-01-08 01:38:50 +01:00
a2402da32e Stop logging accept-header string
Useless once stable
2014-01-08 01:37:16 +01:00
69a8516cd1 Slightly nicer "rank" computer in accept-header 2014-01-08 01:36:31 +01:00
32f9550be5 Add "al" (apparent limit) param with value
Removes element from rss *after* treatment, useful for slow json API
2014-01-08 01:34:40 +01:00
e70399b654 Raise MorssExceptions in morss.py
Cleaner
2014-01-08 01:33:18 +01:00
47b8c12fbb Remove useless 'socket' dependence 2013-12-23 13:10:02 +01:00
bb48ee4518 Forgot one chunk of code in previous commit 2013-12-22 18:27:18 +01:00
a5e4775f68 Move some code into Gather()
Will be useful when playing with WSGIREF
2013-12-22 18:25:33 +01:00
b86b0f371a Remove silly debug print 2013-12-22 12:45:21 +01:00
0badec72a9 Allow iteration over RSS objects
Useful for JSON
2013-12-22 12:44:33 +01:00
d97a72bc0b Use Cache dict for facebook storage 2013-12-22 12:43:03 +01:00
afe31e695a "json" arg to output json feed 2013-12-21 20:14:10 +01:00
47013c7948 Use sys.stdout.write instead of print in progress
For some reason, this avoids having multiple "lines" on top of each other, which was always due to print()' newlines. And this makes the client/js part much more stable.
2013-12-21 20:11:20 +01:00
eafbc14a58 Allow "progress" in JSON 2013-12-21 20:09:14 +01:00
cbdb61a918 Allow real python dict in Cache
Makes it possible to store things a nicer way
2013-12-21 17:05:12 +01:00
2a8c94fd88 Work with unicode strings
In downloads at least (I don't quite remember what readability returns actually, but "it just works")
2013-12-12 23:12:33 +01:00
eac2e7a79a Try to avoid erros with saving
Mainly: do not create empty cache file, and accept empty cache file (doesn't sound logical but still)
2013-12-12 16:41:58 +01:00
82f01acfb1 Fix types (int mostly) in facebook 2013-12-09 22:13:23 +01:00
fa14fa0ccb Fix encoding in feedify 2013-12-09 22:11:46 +01:00
d2345a94f8 Speed up a little html encoding detection
Not sure this is a smart move
2013-12-07 20:35:32 +01:00
245ba99ae9 Always clean up downloads' enconding
TPB, fuck ye
2013-12-07 20:33:33 +01:00
e3f525ff2a Fix JSON related encoding issue 2013-12-04 20:26:39 +01:00
c43bf9f35f Feed: print roottree
Keeps doctype declaration, xml stylesheets and so on
2013-12-04 20:14:09 +01:00
71e4d597f8 Atom: support for <link rel="relative">
Not very clean. Clean work would require full rewrite of xgetCreate & maybe the whole item "selection" system
2013-12-04 20:12:52 +01:00
e2512dba0c Cath all errors in threads
Makes in possible to empty the queue whatsoever happens
2013-12-01 19:45:00 +01:00
1644a409ef Add application/xml as html mimetype 2013-12-01 15:48:17 +01:00
8b3062eaa2 Make Accept headers py 2.6 compatible 2013-12-01 15:47:20 +01:00
66c6dcf203 Store "as it" in JSON (int or str)
The json lib does all the work
2013-12-01 15:46:02 +01:00
52fe67beb3 Create cache file when missing
Damn it...
2013-12-01 15:45:21 +01:00
020c095194 Pretty-print JSON to cache
Easier for debugging, not really needed though, takes more place for nothing
2013-12-01 15:44:19 +01:00
c83f5bb23d URI based Cache filename
Problem: lengthy filenames, have to cut them after 255 chars, sucks with FB, can cause problems
2013-12-01 15:42:35 +01:00
1a50cb390a User JSON to save cache
Faster, cleaner, safer, unobfuscated, not 1/3 bigger
2013-11-30 19:59:19 +01:00
fde5d3e8c5 Argument "silent" prevents from outputting feed
Also fixes small indentation typo (non blocking though)
2013-11-30 19:39:27 +01:00
1d10d30173 Reddit: check feed url instead of link url 2013-11-30 19:36:44 +01:00
b927a4d089 Use "str.startswith" instead of ugly hack 2013-11-30 19:36:15 +01:00
8916216403 Add "txt" argument, to change HTTP Content-Type 2013-11-30 19:35:24 +01:00
336d98230f Make sure final data is there in downloader 2013-11-30 19:34:34 +01:00