pictuga
6c33bb6e1c
Safer Cache saving
...
Create tmp file and then move it to destination. Avoids corrupt files during write
2014-01-29 20:36:45 +01:00
pictuga
6eaec96af7
Keep "dic" param in Cache.new
2014-01-22 15:56:08 +01:00
pictuga
4e549dc88a
Change lim/max settings only for current "run"
2014-01-19 23:36:41 +01:00
pictuga
0f7bc568e4
Send CGI HTTP headers earlier
...
So that browsers show that sth is going on
2014-01-15 21:02:47 +01:00
pictuga
4d6ef92504
Separate function for output. Add csv
2014-01-13 00:10:57 +01:00
pictuga
7fbe728f93
Feeds: allow json, csv export
...
Uses OrderedDict
2014-01-13 00:08:03 +01:00
pictuga
ec55f5e856
Use smarter order for RSS.dict
2014-01-13 00:07:04 +01:00
pictuga
3d78cfb638
Fix HTTP bug when returning empty page
2014-01-11 18:21:37 +01:00
pictuga
840b0b1ded
Remove yet another silly log message
2014-01-11 18:18:02 +01:00
pictuga
8209f243bb
Fix rss-redirection code
...
And add log, which was lost when splitting functions (which made this fix needed)
2014-01-11 18:15:36 +01:00
pictuga
3b3ac4c8a6
Remove batch of useless imports
2014-01-11 17:31:27 +01:00
pictuga
5feb061bf7
First attempt at decent folder structure
...
Use setup.py, subfolder for code.
2014-01-11 17:11:57 +01:00
pictuga
851dacdfbc
Renamed to .py.
2013-04-04 18:17:12 +02:00
pictuga
6783bbf992
Improved shebang.
2013-04-04 17:56:37 +02:00
pictuga
82084c2c75
Move to OOP.
...
This is a huge commit. The whole code is ported to Object-Oritented Programming. This makes the code cleaner, which became required to deal with all the different cases, for example with encoding detection. Encoding detection now works better, and uses 3 different methods. HTML pages with an xml declaration are now supported. Feed urls with parameters (eg. "index.php?option=par") are also supported. Cache is now smarter, since it no longer grows indefinitely, since only in-use pages are kept in the cache. Caching is now mandatory. urllib (not urllib2) is no longer needed. Solved a possible crash with log function (when passing list of str with non-unicode encoging).
README is also updated.
2013-04-04 17:43:30 +02:00
pictuga
05b5bc7783
Catch extra errors (timeout).
2013-03-29 20:06:31 +01:00
pictuga
6f6c5fbaad
Faster xml cleaning
2013-03-01 14:26:51 +01:00
pictuga
e305f387ab
Hopefully fixed encoding issues
...
with the dirtiest trick out there...
2013-02-27 15:12:32 +01:00
pictuga
ed8a45875c
Default to "//h1/.." since most website use it
...
because it is said to be good for SEO. Debug now requires env variable "DEBUG" to be set to something else than "".
2013-02-25 21:36:02 +01:00
pictuga
d39604c453
Support for cookies added
...
NYT needs them
2013-02-25 20:53:59 +01:00
pictuga
d6179a734f
Clearer debug info
2013-02-25 20:53:22 +01:00
pictuga
eb63ce3f4f
Handle more errors
2013-02-25 18:32:23 +01:00
pictuga
b63f91a151
Added cache, easier debug
2013-02-25 18:01:59 +01:00
pictuga
51fe6ce81b
First commit
2013-02-25 15:50:32 +01:00
pictuga