Commit Graph

304 Commits

Author SHA1 Message Date
Athou
d148fa9df7 build disabledUntil date for feeds with support for http 304 2013-05-24 12:15:19 +02:00
Athou
6aebae56e6 Merge pull request #171 from Athou/jklm
Use jkeylockmanager for entry update locking
2013-05-24 03:04:03 -07:00
Athou
1ba5ded090 replaced by jlockmanager 2013-05-24 11:40:59 +02:00
Athou
4ba0ed4bf7 jklm initial implementation 2013-05-24 09:21:20 +02:00
Athou
c2b3992818 do some heavy work outside of the database transaction 2013-05-24 07:15:09 +02:00
Athou
89ffd89a31 wait for a spot in the queue when full 2013-05-23 16:52:50 +02:00
Athou
e8953378bb enforce settings uniqueness 2013-05-23 16:16:05 +02:00
Athou
20a2c90241 truncate url if too long 2013-05-23 15:35:12 +02:00
Athou
dae85a2f48 more pubsub special cases handling 2013-05-23 13:02:56 +02:00
Athou
4935d4f1bc make sure title fits in the database field 2013-05-23 12:15:00 +02:00
Athou
0d65471c83 actually set a capacity limit to the queue 2013-05-23 12:08:16 +02:00
Athou
2bbfb6e3de prevent NPE 2013-05-23 11:30:57 +02:00
Athou
8f43d8d1bd pubsubhubbub tweaks 2013-05-23 11:18:07 +02:00
Athou
a3b91b3ff7 additional log line 2013-05-23 10:52:14 +02:00
Athou
f9cfea4f79 make sure enclosure urls fit in the database field 2013-05-23 10:03:15 +02:00
Athou
fd347eec74 log before executing 2013-05-23 08:19:05 +02:00
Athou
7d09dc8046 handle pushpress errors 2013-05-23 07:03:49 +02:00
Athou
44d4d3e96b setting for database update threads 2013-05-23 06:50:11 +02:00
Athou
dbda3a9484 make sure the etag header fits in the database field 2013-05-22 22:15:53 +02:00
Athou
f20a772603 update database asynchronously 2013-05-22 21:57:53 +02:00
Athou
58501bbfb1 various tweaks 2013-05-22 21:56:22 +02:00
Athou
fe16a2a7e2 mark starred entries 2013-05-22 17:12:01 +02:00
Athou
adb1d99f8b typo 2013-05-22 16:12:39 +02:00
Athou
fc48c64e2b more reasonable buffer 2013-05-22 16:11:31 +02:00
Athou
97c2c12fe2 don't cap feed count buffer 2013-05-22 15:55:28 +02:00
Athou
43caaab007 null handling 2013-05-22 13:33:22 +02:00
Athou
60aed91c95 log error message body 2013-05-22 13:27:42 +02:00
Athou
f429a11d12 record missing metric 2013-05-22 13:13:05 +02:00
Athou
c2a10e6f81 record sleeping threads 2013-05-22 13:07:39 +02:00
Athou
5bf2dfaa18 increment metric only if queue is not null 2013-05-22 12:25:35 +02:00
Athou
eff84c69af prevent duplicate entries for push infos 2013-05-22 11:25:29 +02:00
Athou
cafcfc4c9f forgot to empty queues 2013-05-22 10:39:03 +02:00
Athou
1329d2f007 don't update if nothing to do 2013-05-22 09:38:32 +02:00
Athou
e04c376285 save feed last 2013-05-22 09:38:20 +02:00
Athou
113c7ef81a reuse instance 2013-05-22 09:34:24 +02:00
Athou
1ee37057cd refactored dao method 2013-05-22 08:10:31 +02:00
Athou
15b7d685fe wip: allow parallel update of feeds 2013-05-22 08:01:05 +02:00
Athou
e1b8fa4e76 do the heavy work outside of the locked method 2013-05-21 17:00:37 +02:00
Athou
3dca5d595d just queue feeds, update them later 2013-05-21 16:40:37 +02:00
Athou
9d5b67ffda lazy load push infos 2013-05-21 15:28:08 +02:00
Athou
ce5f9f4932 increase timeout duration 2013-05-21 15:06:03 +02:00
Athou
e836d5c04e some hubs return 200 2013-05-21 15:03:40 +02:00
Athou
a98ddc185a changing logging level 2013-05-21 14:44:55 +02:00
Athou
36960344e8 better log message 2013-05-21 14:42:04 +02:00
Athou
6c90da83d0 smaller sleeping time 2013-05-21 13:55:46 +02:00
Athou
f5a6d6c830 fix annotation 2013-05-21 13:49:42 +02:00
Athou
e388a56c8e enforce uniqueness 2013-05-21 13:47:20 +02:00
Athou
23512e95a7 add atom links for rss feeds 2013-05-21 13:36:20 +02:00
Athou
d906b21fa9 set our own user agent string 2013-05-21 13:24:28 +02:00
Athou
6cfa275aa1 sleep initially for one minute before starting threads 2013-05-21 12:57:07 +02:00