Commit Graph

64 Commits

Author SHA1 Message Date
Athou
8f85637bb8 invalidate cache once per feed instead of once per entry 2013-07-31 16:03:52 +02:00
Athou
6dcf2aabd1 pass a context object around instead of creating transient fields in model objects 2013-07-31 13:06:57 +02:00
Athou
7827cf49d6 limit queue sizes 2013-07-28 16:36:21 +02:00
Athou
3dd4f140e2 refactored the way we handle feed refresh queue 2013-07-27 15:45:03 +02:00
Athou
9cdc364fde index title hash 2013-07-26 08:15:23 +02:00
Athou
6f29af1710 better locking mechanism 2013-07-25 16:41:48 +02:00
Athou
8845c54d0c apply formatter 2013-07-25 09:17:33 +02:00
Athou
c2b53b117c remove many to many relationship between entries and feeds 2013-07-24 15:40:59 +02:00
Athou
60c64ce900 display app version 2013-07-21 11:40:32 +02:00
Athou
642c780936 rename queues 2013-07-21 11:13:26 +02:00
Athou
c388e726fe show active threads in metrics 2013-07-05 09:52:23 +02:00
Athou
f0f1a7f87b cache the "tree" 2013-07-02 18:49:34 +02:00
Athou
d3dd084dd7 better refresh algorithm using queues instead of synchronous database call 2013-06-30 12:35:17 +02:00
Athou
a023de3d28 look subscriptions up only if needed 2013-06-30 07:44:59 +02:00
Athou
27e03e3038 added in memory cache and redis cache and marked them as application scoped 2013-06-29 11:20:53 +02:00
Athou
8c080a581e metrics for entry cache 2013-06-28 22:31:40 +02:00
Athou
fbd0feb6e7 initial entry caching implementation 2013-06-28 20:46:30 +02:00
Athou
158abadf19 use date constructor directly when a calendar is not needed, better performances 2013-06-25 16:57:48 +02:00
Athou
a2a88e85c4 queue first when urgent 2013-06-22 22:32:57 +02:00
Athou
f54e41897d manually queue feeds for refresh (#316) 2013-06-22 20:06:09 +02:00
Athou
27804db165 make sure the entry has been updated 2013-06-07 15:54:47 +02:00
Athou
dbe7b48a04 merge push infos into feeds 2013-06-05 21:50:26 +02:00
Athou
39f1a19c14 removed as it in fact hurts perfs 2013-06-05 18:37:24 +02:00
Athou
502938a1df refresh pubsubhubbub subscriptions every three days 2013-06-03 06:50:36 +02:00
Athou
ca82c3c369 make sure we have something to filter 2013-05-30 18:58:54 +02:00
Athou
2bd89f8238 filter list if not too large only 2013-05-30 15:26:39 +02:00
Athou
2ba1614f1d filter out old entries 2013-05-30 13:51:18 +02:00
Athou
47b9f49831 make sure we have something to do before entering synchronized block 2013-05-30 12:57:14 +02:00
Athou
4da9fca7ea Revert for the moment as it breaks pubsub handling 2013-05-30 11:55:15 +02:00
Athou
0aee6850d5 use a onetomany relationship for push info to avoid hibernate automatic lazy loading of onetoone optional relationships 2013-05-30 10:28:40 +02:00
Athou
e43ec5c2f4 actually use both guid and url as this is what we use later on to identify entries 2013-05-27 22:54:40 +02:00
Athou
6f96bd6df1 make sure the key is not null 2013-05-27 22:52:14 +02:00
Athou
6cc686ad03 lock on entry url 2013-05-27 22:43:08 +02:00
Athou
b6c331f067 display log error when lock fails 2013-05-27 16:41:29 +02:00
Athou
8f647a96e6 add more locks to the pool 2013-05-27 13:20:07 +02:00
Athou
8c45fc41ec requeue feed immediatly if an entry fails to update 2013-05-27 12:16:37 +02:00
Athou
648923afb8 better log message 2013-05-27 11:46:23 +02:00
Athou
c0df050184 wait for lock for one minute, then timeout 2013-05-27 11:42:01 +02:00
Athou
475391c6a7 use weak references for lock keys 2013-05-27 11:37:38 +02:00
Athou
1ce2d854cb queue size in metrics 2013-05-27 11:20:19 +02:00
Athou
db32c05689 use guava for lock handling 2013-05-27 10:44:43 +02:00
Athou
8adcd35cb4 increment feed update metric only when we actually update the feed 2013-05-25 15:39:54 +02:00
Athou
bb4ce2e0e4 remove predestroy responsability from startupbean 2013-05-24 16:50:00 +02:00
Athou
7b8d8d3f62 change log level 2013-05-24 12:51:39 +02:00
Athou
8039915bcf shutdown pool when application stops 2013-05-24 12:28:48 +02:00
Athou
4ba0ed4bf7 jklm initial implementation 2013-05-24 09:21:20 +02:00
Athou
89ffd89a31 wait for a spot in the queue when full 2013-05-23 16:52:50 +02:00
Athou
dae85a2f48 more pubsub special cases handling 2013-05-23 13:02:56 +02:00
Athou
0d65471c83 actually set a capacity limit to the queue 2013-05-23 12:08:16 +02:00
Athou
a3b91b3ff7 additional log line 2013-05-23 10:52:14 +02:00