43 Commits

Author	SHA1	Message	Date
Athou	dbe7b48a04	merge push infos into feeds	2013-06-05 21:50:26 +02:00
Athou	39f1a19c14	removed as it in fact hurts perfs	2013-06-05 18:37:24 +02:00
Athou	502938a1df	refresh pubsubhubbub subscriptions every three days	2013-06-03 06:50:36 +02:00
Athou	ca82c3c369	make sure we have something to filter	2013-05-30 18:58:54 +02:00
Athou	2bd89f8238	filter list if not too large only	2013-05-30 15:26:39 +02:00
Athou	2ba1614f1d	filter out old entries	2013-05-30 13:51:18 +02:00
Athou	47b9f49831	make sure we have something to do before entering synchronized block	2013-05-30 12:57:14 +02:00
Athou	4da9fca7ea	Revert for the moment as it breaks pubsub handling	2013-05-30 11:55:15 +02:00
Athou	0aee6850d5	use a onetomany relationship for push info to avoid hibernate automatic lazy loading of onetoone optional relationships	2013-05-30 10:28:40 +02:00
Athou	e43ec5c2f4	actually use both guid and url as this is what we use later on to identify entries	2013-05-27 22:54:40 +02:00
Athou	6f96bd6df1	make sure the key is not null	2013-05-27 22:52:14 +02:00
Athou	6cc686ad03	lock on entry url	2013-05-27 22:43:08 +02:00
Athou	b6c331f067	display log error when lock fails	2013-05-27 16:41:29 +02:00
Athou	8f647a96e6	add more locks to the pool	2013-05-27 13:20:07 +02:00
Athou	8c45fc41ec	requeue feed immediatly if an entry fails to update	2013-05-27 12:16:37 +02:00
Athou	648923afb8	better log message	2013-05-27 11:46:23 +02:00
Athou	c0df050184	wait for lock for one minute, then timeout	2013-05-27 11:42:01 +02:00
Athou	475391c6a7	use weak references for lock keys	2013-05-27 11:37:38 +02:00
Athou	1ce2d854cb	queue size in metrics	2013-05-27 11:20:19 +02:00
Athou	db32c05689	use guava for lock handling	2013-05-27 10:44:43 +02:00
Athou	8adcd35cb4	increment feed update metric only when we actually update the feed	2013-05-25 15:39:54 +02:00
Athou	bb4ce2e0e4	remove predestroy responsability from startupbean	2013-05-24 16:50:00 +02:00
Athou	7b8d8d3f62	change log level	2013-05-24 12:51:39 +02:00
Athou	8039915bcf	shutdown pool when application stops	2013-05-24 12:28:48 +02:00
Athou	4ba0ed4bf7	jklm initial implementation	2013-05-24 09:21:20 +02:00
Athou	89ffd89a31	wait for a spot in the queue when full	2013-05-23 16:52:50 +02:00
Athou	dae85a2f48	more pubsub special cases handling	2013-05-23 13:02:56 +02:00
Athou	0d65471c83	actually set a capacity limit to the queue	2013-05-23 12:08:16 +02:00
Athou	a3b91b3ff7	additional log line	2013-05-23 10:52:14 +02:00
Athou	fd347eec74	log before executing	2013-05-23 08:19:05 +02:00
Athou	44d4d3e96b	setting for database update threads	2013-05-23 06:50:11 +02:00
Athou	f20a772603	update database asynchronously	2013-05-22 21:57:53 +02:00
Athou	e04c376285	save feed last	2013-05-22 09:38:20 +02:00
Athou	113c7ef81a	reuse instance	2013-05-22 09:34:24 +02:00
Athou	15b7d685fe	wip: allow parallel update of feeds	2013-05-22 08:01:05 +02:00
Athou	e1b8fa4e76	do the heavy work outside of the locked method	2013-05-21 17:00:37 +02:00
Athou	23240f2c93	small optimizations	2013-05-21 12:41:57 +02:00
Athou	304218265f	pubsubhubbub support is now optional	2013-05-21 07:09:48 +02:00
Athou	c88d3021b8	initial pubsubhubbub support (#44)	2013-05-20 17:44:38 +02:00
Athou	56ba907ec5	only allow one thread to update entries for a feed, avoids duplicates if two feeds containing the same entry are updating at the same time	2013-04-26 18:53:48 +02:00
Athou	2af55553a2	return to async beans, jms is too much overhead atm	2013-04-25 17:26:07 +02:00
Athou	9ee2f60e03	small tweaks	2013-04-25 15:04:41 +02:00
Athou	5bba598b2e	allows http threads to continue their job by asynchronously queuing database updates	2013-04-23 21:16:30 +02:00