144 Commits

Author	SHA1	Message	Date
Athou	7b8d8d3f62	change log level	2013-05-24 12:51:39 +02:00
Athou	8039915bcf	shutdown pool when application stops	2013-05-24 12:28:48 +02:00
Athou	d148fa9df7	build disabledUntil date for feeds with support for http 304	2013-05-24 12:15:19 +02:00
Athou	6aebae56e6	Merge pull request #171 from Athou/jklm ... Use jkeylockmanager for entry update locking	2013-05-24 03:04:03 -07:00
Athou	4ba0ed4bf7	jklm initial implementation	2013-05-24 09:21:20 +02:00
Athou	c2b3992818	do some heavy work outside of the database transaction	2013-05-24 07:15:09 +02:00
Athou	89ffd89a31	wait for a spot in the queue when full	2013-05-23 16:52:50 +02:00
Athou	20a2c90241	truncate url if too long	2013-05-23 15:35:12 +02:00
Athou	dae85a2f48	more pubsub special cases handling	2013-05-23 13:02:56 +02:00
Athou	4935d4f1bc	make sure title fits in the database field	2013-05-23 12:15:00 +02:00
Athou	0d65471c83	actually set a capacity limit to the queue	2013-05-23 12:08:16 +02:00
Athou	8f43d8d1bd	pubsubhubbub tweaks	2013-05-23 11:18:07 +02:00
Athou	a3b91b3ff7	additional log line	2013-05-23 10:52:14 +02:00
Athou	f9cfea4f79	make sure enclosure urls fit in the database field	2013-05-23 10:03:15 +02:00
Athou	fd347eec74	log before executing	2013-05-23 08:19:05 +02:00
Athou	7d09dc8046	handle pushpress errors	2013-05-23 07:03:49 +02:00
Athou	44d4d3e96b	setting for database update threads	2013-05-23 06:50:11 +02:00
Athou	dbda3a9484	make sure the etag header fits in the database field	2013-05-22 22:15:53 +02:00
Athou	f20a772603	update database asynchronously	2013-05-22 21:57:53 +02:00
Athou	adb1d99f8b	typo	2013-05-22 16:12:39 +02:00
Athou	fc48c64e2b	more reasonable buffer	2013-05-22 16:11:31 +02:00
Athou	97c2c12fe2	don't cap feed count buffer	2013-05-22 15:55:28 +02:00
Athou	43caaab007	null handling	2013-05-22 13:33:22 +02:00
Athou	f429a11d12	record missing metric	2013-05-22 13:13:05 +02:00
Athou	c2a10e6f81	record sleeping threads	2013-05-22 13:07:39 +02:00
Athou	5bf2dfaa18	increment metric only if queue is not null	2013-05-22 12:25:35 +02:00
Athou	eff84c69af	prevent duplicate entries for push infos	2013-05-22 11:25:29 +02:00
Athou	cafcfc4c9f	forgot to empty queues	2013-05-22 10:39:03 +02:00
Athou	e04c376285	save feed last	2013-05-22 09:38:20 +02:00
Athou	113c7ef81a	reuse instance	2013-05-22 09:34:24 +02:00
Athou	15b7d685fe	wip: allow parallel update of feeds	2013-05-22 08:01:05 +02:00
Athou	e1b8fa4e76	do the heavy work outside of the locked method	2013-05-21 17:00:37 +02:00
Athou	3dca5d595d	just queue feeds, update them later	2013-05-21 16:40:37 +02:00
Athou	6c90da83d0	smaller sleeping time	2013-05-21 13:55:46 +02:00
Athou	23512e95a7	add atom links for rss feeds	2013-05-21 13:36:20 +02:00
Athou	6cfa275aa1	sleep initially for one minute before starting threads	2013-05-21 12:57:07 +02:00
Athou	23240f2c93	small optimizations	2013-05-21 12:41:57 +02:00
Athou	36e39b8c75	delay based on heavy load setting	2013-05-21 10:44:05 +02:00
Athou	9c9a315d1c	settings for heavy load	2013-05-21 08:46:14 +02:00
Athou	304218265f	pubsubhubbub support is now optional	2013-05-21 07:09:48 +02:00
Athou	185df1d3d7	change log level for some logging lines	2013-05-20 18:12:11 +02:00
Athou	c88d3021b8	initial pubsubhubbub support (#44)	2013-05-20 17:44:38 +02:00
Athou	badc830535	use the first entry date as publish date	2013-05-20 12:37:37 +02:00
Athou	72e3507006	disable incrementally by one hour every time the feed fails to download (#44)	2013-05-20 11:57:45 +02:00
Athou	c5147360d8	sort timestamps desc (#44)	2013-05-20 11:47:54 +02:00
Athou	eea6d9855a	typo	2013-05-20 11:22:32 +02:00
Athou	b11fd7897d	first try at #44	2013-05-20 11:19:30 +02:00
Athou	b2ee06d94a	handle iso-8859-2 (#138)	2013-05-19 21:51:26 +02:00
Athou	0e22489d08	set feed exceptions to debug level	2013-05-19 17:08:57 +02:00
Athou	df52dcd748	utility method to calculate average time between entries	2013-05-19 12:54:39 +02:00