183 Commits

Author	SHA1	Message	Date
Athou	4e7bcd004d	make sure we have content	2013-05-31 09:31:59 +02:00
Athou	d0e37af52b	keep text only before detecting direction, use jsoup because bidiutils html stripping is too restrictive	2013-05-31 09:28:51 +02:00
Athou	9568ccfeac	experimental rtl support (#209)	2013-05-31 08:23:30 +02:00
Athou	ca82c3c369	make sure we have something to filter	2013-05-30 18:58:54 +02:00
Athou	2bd89f8238	filter list if not too large only	2013-05-30 15:26:39 +02:00
Athou	f9e9010545	revert to old factor	2013-05-30 15:23:07 +02:00
Athou	a2f28f2565	reduce factor to 2 for heavy load	2013-05-30 14:56:03 +02:00
Athou	7df071b023	use all timestamps available to build average time	2013-05-30 13:58:37 +02:00
Athou	2ba1614f1d	filter out old entries	2013-05-30 13:51:18 +02:00
Athou	63349d6e14	small refactoring	2013-05-30 13:18:26 +02:00
Athou	47b9f49831	make sure we have something to do before entering synchronized block	2013-05-30 12:57:14 +02:00
Athou	4da9fca7ea	Revert for the moment as it breaks pubsub handling	2013-05-30 11:55:15 +02:00
Athou	0aee6850d5	use a onetomany relationship for push info to avoid hibernate automatic lazy loading of onetoone optional relationships	2013-05-30 10:28:40 +02:00
Athou	145285dd20	handle entry content only if the entry is new	2013-05-29 16:42:45 +02:00
Athou	ed18bc55b7	fix opml export not showing head and title	2013-05-29 16:37:22 +02:00
Athou	5dad786802	no guid and no link, skip entry	2013-05-28 21:53:58 +02:00
Athou	23c243c8ac	remove potential duplicates	2013-05-28 13:01:02 +02:00
Athou	f832374087	disable feeds up to a week	2013-05-28 09:20:44 +02:00
Athou	e43ec5c2f4	actually use both guid and url as this is what we use later on to identify entries	2013-05-27 22:54:40 +02:00
Athou	6f96bd6df1	make sure the key is not null	2013-05-27 22:52:14 +02:00
Athou	6cc686ad03	lock on entry url	2013-05-27 22:43:08 +02:00
Athou	0b4682444f	feeds with http errors now bypass update queue	2013-05-27 16:58:02 +02:00
Athou	b6c331f067	display log error when lock fails	2013-05-27 16:41:29 +02:00
Athou	8f647a96e6	add more locks to the pool	2013-05-27 13:20:07 +02:00
Athou	8c45fc41ec	requeue feed immediatly if an entry fails to update	2013-05-27 12:16:37 +02:00
Athou	648923afb8	better log message	2013-05-27 11:46:23 +02:00
Athou	5b0c9e940b	first resolve absolute url then truncate	2013-05-27 11:44:14 +02:00
Athou	c0df050184	wait for lock for one minute, then timeout	2013-05-27 11:42:01 +02:00
Athou	475391c6a7	use weak references for lock keys	2013-05-27 11:37:38 +02:00
Athou	1ce2d854cb	queue size in metrics	2013-05-27 11:20:19 +02:00
Athou	db32c05689	use guava for lock handling	2013-05-27 10:44:43 +02:00
Athou	5124a092d3	build icon url server side	2013-05-26 15:36:55 +02:00
Athou	f04b24796c	resolve entry link when url is relative (fix #181)	2013-05-26 07:29:10 +02:00
Athou	02c0ef175d	make sure the guid fits in the database field	2013-05-25 18:45:24 +02:00
Athou	8adcd35cb4	increment feed update metric only when we actually update the feed	2013-05-25 15:39:54 +02:00
Athou	fdd845ca1e	set default values when importing	2013-05-25 13:08:11 +02:00
Athou	54aa6c8321	skip update queue if 304 not modified	2013-05-25 11:49:02 +02:00
Athou	9dc67ba6f9	handle all entry content sanity check at the same place	2013-05-25 00:21:00 +02:00
Athou	bb4ce2e0e4	remove predestroy responsability from startupbean	2013-05-24 16:50:00 +02:00
Athou	7b8d8d3f62	change log level	2013-05-24 12:51:39 +02:00
Athou	8039915bcf	shutdown pool when application stops	2013-05-24 12:28:48 +02:00
Athou	d148fa9df7	build disabledUntil date for feeds with support for http 304	2013-05-24 12:15:19 +02:00
Athou	6aebae56e6	Merge pull request #171 from Athou/jklm ... Use jkeylockmanager for entry update locking	2013-05-24 03:04:03 -07:00
Athou	4ba0ed4bf7	jklm initial implementation	2013-05-24 09:21:20 +02:00
Athou	c2b3992818	do some heavy work outside of the database transaction	2013-05-24 07:15:09 +02:00
Athou	89ffd89a31	wait for a spot in the queue when full	2013-05-23 16:52:50 +02:00
Athou	20a2c90241	truncate url if too long	2013-05-23 15:35:12 +02:00
Athou	dae85a2f48	more pubsub special cases handling	2013-05-23 13:02:56 +02:00
Athou	4935d4f1bc	make sure title fits in the database field	2013-05-23 12:15:00 +02:00
Athou	0d65471c83	actually set a capacity limit to the queue	2013-05-23 12:08:16 +02:00