195 Commits

Author	SHA1	Message	Date
Athou	27804db165	make sure the entry has been updated	2013-06-07 15:54:47 +02:00
Athou	6bce9eb8ac	make sure the feed was not in error before using its last disabled date	2013-06-06 12:20:20 +02:00
Athou	be6db080fd	hibernate tweaks	2013-06-06 09:54:17 +02:00
Athou	5661b00c9b	reuse previous disabled period if available	2013-06-06 08:45:55 +02:00
Athou	dbe7b48a04	merge push infos into feeds	2013-06-05 21:50:26 +02:00
Athou	39f1a19c14	removed as it in fact hurts perfs	2013-06-05 18:37:24 +02:00
Athou	87d3cb6c34	handle entries with no title	2013-06-04 15:11:35 +02:00
Athou	1445486d4b	tweaking for feeds returning 304	2013-06-04 13:50:23 +02:00
Athou	502938a1df	refresh pubsubhubbub subscriptions every three days	2013-06-03 06:50:36 +02:00
Athou	4ba2f5dbd9	moving some code around	2013-06-02 19:44:25 +02:00
Athou	a3cc4ee269	use title if content is empty for rtl detection	2013-06-02 19:42:25 +02:00
Ebrahim Byagowi	c1d5c699a2	Some improvments for having better support for RTL/BiDi contents	2013-06-02 20:53:41 +01:00
Athou	4e7bcd004d	make sure we have content	2013-05-31 09:31:59 +02:00
Athou	d0e37af52b	keep text only before detecting direction, use jsoup because bidiutils html stripping is too restrictive	2013-05-31 09:28:51 +02:00
Athou	9568ccfeac	experimental rtl support (#209)	2013-05-31 08:23:30 +02:00
Athou	ca82c3c369	make sure we have something to filter	2013-05-30 18:58:54 +02:00
Athou	2bd89f8238	filter list if not too large only	2013-05-30 15:26:39 +02:00
Athou	f9e9010545	revert to old factor	2013-05-30 15:23:07 +02:00
Athou	a2f28f2565	reduce factor to 2 for heavy load	2013-05-30 14:56:03 +02:00
Athou	7df071b023	use all timestamps available to build average time	2013-05-30 13:58:37 +02:00
Athou	2ba1614f1d	filter out old entries	2013-05-30 13:51:18 +02:00
Athou	63349d6e14	small refactoring	2013-05-30 13:18:26 +02:00
Athou	47b9f49831	make sure we have something to do before entering synchronized block	2013-05-30 12:57:14 +02:00
Athou	4da9fca7ea	Revert for the moment as it breaks pubsub handling	2013-05-30 11:55:15 +02:00
Athou	0aee6850d5	use a onetomany relationship for push info to avoid hibernate automatic lazy loading of onetoone optional relationships	2013-05-30 10:28:40 +02:00
Athou	145285dd20	handle entry content only if the entry is new	2013-05-29 16:42:45 +02:00
Athou	ed18bc55b7	fix opml export not showing head and title	2013-05-29 16:37:22 +02:00
Athou	5dad786802	no guid and no link, skip entry	2013-05-28 21:53:58 +02:00
Athou	23c243c8ac	remove potential duplicates	2013-05-28 13:01:02 +02:00
Athou	f832374087	disable feeds up to a week	2013-05-28 09:20:44 +02:00
Athou	e43ec5c2f4	actually use both guid and url as this is what we use later on to identify entries	2013-05-27 22:54:40 +02:00
Athou	6f96bd6df1	make sure the key is not null	2013-05-27 22:52:14 +02:00
Athou	6cc686ad03	lock on entry url	2013-05-27 22:43:08 +02:00
Athou	0b4682444f	feeds with http errors now bypass update queue	2013-05-27 16:58:02 +02:00
Athou	b6c331f067	display log error when lock fails	2013-05-27 16:41:29 +02:00
Athou	8f647a96e6	add more locks to the pool	2013-05-27 13:20:07 +02:00
Athou	8c45fc41ec	requeue feed immediatly if an entry fails to update	2013-05-27 12:16:37 +02:00
Athou	648923afb8	better log message	2013-05-27 11:46:23 +02:00
Athou	5b0c9e940b	first resolve absolute url then truncate	2013-05-27 11:44:14 +02:00
Athou	c0df050184	wait for lock for one minute, then timeout	2013-05-27 11:42:01 +02:00
Athou	475391c6a7	use weak references for lock keys	2013-05-27 11:37:38 +02:00
Athou	1ce2d854cb	queue size in metrics	2013-05-27 11:20:19 +02:00
Athou	db32c05689	use guava for lock handling	2013-05-27 10:44:43 +02:00
Athou	5124a092d3	build icon url server side	2013-05-26 15:36:55 +02:00
Athou	f04b24796c	resolve entry link when url is relative (fix #181)	2013-05-26 07:29:10 +02:00
Athou	02c0ef175d	make sure the guid fits in the database field	2013-05-25 18:45:24 +02:00
Athou	8adcd35cb4	increment feed update metric only when we actually update the feed	2013-05-25 15:39:54 +02:00
Athou	fdd845ca1e	set default values when importing	2013-05-25 13:08:11 +02:00
Athou	54aa6c8321	skip update queue if 304 not modified	2013-05-25 11:49:02 +02:00
Athou	9dc67ba6f9	handle all entry content sanity check at the same place	2013-05-25 00:21:00 +02:00