82 Commits

Author	SHA1	Message	Date
Athou	2af55553a2	return to async beans, jms is too much overhead atm	2013-04-25 17:26:07 +02:00
Athou	9ee2f60e03	small tweaks	2013-04-25 15:04:41 +02:00
Athou	735c2efb34	queue feed for refresh after a subscription	2013-04-25 14:41:56 +02:00
Athou	effa009241	new fetchedfeed class	2013-04-25 12:30:21 +02:00
Athou	b767980fe5	import using small database transactions, not a huge one with the whole OPML in it, prevents long table lock	2013-04-24 05:13:06 +02:00
Athou	5bba598b2e	allows http threads to continue their job by asynchronously queuing database updates	2013-04-23 21:16:30 +02:00
Athou	c71b0aee96	don't batch refresh more than 100 feeds	2013-04-23 16:00:18 +02:00
Athou	83946373d9	use a constant instead	2013-04-23 15:58:56 +02:00
Athou	5c4df4e451	handle background threads ourselves, leave the stateless pool intact	2013-04-23 10:51:05 +02:00
Athou	24198689a5	properly detect invalid characters	2013-04-23 09:40:13 +02:00
Athou	8500589943	combine all characters stripping in one place	2013-04-23 09:31:02 +02:00
Athou	92e76d469f	check for nulls before querying the database	2013-04-23 09:06:35 +02:00
Athou	64747881de	detect encoding and trim invalid characters before parsing xml (#60)	2013-04-23 07:20:21 +02:00
Athou	fbba5dce16	completely disable transactions for background threads	2013-04-22 18:02:57 +02:00
Athou	8376b69f25	prevent NPE	2013-04-22 17:56:30 +02:00
Athou	faaf18f5cf	trim unicode characters from url if any	2013-04-22 13:20:17 +02:00
Athou	839beb5d14	small optimizations	2013-04-22 10:23:53 +02:00
Athou	bb5d76109a	Integer.MAX_VALUE is actually the maximum value in seconds, construct date with milliseconds (#56)	2013-04-22 09:05:04 +02:00
Athou	d28c74ea25	use a default date instead of null	2013-04-21 23:07:19 +02:00
Athou	0204dadc3f	make sure dates are in an acceptable interval	2013-04-21 16:56:09 +02:00
Athou	d4fa817983	import opml asynchronously	2013-04-21 12:39:10 +02:00
Athou	7502707930	check if the feed has changed by using publishDate of the feed or the first entry	2013-04-19 12:53:25 +02:00
Athou	a4a7f6389c	faster way of extracting declared encoding	2013-04-19 09:36:58 +02:00
Athou	db8fc29d4f	don't update the database if the feed didn't change	2013-04-18 13:22:59 +02:00
Athou	ef3508f393	speed feeds refresh up by using http headers	2013-04-17 12:52:17 +02:00
Athou	8343434882	remove circular dependency	2013-04-17 07:57:43 +02:00
Athou	af4e294a0c	log feed url in message when available	2013-04-16 14:57:36 +02:00
Athou	743b389808	initial metrics system	2013-04-16 13:52:20 +02:00
Athou	94251d2be7	ability to queue a feed for refresh	2013-04-16 12:50:41 +02:00
Athou	11a9d68948	transaction not needed	2013-04-16 10:53:56 +02:00
Athou	852f834377	api tweak	2013-04-16 10:42:34 +02:00
Athou	b6d8072090	smarter way of stopping things	2013-04-16 09:29:33 +02:00
Athou	b9fbf0fdf3	force a feed refresh when someone subscribes	2013-04-16 07:30:23 +02:00
Athou	c35363a8cb	just log the error and go on	2013-04-15 22:46:41 +02:00
Athou	f8faa69f02	remove serializable as it does not make sense	2013-04-15 11:47:48 +02:00
Athou	0da3ce1bc5	scale based on number of background threads	2013-04-15 10:50:25 +02:00
Athou	5be7c487ad	optimizations	2013-04-14 18:51:12 +02:00
Athou	86edd54a21	index hashes	2013-04-14 18:28:48 +02:00
Athou	6217f236fa	avoid an extra database roundtrip	2013-04-14 18:12:35 +02:00
Athou	b3465f33c1	cancel threads when application stops/restarts	2013-04-13 11:41:33 +02:00
Athou	c41c4fe8b9	forgot to refresh lastUpdate field	2013-04-13 10:13:41 +02:00
Athou	544ebb8e86	injetions cleanup	2013-04-13 09:17:38 +02:00
Athou	281ff6d883	smarter way of getting the next feed to update	2013-04-13 07:02:59 +02:00
Athou	9d7c6b17c0	don't stop the worker, just log the exception and go on	2013-04-13 06:39:12 +02:00
Athou	5b5ad242e0	major classes refactoring	2013-04-11 20:49:08 +02:00
Athou	54ebf7b9db	more threads	2013-04-11 19:35:16 +02:00
Athou	4b49625a8f	better background refresh	2013-04-11 19:11:27 +02:00
Athou	70b6fd1fd3	disable feeds for a little bit when unable to refresh the feed several times in a row	2013-04-11 16:50:20 +02:00
Athou	36a9a7a795	format message	2013-04-11 12:57:21 +02:00
Athou	25dd0aab51	propagate exceptions	2013-04-11 12:50:41 +02:00