109 Commits

Author	SHA1	Message	Date
Athou	6cfa275aa1	sleep initially for one minute before starting threads	2013-05-21 12:57:07 +02:00
Athou	23240f2c93	small optimizations	2013-05-21 12:41:57 +02:00
Athou	36e39b8c75	delay based on heavy load setting	2013-05-21 10:44:05 +02:00
Athou	9c9a315d1c	settings for heavy load	2013-05-21 08:46:14 +02:00
Athou	304218265f	pubsubhubbub support is now optional	2013-05-21 07:09:48 +02:00
Athou	185df1d3d7	change log level for some logging lines	2013-05-20 18:12:11 +02:00
Athou	c88d3021b8	initial pubsubhubbub support (#44)	2013-05-20 17:44:38 +02:00
Athou	badc830535	use the first entry date as publish date	2013-05-20 12:37:37 +02:00
Athou	72e3507006	disable incrementally by one hour every time the feed fails to download (#44)	2013-05-20 11:57:45 +02:00
Athou	c5147360d8	sort timestamps desc (#44)	2013-05-20 11:47:54 +02:00
Athou	eea6d9855a	typo	2013-05-20 11:22:32 +02:00
Athou	b11fd7897d	first try at #44	2013-05-20 11:19:30 +02:00
Athou	b2ee06d94a	handle iso-8859-2 (#138)	2013-05-19 21:51:26 +02:00
Athou	0e22489d08	set feed exceptions to debug level	2013-05-19 17:08:57 +02:00
Athou	df52dcd748	utility method to calculate average time between entries	2013-05-19 12:54:39 +02:00
Athou	d4d95e741f	force feed refresh if updated more than ten minutes ago	2013-05-19 12:11:54 +02:00
Athou	f59198e018	persist entry author	2013-05-19 06:47:37 +02:00
Athou	a6e969fadc	disallow align for images and display them as blocks	2013-05-17 21:14:17 +02:00
Athou	680b0551fc	allow some table styling	2013-05-17 15:57:56 +02:00
Athou	11632286bf	fix #113	2013-05-17 14:33:21 +02:00
Athou	d31ba48507	skip characters until the xml actually starts	2013-05-02 08:59:47 +02:00
Athou	30cf80e4f5	api method to export opml (#64)	2013-04-28 09:19:27 +02:00
Athou	fe3ccb92df	disable a feed up to 12 hours	2013-04-27 11:12:05 +02:00
Athou	af821662cf	intercept empty feed early on	2013-04-27 11:03:47 +02:00
Athou	afcfebdc36	that check is not reliable	2013-04-27 10:49:15 +02:00
Athou	56ba907ec5	only allow one thread to update entries for a feed, avoids duplicates if two feeds containing the same entry are updating at the same time	2013-04-26 18:53:48 +02:00
Athou	69e9d05e0b	warn if we are unable to parse xml, debug otherwise (timeout, ...)	2013-04-25 17:28:08 +02:00
Athou	2af55553a2	return to async beans, jms is too much overhead atm	2013-04-25 17:26:07 +02:00
Athou	9ee2f60e03	small tweaks	2013-04-25 15:04:41 +02:00
Athou	735c2efb34	queue feed for refresh after a subscription	2013-04-25 14:41:56 +02:00
Athou	effa009241	new fetchedfeed class	2013-04-25 12:30:21 +02:00
Athou	b767980fe5	import using small database transactions, not a huge one with the whole OPML in it, prevents long table lock	2013-04-24 05:13:06 +02:00
Athou	5bba598b2e	allows http threads to continue their job by asynchronously queuing database updates	2013-04-23 21:16:30 +02:00
Athou	c71b0aee96	don't batch refresh more than 100 feeds	2013-04-23 16:00:18 +02:00
Athou	83946373d9	use a constant instead	2013-04-23 15:58:56 +02:00
Athou	5c4df4e451	handle background threads ourselves, leave the stateless pool intact	2013-04-23 10:51:05 +02:00
Athou	24198689a5	properly detect invalid characters	2013-04-23 09:40:13 +02:00
Athou	8500589943	combine all characters stripping in one place	2013-04-23 09:31:02 +02:00
Athou	92e76d469f	check for nulls before querying the database	2013-04-23 09:06:35 +02:00
Athou	64747881de	detect encoding and trim invalid characters before parsing xml (#60)	2013-04-23 07:20:21 +02:00
Athou	fbba5dce16	completely disable transactions for background threads	2013-04-22 18:02:57 +02:00
Athou	8376b69f25	prevent NPE	2013-04-22 17:56:30 +02:00
Athou	faaf18f5cf	trim unicode characters from url if any	2013-04-22 13:20:17 +02:00
Athou	839beb5d14	small optimizations	2013-04-22 10:23:53 +02:00
Athou	bb5d76109a	Integer.MAX_VALUE is actually the maximum value in seconds, construct date with milliseconds (#56)	2013-04-22 09:05:04 +02:00
Athou	d28c74ea25	use a default date instead of null	2013-04-21 23:07:19 +02:00
Athou	0204dadc3f	make sure dates are in an acceptable interval	2013-04-21 16:56:09 +02:00
Athou	d4fa817983	import opml asynchronously	2013-04-21 12:39:10 +02:00
Athou	7502707930	check if the feed has changed by using publishDate of the feed or the first entry	2013-04-19 12:53:25 +02:00
Athou	a4a7f6389c	faster way of extracting declared encoding	2013-04-19 09:36:58 +02:00