You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
24 lines
1.9 KiB
24 lines
1.9 KiB
# Data Compression
|
|
|
|
* :scroll: [Data Compression](data-compression.pdf)
|
|
|
|
> This paper surveys a variety of data compression methods spanning almost 40 years of research, from the work of Shannon, Fano and Huffman in the 40's, to a technique developed in 1986.
|
|
|
|
## Scientific Data Compression
|
|
|
|
* :scroll: [Fast Error-bounded Lossy HPC Data Compression with SZ](fast_error_bounded_Lossy_hpc_data_compression_with_sz.pdf)
|
|
|
|
> This is the first version of SZ. In this paper, SZ is introduced to achieve data reduction using regression-based data point prediction.
|
|
|
|
* :scroll: [Significantly Improving Lossy Compression for Scientific Data Sets Based on Multidimensional Prediction and Error-Controlled Quantization](Significantly_Improving_Lossy_Compression_for_Scientific_Data_Sets_Based_on_Multidimensional_Prediction_and_Error-Controlled_Quantization.pdf)
|
|
|
|
> This work is known as SZ-1.4. In this work, SZ employs multi-dimensional data prediction so that data with dimension larger than 1 is no longer linearized into single dimension before compression. In this way, more data locality is preserved thus compression ratio is improved.
|
|
|
|
* :scroll: [Error-Controlled Lossy Compression Optimized for High Compression Ratios of Scientific Datasets](Error-Controlled_Lossy_Compression_Optimized_for_High_Compression_Ratios_of_Scientific_Datasets.pdf)
|
|
|
|
> This work is known as SZ-2.0. In this work, authors proposed an online selection tool between 2 predictors, the mean-integrated Lorenzo predictor and linear regression-based predictor. Users can choose the predictor that yields larger compression ratio with higher prediction accuracy.
|
|
|
|
* :scroll: [Fixed-Rate Compressed Floating-Point Arrays](fixed-rate_compressed_floating_point_arrays.pdf)
|
|
|
|
* :scroll: [FPC: A High-Speed Compressor for Double-Precision Floating-Point Data](fpc_a_high_speed_compressor_for_double_precision_floating_point_data.pdf)
|