您好,欢迎来到中国测试科技资讯平台!

首页> 《中国测试》期刊 >本期导读>面向监测数据压缩的自适应SDT算法

面向监测数据压缩的自适应SDT算法

2866    2017-03-09

免费

全文售价

作者:张宗华1, 叶志佳2, 牛新征2

作者单位:1. 国家电网公司北京电力医院信息通讯部, 北京 100073;
2. 电子科技大学计算机科学与工程学院, 四川 成都 611731


关键词:数据压缩;旋转门算法;平滑处理;自适应调整


摘要:

为降低IT运维系统的实时监测数据量、提高数据存储效率,提出一种自适应的旋转门算法(adaptive swinging door trending,ASDT)。针对传统SDT算法存在抗噪性弱、参数选取困难等缺陷,ASDT首先通过最小二乘平滑处理,减小噪声数据对SDT趋势判断的影响;然后通过改进死区限值过滤算法,对经平滑处理后的数据进行压缩;最后基于相邻压缩区间标准差变化,自适应调整压缩精度参数。实验结果表明:在保证数据保真度的前提下,ASDT的仿真数据和真实数据上的压缩比分别提高60%和24%以上。


Adaptive SDT algorithm for monitoring data compression

ZHANG Zonghua1, YE Zhijia2, NIU Xinzheng2

1. Ministry of Information and Communication, Beijing Electric Power Hospital, State Grid Corporation of China, Beijing 100073, China;
2. School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China

Abstract: To reduce the amount of monitoring data of IT operation and maintenance system and improve the efficiency of data storage, an adaptive SDT algorithm named adaptive swinging door trending(ASDT) was proposed. To address problems such as the weak resistance to noise and the difficulty of parameter selection of traditional SDT algorithm, ASDT firstly adopts least-squares to smooth the original data to reduce the influence of noise to SDT trend judgment; then, it combines with improved boxcar-back slope algorithm to compress the data after smoothing; finally, it adjusts the parameters of compression accuracy adaptively based on the changes of standard deviation of adjacent interval. Results of experiments conducted on the simulation data and real data show that on the premise of guaranteeing the data fidelity, ASDT's compression ratio is increased by over 60% and 24% respectively.

Keywords: data compression;SDT algorithm;smoothing;adaptive adjustment

2017, 43(2): 104-108  收稿日期: 2016-06-17;收到修改稿日期: 2016-07-20

基金项目: 国家自然科学基金项目(61300192);中央高校基本科研业务费项目(ZYGX2014J052);北京电力医院一体化运维监控与管理项目(HW2015000759)

作者简介: 张宗华(1977-),男,四川成都市人,工程师,硕士,研究方向为电力信息化研究与建设。

参考文献

[1] 韩学奇,王锋. IT运维数据展示系统的研究和实现[J]. 计算机科学,2012,39(S2):232-235.
[2] NING J, WANG J, GAO W, et al. A Wavelet-based data compression technique for smart grid[J]. IEEE Transactions on Smart Grid,2011,2(1):212-218.
[3] BRISABOA N R, CANOVAS R, CLAUDE F, et al. Compressed string dictionaries[J]. Computer Science,2011(6630):136-147.
[4] KAVOUSIANOS X, KALLIGEROS E, NIKOLOS D. Optimal selective huffman coding for test-data compression[J]. IEEE Transactions on Computers,2007,56(8):1146-1152.
[5] BRISTOL E H. Swinging door trending: adaptive trend recording[C]//Proceedings of the ISA National Conference. New York:ISA,1990:749-753.
[6] ZHANG F, CHENG L, LI X, et al. Application of a real-time data compression and adapted protocol technique for WAMS[J]. IEEE Transactions on Power Systems,2015,30(2):653-662.
[7] 于松涛,王晓琨,赵利强,等. 基于容差动态调整的旋转门(SDT)改进算法[J]. 北京化工大学学报(自然科学版),2013,40(3):109-113.
[8] 马发勇,厉启鹏,马志斌,等. 电力调度SCADA系统中历史数据压缩及存储策略[J]. 电网技术,2014,38(4):1109-1114.
[9] 韦玉春,王国祥,程春梅. 水面光谱数据的核回归平滑去干扰分析[J]. 南京师范大学学报(自然科学版),2010,33(3):97-102.
[10] 杨正举,刘洛琨,钱学锋,等. 基于最小二乘平滑算法的时变信道盲辨识[J]. 计算机工程与设计,2013,34(1):59-65.
[11] LI X, LI Y, HAN X, et al. Application of fuzzy wavelet transform to smooth Wind/PV hybrid power system output with battery energy storage system[J]. Energy Procedia,2011,12(39):994-1001.
[12] 徐慧. 实时数据库中数据压缩算法的研究[D]. 杭州:浙江大学,2006.
[13] 曲奕霖,王文海. 用于过程数据压缩的自控精度SDT算法[J]. 计算机工程,2010,36(22):40-42.
[14] 宁海楠. 一种基于SDT算法的新的过程数据压缩算法[J].计算机技术与发展,2010,20(1):25-28.
[15] MathWorks中国. Generate white Gaussian noise-Matlab wgn[EB/OL].http://cn.mathworks.com/help/comm/ref/wgn.html?searchHighlight=wgn,2016.