Nuclear Techniques ›› 2020, Vol. 43 ›› Issue (7): 70202-070202.doi: 10.11889/j.0253-3219.2020.hjs.43.070202

• ACCELERATOR, RAY TECHNOLOGY AND APPLICATIONS • Previous Articles     Next Articles

Development of data archiving and retrieval system for HLS-II based on HBase

Shangcong XIN,Xiaokang SUN,Chuan LI,Ke XUAN,Gongfa LIU()   

  1. National Synchrotron Radiation Laboratory, University of Science and Technology of China, Hefei 230029, China
  • Received:2019-02-10 Revised:2019-04-06 Online:2020-07-15 Published:2020-07-16
  • Contact: Gongfa LIU E-mail:gfliu@ustc.edu.cn
  • About author:XIN Shangcong, male, born in 1994, graduated from Southwest University of Science and Technology in 2017, master student, focusing on accelerator control technology
  • Supported by:
    Key R & D Project of Hefei Science Center, Chinese Academy of Sciences(2019HSC-KPRD003)

Abstract: Background

HLS-II is a dedicated synchrotron radiation source with featured spectrum in vacuum ultraviolet and soft X-rays regions. The retrieval speed of the HLS-II historical data is critical for the performance analysis and fault diagnosis.

Purpose

This study aims to develop a HBase-based data archiving and retrieval system (HDARS) to improve the retrieval speed of HLS-II historical data.

Methods

A data extraction algorithm was designed to extract characteristic data from raw data with the different time granularities when HDARS was archiving data. The raw data and characteristic data were stored in the HBase raw data table and redundant data table, respectively. When querying long-term historical data, the proper time granularity was calculated by HDARS according to the time range of the query. Then, the characteristic data with this granularity in the redundant table were retrieved and returned.

Results

The system has been working stably since it was brought into operation. It responds to the query requests in any time range within 1 s.

Conclusions

HDARS meets all needs of HLS-II historical data query, completely solves the problem of slow retrieval of long-term historical data at a cost of small additional redundant storage space.

Key words: HLS-II, Data archiving, Data retrieval, HBase, Data extraction algorithm, Redundant storage

CLC Number: 

  • TL503.6