TY - JOUR
T1 - Overview of KAGRA
T2 - Data transfer and management
AU - KAGRA collaboration
AU - Akutsu, T.
AU - Ando, M.
AU - Arai, K.
AU - Arai, Y.
AU - Araki, S.
AU - Araya, A.
AU - Aritomi, N.
AU - Asada, H.
AU - Aso, Y.
AU - Bae, S.
AU - Bae, Y.
AU - Baiotti, L.
AU - Bajpai, R.
AU - Barton, M. A.
AU - Cannon, K.
AU - Cao, Z.
AU - Capocasa, E.
AU - Chan, M.
AU - Chen, C.
AU - Chen, K.
AU - Chen, Y.
AU - Chiang, C. Y.
AU - Chu, H.
AU - Chu, Y. K.
AU - Eguchi, S.
AU - Enomoto, Y.
AU - Flaminio, R.
AU - Fujii, Y.
AU - Fujikawa, Y.
AU - Fukunaga, M.
AU - Fukushima, M.
AU - Gao, D.
AU - Ge, G.
AU - Ha, S.
AU - Hagiwara, A.
AU - Haino, S.
AU - Han, W. B.
AU - Hasegawa, K.
AU - Hattori, K.
AU - Hayakawa, H.
AU - Hayama, K.
AU - Himemoto, Y.
AU - Hiranuma, Y.
AU - Hirata, N.
AU - Hirose, E.
AU - Hong, Z.
AU - Hsieh, B.
AU - Huang, G. Z.
AU - Huang, H. Y.
AU - Lin, F. L.
N1 - Publisher Copyright:
© 2023 The Author(s). Published by Oxford University Press on behalf of the Physical Society of Japan.
PY - 2023/10/1
Y1 - 2023/10/1
N2 - KAGRA is a newly built gravitational wave observatory, a laser interferometer with a 3 km arm length, located in Kamioka, Gifu prefecture, Japan. In this article, we describe the KAGRA data management system, i.e., recording of data, transfer from the KAGRA experiment site to computing resources, as well as data distribution to tier sites, including international sites in Taiwan and Korea. The amount of KAGRA data exceeded 1.0 PiB and increased by about 1.5 TB per day during operation in 2020. Our system has succeeded in data management, and has achieved performance that can withstand observations after 2023, that is, a transfer rate of 20 MB s-1 or more and file storage of sufficient capacity for petabyte class. We also discuss the sharing of data between the global gravitational-wave detector network with other experiments, namely LIGO and Virgo. The latency, which consists of calculation of calibrated strain data and transfer time within the global network, is very important from the view of multi-messenger astronomy using gravitational waves. Real-time calbrated data delivered from the KAGRA detector site and other detectors to our computing system arrive with about 4-15 seconds of latency. These latencies are sufficiently short compared to the time taken for gravitational wave event search computations. We also established a high-latency exchange of offline calibrated data that was aggregated with a better accuracy compared with real-time data.
AB - KAGRA is a newly built gravitational wave observatory, a laser interferometer with a 3 km arm length, located in Kamioka, Gifu prefecture, Japan. In this article, we describe the KAGRA data management system, i.e., recording of data, transfer from the KAGRA experiment site to computing resources, as well as data distribution to tier sites, including international sites in Taiwan and Korea. The amount of KAGRA data exceeded 1.0 PiB and increased by about 1.5 TB per day during operation in 2020. Our system has succeeded in data management, and has achieved performance that can withstand observations after 2023, that is, a transfer rate of 20 MB s-1 or more and file storage of sufficient capacity for petabyte class. We also discuss the sharing of data between the global gravitational-wave detector network with other experiments, namely LIGO and Virgo. The latency, which consists of calculation of calibrated strain data and transfer time within the global network, is very important from the view of multi-messenger astronomy using gravitational waves. Real-time calbrated data delivered from the KAGRA detector site and other detectors to our computing system arrive with about 4-15 seconds of latency. These latencies are sufficiently short compared to the time taken for gravitational wave event search computations. We also established a high-latency exchange of offline calibrated data that was aggregated with a better accuracy compared with real-time data.
UR - http://www.scopus.com/inward/record.url?scp=85179357382&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85179357382&partnerID=8YFLogxK
U2 - 10.1093/ptep/ptad112
DO - 10.1093/ptep/ptad112
M3 - Article
AN - SCOPUS:85179357382
SN - 2050-3911
VL - 2023
JO - Progress of Theoretical and Experimental Physics
JF - Progress of Theoretical and Experimental Physics
IS - 10
M1 - 10A102
ER -