DMG (Data transfer & archiving)takahiro.yamamoto - 21:06 Wednesday 13 August 2025 (34823)
Print this reportLack of GWF files on Kashiwa due to unstable DAQAs I reported in klog#34822, Frame Writers become unstable in recent a couple of days.
According to the `ls` command, GWF files at Kashiwa is copied from k1fw1 as primary. Missing frames on Kashiwa is same as ones on k1fw1 [full] 2025-08-12 13:41:34 UTC /data/KAGRA/raw/full/14390/K-K1_C-1439041312-32.gwf 2025-08-12 13:42:06 UTC /data/KAGRA/raw/full/14390/K-K1_C-1439041344-32.gwf
[science] 2025-08-12 13:41:34 UTC /data/KAGRA/raw/science/14390/K-K1_R-1439041312-32.gwf 2025-08-12 13:42:06 UTC /data/KAGRA/raw/science/14390/K-K1_R-1439041344-32.gwf
I wonder why they weren't filled automatically by resend process around 3am. Anyway they can be filled by using GWF files on k1fw0. (Because old full and science frames is deleted from the Kamioka spool after about 10 days, this process needs to be done within several days.)
And also, trend-frames are also copied from k1fw1 as primary accroding to comparison of file size. Following files were partially zero-filled during daqd was restarted. So it might be better to replace follwoing files as ones on k1fw0. [trend/second] /frame9/trend/second/14390/K-K1_T-1439041200-600.gwf
takahiro.yamamoto - 16:34 Thursday 14 August 2025 (34833)
Print this reportI made copy of GWF files on k1fw0 and k1fw1 during problematic time as ~takahiro.yamamoto/share/MissingFiles_klog34822. Permission of GWF files is set as 440 for takahiro.yamamoto:dmg.
All files on Kashiwa was sent from stream-1 (k1fw1, hyades-2). So missing files in full and science should be filled by ones on stream-0 (k1fw0, hyades-0). - share/MissingFiles_klog34822/k1fw0/full/14390/K-K1_C-1439041312-32.gwf - share/MissingFiles_klog34822/k1fw0/full/14390/K-K1_C-1439041344-32.gwf - share/MissingFiles_klog34822/k1fw0/science/14390/K-K1_R-1439041312-32.gwf - share/MissingFiles_klog34822/k1fw0/science/14390/K-K1_R-1439041344-32.gwf
Partially zero-filled files in second and minute trends copied from stream-1 should be replaced by ones on stream-0. - share/MissingFiles_klog34822/k1fw0/trend/second/14390/K-K1_T-1439041200-600.gwf - share/MissingFiles_klog34822/k1fw0/trend/minute/14390/K-K1_M-1439038800-3600.gwf
All other missing files were occurred on stream-0. So GWF files stored in Kashiwa aren't affected.
nobuyuki.kanda - 11:34 Friday 10 October 2025 (35307)
Print this reportThanks for the regeneration of missing frame data. We just copied files into common KAGRA data directory as below:
[daq@kagra-dsr-b1 14390]$ ls -lt /data/KAGRA/raw/full/14390/*.gwf |head -rwxr--r-- 1 daq dmg 467010478 Oct 10 10:51 /data/KAGRA/raw/full/14390/K-K1_C-1439041344-32.gwf -rwxr--r-- 1 daq dmg 467364017 Oct 10 10:51 /data/KAGRA/raw/full/14390/K-K1_C-1439041312-32.gwf
[daq@kagra-dsr-b1 14390]$ ls -lt /data/KAGRA/raw/science/14390/*.gwf |head -rwxr--r-- 1 daq dmg 155181931 Oct 10 10:57 /data/KAGRA/raw/science/14390/K-K1_R-1439041344-32.gwf -rwxr--r-- 1 daq dmg 155074657 Oct 10 10:57 /data/KAGRA/raw/science/14390/K-K1_R-1439041312-32.gwf
[daq@kagra-dsr-b1 14390]$ ls -lt /data/KAGRA/raw/trend/second/14390/*1439041200*.gwf* |head -rwxr--r-- 1 daq dmg 531471923 Oct 10 11:01 /data/KAGRA/raw/trend/second/14390/K-K1_T-1439041200-600.gwf -rw-r--r-- 1 daq dmg 474338895 Aug 12 22:50 /data/KAGRA/raw/trend/second/14390/K-K1_T-1439041200-600.gwf_partial-0-filled
[daq@kagra-dsr-b1 14390]$ ls -lt /data/KAGRA/raw/trend/minute/14390/*1439038800* |head -rwxr--r-- 1 daq dmg 289477572 Oct 10 11:30 /data/KAGRA/raw/trend/minute/14390/K-K1_M-1439038800-3600.gwf -rw-r--r-- 1 daq dmg 274716945 Aug 12 23:00 /data/KAGRA/raw/trend/minute/14390/K-K1_M-1439038800-3600.gwf_partial-0-filled