Test data of this setup
Test data of this setup
During this measurement, we found an extremely large coupling between the MN length and the TM pitch.
Efforts to reduce this coupling will be necessary.
The coupling factor will be estimated when we restart this work.
[Yuzu, YamaT]
a2A5328-4gmPRO camera was moved from a top plate of the fire alarm rack around OMC area to a top plate of k1boot in the server room (Fig.1).
It's now connected to the 10Gbps core switch directly. So a shortage of a bandwidth might be mitigated. (Even if so, we need to reconsider the system design of high resolution cameras. But we may be able to know one of requirements of that system from a change in the situation by difference in the connected switches.) Camera servers were already shut down for the planned power outage. So a test with the new configuration will be done after recovering from the power outage.
Today, we performed the shutdown operations for the Pcal at both end stations in response to the planned power outage.
First, we requested the SAFE state for the Pcal GRDs.
While the GRDs were transitioning to the SAFE state, and before turning off the laser output, we turned off the GRDs.
After confirming this, we turned off the laser output remotely.
Then, we shut down the following servers remotely:
calexacaleyalcaleyaNote: calexal was not shut down remotely due to the issue described in klog36479.
Note: For Pcal-Y, the QPD box was already powered off (no power supplied) before starting the shutdown procedure.
I went to the third reassembly of the broken FLDACCs. #5 folded pendulum block was replaced with #9 block (Picture #1). The assembled pendulum looks fine (Picture #2).
For the preparation of the planned power outage at the KAGRA site, I shutdowned the detchar computers located in the mine.
I found that when I reboot/turn off the calexal server, the laser source was turned ON! (The LPD shows ~7V)
Today, we will use the local interlock key to keep the laser OFF on site and turn OFF the server.
But, this issue should be clear for safety.
[Tanaka, Ushiba, Aso, Komori]
Abstract:
We began testing a new DARM hierarchical control scheme using only the MN and TM stages to suppress the RMS of the TM feedback signal and enable control with the low-power coil driver.
The filter tested in this trial caused high-frequency saturation in the ALS DARM state; therefore, further investigation and redesign are required.
Detail:
As described in a series of previous trials (klog:33176), we need to implement a new DARM hierarchical control scheme in which the RMS of the TM feedback signal is sufficiently reduced to allow replacement of the current high-power coil driver with a low-power one.
This replacement is crucial because the noise of the high-power coil driver is already subdominant in O4c, and we must transition to the low-power driver to further improve the detector sensitivity.
We revisited the previous trials and adopted a new approach in this study.
Our new approach uses only the MN and TM stages, as this configuration avoids the IM stage, whose actuation path includes a negative zero.
We designed a new open-loop transfer function using the MN and TM stages based on a theoretical multiple-pendulum model, as shown in Fig. 1.
The crossover frequency between the MN and TM stages is approximately 4 Hz.
Please note that the unity gain frequency (UGF) can be increased up to approximately 30 Hz at most, because the ALS DARM error signal is noisy and excessive bandwidth leads to saturation.
We successfully implemented the hierarchical transfer function as designed (Fig. 2).
However, we were unable to close the ALS DARM loop with this filter due to saturation at the MN stage.
The RMS of the current DARM feedback signal is dominated by noise around 30–40 Hz, as expected (Fig. 3).
The phase compensation filter, whose gain increases at higher frequencies, enhances the response in this band and leads to saturation around 30–40 Hz.
We will redesign the filter to mitigate this saturation in the near future.
In addition, another potential approach is to switch from the high-power coil driver with the conventional filter to the low-power driver with the new filter during the transition of the controlled TM between EX and EY after the handover to IR.
Since the IR signal is significantly quieter, we can maintain the UGF at around 100 Hz from the beginning.
This will make the implementation of the new filter more straightforward.
During this measurement, we found an extremely large coupling between the MN length and the TM pitch.
Efforts to reduce this coupling will be necessary.
The coupling factor will be estimated when we restart this work.
(Log for Friday's work)
To investigate the line noises and the low-frequency 1/f noise, whether they were actual magnetic field or sensing noise, I located the sensors at opposite direction (Y-direction) and checked their coherence and phase.
The spectrum shape is lmost the same for both channels.
There were large coherence (~1) for both the line noises and the low-frequency 1/f noise, and the phase was about 180 degree. So we can say these noises are actual magnetic field.
After these tests, I recoverd the sensor positions and directions to the original ones. (Hx for the X-direction, Hy for the Y-direction)
The FLDACCs for SRM moved back to the SR-OMC area from the BS area. I went to the second reassembly of the broken FLDACCs. #2 folded pendulum block was replaced with #8 block (Picture #1). The assembled pendulum looks fine (Picture #2).
Since newly added channels are not monitored by SDF, I started to monitor these channels as shown in fig1.
With Kenta Tanaka
We accepted SDFs caused by the works on klog36194.
[Takahashi, Ikeda]
We checked if the SDFs for VIS are 0. We attached MON flags to the SDFs that changed due to the model modification in SRM.
SDF of K1:IMC-SERVO_NPRO_TEMP_BIAS_OFFSET was changed from 5 of January.
Though laser work was conducted at that time (klog36019), there is no description on the laser temp bias changes and according to the working log, there seems no need to change temp bias.
So, I'm not so sure this change is related to this laser work.
Anyway, we confirmed IFO can be locked with the current EPICS values, I accepted the SDF shown in fig1.
[Miyoki]
The cleaning was done.
The water dropping above -X side of SRM continues. We put a wavy plastic plate and dust cloth to catch the water dropping. So we should be careful when the top curtain will be opened.
I tried using the a2A5328-4gmPRO camera while it was occupying k1cam1.
But high-resolution and/or high-bit-depth recording still failed.
So using dedicated camera server doesn't become a solution for this issue
And also, either an upgrade of the network capacity or an allocation of dedicated bandwidth seems to be necessary.
-----
Bottleneck investigation
To isolate a network capacity issue from a server capacity issue, I moved all acA640-120gm cameras to k1cam0 and k1cam2, then tested a2A5328-4gmPRO while k1cam1 exclusively occupied by it. But capturing high-resolution and/or high-bit-depth images was still failed. Increasing buffer size of NIC from 256kB to 4096kB (upper limit) by ethtool didn't change a situation. In this configuration, a25328-4gmPRO should be able to occupy 1Gbps band-width on the NIC of k1cam1. And also, this situation isn't probably improved by using 10GigE NIC for k1cam1 because NIC of a25328-4gmPRO is 1GbE.
These facts suggest that a current limitation is actual throughput of a network path which can be occupied by a2A5328-4gmPRO. (I haven't isolated just a bandwidth issue from buffer size issue of each network switch.) Current connection of the CAM network is shown in Fig.1. Though the core camera switch in the server room on which all traffic concentrates is 10GigE one, edge switches except at IOO and connections are 1GbE. (Because all cameras in the corner station were connected from IOO rack in the past, only the edge switch at IOO is 10GigE one.) acA640-120gm which is main cameras for KAGRA GigE system is used with 640x480 as resolution, 8bit depth (Mono8) and 25fps. So ~60Mbps per 1 camera is required and 1Gbps bandwidth is enough to stably use 12-13 cameras (corresponding to ~70% of full bandwidth) and managing 18 cameras with 2 camera servers and one 10GigE core switch is sufficient.
a2A5328-4gmPRO is designed as using almost full width of 1Gbps to send caputured images (It's natural behavior because if bandwidth is limited as slower than 1Gbps, a risk of a connection time-out increases for high-resolution cameras such as a2A5328-4gmPRO.) So sharing bandwidth of 1GbE with another devices is not proper configuration for a2A5328-4gmPRO. If network paths will be shared, the CAM network should be upgraded to 10GigE for at least the shared paths with a2A5328-4gmPRO. Another solution is connecting a2A5328-4gmPRO to the core switch in the server room directly. But it may be more tough work than preparing a dedicated TCam server physically near a2A5328-4gmPRO.
Simple camera server application for a2A5328-4gmPRO
To capture images easily for this investigation, I prepared a simple camera server application as /kagra/camera/test-a2A5328-4gmPRO/test_CameraServer.py. It runs on one of camera servers (currently k1cam1) and listens various requests from CDS-workstations via the client application as /kagra/camera/test-a2A5328-4gmPRO/test_CameraClient.py. Because this server application keeps a connection to camera devices (keeping camera.Open()) same as camlan- and pylon-camera-server, this server application must be stopped before another applications connect to same camera devices. This application is now managed by the systemd in the user slice. So it can be stopped by a following command on k1cam1.
> systemctl --user stop test_CameraServer.service
2 FFUS were recoverd above SRM by reconnecting power/line cables near FFUs. 1FFU above SR3 and OMMT was still off maybe because of power/signal line disconnection.
Wrapped stainless steal floors near SR2 and SRM were repaired.
[Miyoki]
The Fujimi-sangyou member found a huge water pool on the ceiling just above the -X side of the SRM vacuum tanks. (Maybe Hayakawa-kun also noticed well before) (Photo.1)
Although the water drain pipe was set just around this pool, there seems to be no water flow in this drain pipe, maybe because something is stuck at some point. So we tried to drain this water along some possible paths by pushing up the water pool with several T-bars. Fortunately, about 70% water could be drained out. (Photo.2) We need to fix this drain system while the amount of water is small.
2 FFUS were recoverd above SRM by reconnecting power/line cables near FFUs. 1FFU above SR3 and OMMT was still off maybe because of power/signal line disconnection.
Wrapped stainless steal floors near SR2 and SRM were repaired.
[Hayakawa, Uchiyama, Takahashi-m, Sawada, Yamaguchi, Takahashi-r]
Fujimi-sangyo started cleaning of the SR-OMC area.