OPS: Sergey Rostopchin / Nathan McReynolds HET released for OPS at 2024-04-28 23:01:07 UT SUMMARY: Issue with PFIP hardware (see PR 6323) which was solved by restarting PFIP server. All other is good. Calibrations: HPF cals ETA Start time 23:39 UT PartA 00:22 UT PartC 01:08 UT at jobs check @ 2024-04-28 23:40:58 #1209 scheduled @ 2024-04-29 00:22 cal lrs2 -l qth ldls_long cd-a fear hg cal virus -l ldls_long cd-a hg cal virus -pd -de 360 -d 3 V/L cals ETA LRS2 00:48 UT VIRUS 01:07 UT V/L PARALLEL DARKS 01:29 UT Sunset tonight 01:40 UT Still needed cals: V/L PARALLEL BIASES ========================================================================================= QUEUE STATE 2024-04-28 23:00:24 Checked for new target submissions and update 2024-04-28 23:00:24 New allocation(s) has been accepted and PIs settings were updated 2024-04-28 23:01:00 Ran the queue updates 2024-04-28 23:01:47 OCD targets for 2460429.51 +-------------+----------------------+-------+-------+--------+-------+-----+ | UT | Field | QIDX | PIpri | Az | illum | Pri | +-------------+----------------------+-------+-------+--------+-------+-----+ | 03:00-03:25 | DEXsp2685 | 892 | 51 | 47.0 | 52.3 | 0 | | 03:28-03:53 | DEXsp2696 | 897 | 51 | 47.0 | 55.7 | 0 | | 03:53-04:18 | DEXsp2899 | 1006 | 51 | 47.0 | 55.6 | 0 | | 04:18-04:43 | DEXsp3160 | 1143 | 51 | 47.0 | 55.6 | 0 | | 04:43-05:08 | DEXsp3503 | 1235 | 51 | 47.0 | 55.6 | 0 | | 05:08-05:33 | DEXsp6936 | 1447 | 51 | 47.0 | 55.6 | 0 | | 05:33-05:58 | DEXsp6217 | 1305 | 51 | 47.0 | 55.6 | 0 | | 05:58-06:23 | DEXsp6385 | 1320 | 51 | 47.0 | 48.1 | 0 | +-------------+----------------------+-------+-------+--------+-------+-----+ Non-HETDEX targets +-----+------------+---------------+-----+-------+-------+----------+---------+ | idx | program | object | pri | Eopt | Wopt | sky | syndate | +-----+------------+---------------+-----+-------+-------+----------+---------+ | 568 | UT24-2-003 | VDFI_EGS_C3.4 | 0 | 03:45 | -- | 21.5 / S | | | 569 | UT24-2-003 | VDFI_EGS_D1.4 | 0 | 03:45 | -- | 21.5 / S | | | 570 | UT24-2-003 | VDFI_EGS_D3.4 | 0 | 03:45 | -- | 21.5 / S | | | 564 | UT24-2-003 | VDFI_EGS_A3.4 | 0 | 03:45 | -- | 21.5 / S | | | 566 | UT24-2-003 | VDFI_EGS_B3.4 | 0 | 03:45 | -- | 21.5 / S | | | 687 | UT24-2-006 | J1427+2632_p5 | 0 | -- | 09:18 | 21.5 / S | | | 688 | UT24-2-006 | J1427+2632_p5 | 0 | -- | 09:18 | 21.5 / S | | | 689 | UT24-2-006 | J1427+2632_p6 | 0 | -- | 09:18 | 21.5 / S | | | 690 | UT24-2-006 | J1427+2632_p6 | 0 | -- | 09:18 | 21.5 / S | | | 691 | UT24-2-006 | J1552+5705_p3 | 0 | -- | 10:17 | 21.5 / S | | | 692 | UT24-2-006 | J1552+5705_p3 | 0 | -- | 10:17 | 21.5 / S | | +-----+------------+---------------+-----+-------+-------+----------+---------+ ========================================================================================= STATE OF NOSS VITAL COMPONENTS REPLICATION DEPOT 2024-04-28 22:59:38: Replication up and running HYDRA 2024-04-28 22:59:38: Replication up and running RA interface checked 2024-04-28 23:01:52 PI interface checked 2024-04-28 23:01:53 HTOPX3 checked 2024-04-28 23:01:55 Night Report checked 2024-04-28 23:30:15 ========================================================================================= STATE OF VARIOUS PRODUCTION COMPUTERS and TCS COMMUNICATION 2024-04-28 23:00:30 HET OPS calendar checked 2024-04-28 23:00:28 RA station sound checked 2024-04-28 23:00:31 DIMM data mounted 2024-04-28 23:00:31 State of the RA station file systems / 81% HPF TCS COMM /HPFData/LinuxGigE/20240428/hpf/0066/fits/hpf_20240428T230110_R01_F010.fits RTFX = -0.4203 / Tracker Real Coord X STRTAZ = 180.008814 / Structure Actual Azimuth LRS2 2024-04-28 23:00:50 LRS2 server running Pivot server running Data transfer server (RAM->LOCAL->NFS) running RAMDISK state 0% Used LRS2 TCS COMM /hetdata/data/20240428/lrs2/lrs20009911/exp01/lrs2/20240428T233644.6_066LU_cmp.fits STRUCTAZ= 0.005114 / Azimuth of the structure X_STRT = -0.434959 / X pos of tracker at start of exposure (mm) VIRUS 2024-04-28 23:00:56 VIRUS server running Pivot server running Data transfer server (RAM->LOCAL>NFS) running Data transfer server (NFS->TACC) running RAMDISK state 0% Used VIRUS TCS COMM /hetdata/data/20240428/virus/virus0009902/exp01/virus/20240428T232028.4_023RU_drk.fits STRUCTAZ= 0.007817 / Azimuth of the structure X_STRT = -51.563968 / X pos of tracker at start of exposure (mm) ========================================================================================= HPF Detect says "GetObsnum:65" 2024-04-28 23:00:39 Het says "message:Het_shuttingdown" 2024-04-28 23:00:45 timshet started 2024-04-28 23:04:31 fiber scrambler sounds normal ========================================================================================= LRS2 Notes: LRS2 OPS cals crushed (PR6322). Restarted them. Uptime: 032:04:00:48 2024-04-28 23:41:06 LRS2 data and Qth/FeAr lamps checked IP/VG turn off 2024-04-28T22:59:07 Cryo Cryo Left Right Left Right Left Right Left Right IHMP Unit Cntl Encl Mux Temp Press SetPt SetPt Temp Temp Htr Htr Pwr Pwr Snnn Vnnn Cnnn Exyz Mnnn C mB C C C C V V % % 1 056 503 082 111 000 -183.2 9.9e-07 -110.0 -110.0 -110.0 -110.0 0.939 1.304 29.35 56.58 2 066 502 100 121 000 -184.4 1.3e-06 -110.0 -110.0 -110.0 -110.0 1.206 1.310 48.42 57.09 ========================================================================================= VIRUS VHC report: 20240428 / 9901:1 ALL : FFT problem in 17 out of 312 amplifiers S087-V204LU: bias line stdev 0.6 > 0.5 S095-V426RU: zero pixels 1065024 > 5000 Uptime: 001:04:44:04 Virus Ion Pumps: OFF: ok STATUS: All ion pumps are off since 2024-04-28 23:01:40Z 2024-04-28 23:22:24 VIRUS data and LDLS/CdA/FeAr lamps checked 2024-04-28T23:01:17 Cryo Left Right Left Right Left Right Left Right Left Right IHMP Unit Cntl Encl Mux Temp SetPt SetPt Temp Temp Htr Htr Pwr Pwr Id Id Snnn Vnnn Cnnn Exyz Mnnn C C C C C V V % % 1 013 412 021 241 008 -182.5 -110.0 -110.0 -110.0 -110.0 1.227 1.131 50.11 42.58 26932 26960 2 014 411 008 221 006 -184.8 -110.0 -110.0 -110.0 -110.0 1.383 1.430 63.72 68.10 26904 27016 3 015 317 049 234 007 -184.0 -110.0 -110.0 -110.0 -110.0 1.205 1.397 48.32 64.98 21133 21181 4 016 409 058 242 008 -180.3 -110.0 -110.0 -110.0 -110.0 1.192 1.165 47.33 45.18 26937 26988 5 021 315 068 218 005 -181.1 -110.0 -110.0 -110.0 -110.0 1.308 1.332 56.98 59.06 21176 21177 6 022 316 102 247 008 -182.0 -110.0 -110.0 -110.0 -110.0 1.401 1.333 65.35 59.17 21188 21195 7 023 313 024 255 009 -183.2 -110.0 -110.0 -110.0 -110.0 1.189 1.202 47.07 48.06 21254 21265 8 024 410 070 224 006 -182.6 -110.0 -110.0 -110.0 -110.0 1.312 1.150 57.31 44.03 27004 27010 9 025 303 028 254 009 -184.8 -110.0 -110.0 -110.0 -110.0 1.325 1.193 58.46 47.36 21091 21208 10 026 318 057 244 008 -182.3 -110.0 -110.0 -110.0 -110.0 1.400 1.200 65.27 47.93 21150 21225 11 027 314 018 253 009 -184.6 -110.0 -110.0 -110.0 -110.0 1.258 1.322 52.70 58.20 21113 21227 12 028 413 014 252 009 -178.4 -110.0 -110.0 -110.0 -110.0 1.035 0.976 35.63 31.70 27031 27044 13 030 420 061 212 005 -180.2 -110.0 -110.0 -110.0 -110.0 1.121 1.175 41.85 45.98 27040 26967 14 031 408 033 211 005 -186.1 -110.0 -110.0 -110.0 -110.0 1.469 1.365 71.80 62.07 26915 26951 15 032 320 059 236 007 -183.7 -110.0 -110.0 -110.0 -110.0 1.297 1.271 55.97 53.81 21172 21262 16 033 310 069 257 009 -183.6 -110.0 -110.0 -110.0 -110.0 1.099 1.335 40.23 59.30 21182 21213 17 034 305 078 248 008 -183.6 -110.0 -110.0 -110.0 -110.0 1.379 1.277 63.33 54.27 21132 21165 18 035 202 038 238 007 -171.2 -110.0 -110.0 -110.0 -110.0 0.692 1.214 15.96 49.10 15278 18066 19 036 302 053 235 007 -185.1 -110.0 -110.0 -110.0 -110.0 1.233 1.312 50.58 57.34 21102 21264 20 037 306 042 228 006 -183.0 -110.0 -110.0 -110.0 -110.0 1.446 1.133 69.62 42.73 21248 21252 21 038 414 072 251 009 -180.2 -110.0 -110.0 -110.0 -110.0 1.151 0.971 44.14 31.39 26927 26959 22 039 424 046 217 005 -184.1 -110.0 -110.0 -110.0 -110.0 1.271 1.348 53.80 60.47 27033 26851 23 040 419 085 225 006 -184.4 -110.0 -110.0 -110.0 -110.0 1.217 1.217 49.32 49.29 26873 26897 24 041 407 104 226 006 -181.9 -110.0 -110.0 -110.0 -110.0 1.231 1.256 50.45 52.49 26902 26954 25 042 321 077 243 008 -183.7 -110.0 -110.0 -110.0 -110.0 1.405 1.462 65.71 71.18 21155 21191 26 043 323 041 231 007 -186.1 -110.0 -110.0 -110.0 -110.0 1.171 1.438 45.62 68.87 21153 21190 27 044 304 083 256 009 -184.0 -110.0 -110.0 -110.0 -110.0 1.035 1.216 35.69 49.23 21120 21126 28 045 312 084 237 007 -183.2 -110.0 -110.0 -110.0 -110.0 1.181 1.060 46.42 37.43 21216 21218 29 046 309 025 258 009 -184.3 -110.0 -110.0 -110.0 -110.0 1.231 1.438 50.44 68.80 21202 21148 30 047 308 081 227 006 -184.2 -110.0 -110.0 -110.0 -110.0 1.143 1.380 43.51 63.38 21129 21229 31 048 415 031 223 006 -185.0 -110.0 -110.0 -110.0 -110.0 1.355 1.280 61.12 54.51 26910 26911 32 049 425 052 222 006 -185.4 -110.0 -110.0 -110.0 -110.0 1.381 1.394 63.48 64.67 26990 27012 33 050 504 067 213 005 -186.1 -110.0 -110.0 -110.0 -110.0 1.342 1.332 60.00 59.02 27726 27725 34 051 503 016 214 005 -182.7 -110.0 -110.0 -110.0 -110.0 1.060 1.271 37.38 53.81 27702 27693 35 052 301 087 233 007 -182.3 -110.0 -110.0 -110.0 -110.0 1.071 1.439 38.21 68.98 21123 21185 36 053 311 027 245 008 -184.6 -110.0 -110.0 -110.0 -110.0 1.221 1.149 49.64 43.92 21214 21215 37 057 418 055 216 005 -181.2 -110.0 -110.0 -110.0 -110.0 1.184 1.102 46.68 40.46 26876 26984 38 058 416 034 215 005 -183.4 -110.0 -110.0 -110.0 -110.0 1.248 1.275 51.87 54.12 27032 27039 39 059 508 043 232 007 -185.8 -110.0 -110.0 -110.0 -110.0 1.461 1.431 71.05 68.15 27772 27650 40 060 206 039 246 008 -182.8 -110.0 -110.0 -110.0 -110.0 1.304 1.283 56.65 54.82 18201 18265 41 061 427 106 116 000 -181.2 -110.0 -110.0 -110.0 -110.0 1.141 1.136 43.35 42.96 26888 26985 42 062 319 044 137 002 -183.2 -110.0 -110.0 -110.0 -110.0 1.316 1.485 57.69 73.40 21166 21200 43 063 511 062 133 002 -184.0 -110.0 -110.0 -110.0 -110.0 1.221 1.180 49.65 46.32 27661 27668 44 067 025 092 154 004 -186.7 -110.0 -110.0 -110.0 -110.0 1.306 1.392 56.74 64.47 12841 12807 45 068 417 032 126 001 -183.4 -110.0 -110.0 -110.0 -110.0 1.267 1.250 53.41 51.99 26989 27013 46 069 421 076 127 001 -179.2 -110.0 -110.0 -110.0 -110.0 1.062 1.067 37.56 37.89 26912 26952 47 070 502 080 125 001 -182.9 -110.0 -110.0 -110.0 -110.0 1.233 1.254 50.58 52.33 27785 27627 48 071 406 088 117 000 -183.3 -110.0 -110.0 -110.0 -110.0 1.308 1.373 56.94 62.76 27018 27025 49 072 405 023 115 000 -181.1 -110.0 -110.0 -110.0 -110.0 1.306 1.325 56.77 58.44 26948 26907 50 073 404 029 143 003 -185.6 -110.0 -110.0 -110.0 -110.0 1.250 1.276 52.04 54.23 26866 26939 51 074 403 063 142 003 -186.0 -110.0 -110.0 -110.0 -110.0 1.397 1.346 64.94 60.32 26956 27061 52 075 324 048 156 004 -183.1 -110.0 -110.0 -110.0 -110.0 1.424 1.228 67.47 50.18 21212 21253 53 076 325 030 147 003 -183.9 -110.0 -110.0 -110.0 -110.0 1.088 1.228 39.44 50.17 21221 21263 54 077 402 054 141 003 -182.3 -110.0 -110.0 -110.0 -110.0 1.310 1.248 57.16 51.87 26856 26928 55 078 422 096 124 001 -181.1 -110.0 -110.0 -110.0 -110.0 1.146 1.078 43.76 38.66 26900 26894 56 079 401 037 123 001 -184.8 -110.0 -110.0 -110.0 -110.0 1.397 1.366 64.94 62.15 26892 26913 57 080 501 066 148 003 -182.2 -110.0 -110.0 -110.0 -110.0 1.264 1.165 53.15 45.18 27789 27630 58 081 327 073 118 000 -183.3 -110.0 -110.0 -110.0 -110.0 1.005 1.243 33.62 51.46 21121 21168 59 082 326 060 146 003 -184.1 -110.0 -110.0 -110.0 -110.0 1.155 1.126 44.40 42.18 21194 21267 60 083 328 091 112 000 -185.1 -110.0 -110.0 -110.0 -110.0 1.418 1.486 66.91 73.52 21143 21243 61 084 322 026 128 001 -183.9 -110.0 -110.0 -110.0 -110.0 1.398 1.159 65.07 44.76 21135 21151 62 085 307 105 131 002 -186.0 -110.0 -110.0 -110.0 -110.0 1.336 1.151 59.46 44.12 21220 21240 63 086 203 040 151 004 -185.3 -110.0 -110.0 -110.0 -110.0 1.373 1.448 62.74 69.77 18092 18110 64 087 204 056 145 003 -183.0 -110.0 -110.0 -110.0 -110.0 1.377 1.419 63.14 67.08 18181 18264 65 088 329 071 144 003 -185.1 -110.0 -110.0 -110.0 -110.0 1.427 1.445 67.81 69.54 21173 21203 66 089 423 095 114 000 -184.1 -110.0 -110.0 -110.0 -110.0 1.265 1.209 53.24 48.68 27024 26931 67 091 205 094 113 000 -185.0 -110.0 -110.0 -110.0 -110.0 1.427 1.345 67.77 60.23 18244 18249 68 092 330 103 132 002 -183.1 -110.0 -110.0 -110.0 -110.0 1.243 1.327 51.43 58.62 21223 21224 69 093 507 020 157 004 -182.7 -110.0 -110.0 -110.0 -110.0 1.326 1.276 58.51 54.21 27735 27779 70 094 509 012 155 004 -181.1 -110.0 -110.0 -110.0 -110.0 1.182 1.135 46.51 42.88 27771 27679 71 095 426 107 158 004 -182.2 -110.0 -110.0 -110.0 -110.0 1.296 1.268 55.88 53.51 26940 26983 72 096 510 051 134 002 -185.6 -110.0 -110.0 -110.0 -110.0 1.231 1.293 50.44 55.63 27680 27691 73 097 505 064 135 002 -182.1 -110.0 -110.0 -110.0 -110.0 1.322 1.177 58.23 46.09 27743 27756 74 098 027 090 122 001 -183.2 -110.0 -110.0 -110.0 -110.0 1.572 1.320 82.27 57.98 12808 12849 75 103 514 075 152 004 -183.5 -110.0 -110.0 -110.0 -110.0 1.334 1.288 59.26 55.22 27800 27732 76 104 512 098 153 004 -178.2 -110.0 -110.0 -110.0 -110.0 0.920 0.731 28.20 17.80 27741 27671 77 105 513 036 138 002 -179.1 -110.0 -110.0 -110.0 -110.0 1.178 1.084 46.22 39.11 27748 27734 78 106 506 013 136 002 -183.2 -110.0 -110.0 -110.0 -110.0 1.205 1.214 48.34 49.08 27796 27737 ========================================================================================= PFIP Check for probes move Before: GC1 0.15007 -0.06001 GC2 -0.14996 0.06000 WF1 0.06000 0.14997 WF2 -0.06000 -0.14996 After home5: Commanded positions: GC1 0.16 -0.00 GC2 -0.16 0.00 WF1 0.00 0.16 WF2 0.00 -0.16 Final positions: GC1 0.15995 -0.00003 GC2 -0.16002 -0.00000 WF1 -0.00000 0.16002 WF2 -0.00000 -0.15998 ACQ camera mirror insertion test: averages on 9 comparisons: ------------------------------- dx = 0.0521 +/- 0.0415 [pixels] dy = -0.0023 +/- 0.0018 [pixels]