nixbot

1these 13 derivations will be built:2  /nix/store/13l2y446mdhj86dax7snzq2gxg0l1zjx-unit-nixbot.socket.drv3  /nix/store/zvkczwyn0jx44l6qgiz8yp7mhib55vpn-unit-nixbot.service.drv4  /nix/store/w1bhnx21cdwg1gwp0pilk96rd9lsjdbw-system-units.drv5  /nix/store/lpyfpkr3g9jjdvyjccklngpl54iplcam-etc.drv6  /nix/store/ymzchbbhwi5j952ri6mrby9n5lqsjrq7-activate.drv7  /nix/store/y8ygz3pwaarmvl4iyvxxnfji402xa9p3-nixos-system-gitlab-test.drv8  /nix/store/r5p31f7gjhrrljcfyx1i57bcscbplsh3-closure-info.drv9  /nix/store/s5rkzwwv0sfzmlgic85wafqmw7lyalvq-closure-info.drv10  /nix/store/y5ra65sz5bxv0v7dp09zz33nz0imkxa0-run-nixos-vm.drv11  /nix/store/s6n8hwhv5vzvfqh3xb2bbskkm5rqv9dc-nixos-vm.drv12  /nix/store/kd6mbmgd0mbxzxnidpjbz6xgix33nsl6-driverConfiguration.json.drv13  /nix/store/isfc01zdfmm00lix4zd65hr3mfa3346r-nixos-test-driver-nixbot-gitlab.drv14  /nix/store/m9gzdzlca879c5cng35afzk4g067w76k-vm-test-run-nixbot-gitlab.drv15building '/nix/store/zvkczwyn0jx44l6qgiz8yp7mhib55vpn-unit-nixbot.service.drv'16building '/nix/store/13l2y446mdhj86dax7snzq2gxg0l1zjx-unit-nixbot.socket.drv'17building '/nix/store/w1bhnx21cdwg1gwp0pilk96rd9lsjdbw-system-units.drv'18building '/nix/store/lpyfpkr3g9jjdvyjccklngpl54iplcam-etc.drv'19building '/nix/store/ymzchbbhwi5j952ri6mrby9n5lqsjrq7-activate.drv'20building '/nix/store/y8ygz3pwaarmvl4iyvxxnfji402xa9p3-nixos-system-gitlab-test.drv'21nixos-system-gitlab-test> structuredAttrs is enabled22building '/nix/store/r5p31f7gjhrrljcfyx1i57bcscbplsh3-closure-info.drv'23closure-info> structuredAttrs is enabled24building '/nix/store/s5rkzwwv0sfzmlgic85wafqmw7lyalvq-closure-info.drv'25closure-info> structuredAttrs is enabled26building '/nix/store/y5ra65sz5bxv0v7dp09zz33nz0imkxa0-run-nixos-vm.drv'27building '/nix/store/s6n8hwhv5vzvfqh3xb2bbskkm5rqv9dc-nixos-vm.drv'28building '/nix/store/kd6mbmgd0mbxzxnidpjbz6xgix33nsl6-driverConfiguration.json.drv'29driverConfiguration.json> structuredAttrs is enabled30building '/nix/store/isfc01zdfmm00lix4zd65hr3mfa3346r-nixos-test-driver-nixbot-gitlab.drv'31nixos-test-driver-nixbot-gitlab> Running type check (enable/disable: config.skipTypeCheck)32nixos-test-driver-nixbot-gitlab> See https://nixos.org/manual/nixos/stable/#test-opt-skipTypeCheck33nixos-test-driver-nixbot-gitlab> All checks passed!34nixos-test-driver-nixbot-gitlab> Linting test script (enable/disable: config.skipLint)35nixos-test-driver-nixbot-gitlab> See https://nixos.org/manual/nixos/stable/#test-opt-skipLint36nixos-test-driver-nixbot-gitlab> All checks passed!37building '/nix/store/m9gzdzlca879c5cng35afzk4g067w76k-vm-test-run-nixbot-gitlab.drv' on 'ssh-ng://nix@jamie'38building '/nix/store/m9gzdzlca879c5cng35afzk4g067w76k-vm-test-run-nixbot-gitlab.drv'39vm-test-run-nixbot-gitlab> Machine state will be reset. To keep it, pass --keep-machine-state40vm-test-run-nixbot-gitlab> start all VLans41vm-test-run-nixbot-gitlab> (finished: start all VLans, in 0.01 seconds)42vm-test-run-nixbot-gitlab> Test will time out and terminate in 3600 seconds43vm-test-run-nixbot-gitlab> run the VM test script44vm-test-run-nixbot-gitlab> additionally exposed symbols:45vm-test-run-nixbot-gitlab>     gitlab,46vm-test-run-nixbot-gitlab>     vlan1,47vm-test-run-nixbot-gitlab>     start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh48vm-test-run-nixbot-gitlab> start all VMs49vm-test-run-nixbot-gitlab> gitlab: starting vm50vm-test-run-nixbot-gitlab> gitlab # Disk image does not exist, creating the virtualisation disk image...51vm-test-run-nixbot-gitlab> gitlab: QEMU running (pid 13)52vm-test-run-nixbot-gitlab> gitlab # Formatting '/build/vm-state-gitlab/tmp.XvCkb4umTD', fmt=raw size=107374182453vm-test-run-nixbot-gitlab> gitlab # mke2fs 1.47.3 (8-Jul-2025)54vm-test-run-nixbot-gitlab> gitlab # Discarding device blocks:      0/262144             done55vm-test-run-nixbot-gitlab> gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes56vm-test-run-nixbot-gitlab> gitlab # Filesystem UUID: 6d1207e1-b29f-4134-be0c-9340828284b157vm-test-run-nixbot-gitlab> gitlab # Superblock backups stored on blocks:58vm-test-run-nixbot-gitlab> gitlab # 	32768, 98304, 163840, 22937659vm-test-run-nixbot-gitlab> gitlab # 60vm-test-run-nixbot-gitlab> gitlab # Allocating group tables: 0/8   done61vm-test-run-nixbot-gitlab> gitlab # Writing inode tables: 0/8   done62vm-test-run-nixbot-gitlab> gitlab # Creating journal (8192 blocks): done63vm-test-run-nixbot-gitlab> gitlab # Writing superblocks and filesystem accounting information: 0/8   done64vm-test-run-nixbot-gitlab> gitlab # 65vm-test-run-nixbot-gitlab> gitlab # Virtualisation disk image created.66vm-test-run-nixbot-gitlab> gitlab # Creating Nix store image...67vm-test-run-nixbot-gitlab> gitlab # Created Nix store image.68vm-test-run-nixbot-gitlab> (finished: start all VMs, in 37.72 seconds)69vm-test-run-nixbot-gitlab> gitlab: waiting for unit setup-gitlab.service70vm-test-run-nixbot-gitlab> gitlab: waiting for the VM to finish booting71vm-test-run-nixbot-gitlab> gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)72vm-test-run-nixbot-gitlab> gitlab # 73vm-test-run-nixbot-gitlab> gitlab # 74vm-test-run-nixbot-gitlab> gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0075vm-test-run-nixbot-gitlab> gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...76vm-test-run-nixbot-gitlab> gitlab # 77vm-test-run-nixbot-gitlab> gitlab # 78vm-test-run-nixbot-gitlab> gitlab # 79vm-test-run-nixbot-gitlab> gitlab # 80vm-test-run-nixbot-gitlab> gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0081vm-test-run-nixbot-gitlab> gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...82vm-test-run-nixbot-gitlab> gitlab # 83vm-test-run-nixbot-gitlab> gitlab # 84vm-test-run-nixbot-gitlab> gitlab # Booting from ROM...85vm-test-run-nixbot-gitlab> gitlab # Probing EDD (edd=off to disable)... ok[    0.000000] Linux version 6.18.34 (nixbld@localhost) (gcc (GCC) 15.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Jun  1 15:51:08 UTC 202686vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/w3f5kbj3l91xx2071j9aw23f0pgznfqg-nixos-system-gitlab-test/init regInfo=/nix/store/y0pfajf465in3r0h4f10j7pfzdpc4iyp-closure-info/registration console=ttyS0,115200n8 console=tty087vm-test-run-nixbot-gitlab> gitlab # [    0.000000] BIOS-provided physical RAM map:88vm-test-run-nixbot-gitlab> gitlab # [    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable89vm-test-run-nixbot-gitlab> gitlab # [    0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved90vm-test-run-nixbot-gitlab> gitlab # [    0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved91vm-test-run-nixbot-gitlab> gitlab # [    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable92vm-test-run-nixbot-gitlab> gitlab # [    0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved93vm-test-run-nixbot-gitlab> gitlab # [    0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved94vm-test-run-nixbot-gitlab> gitlab # [    0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved95vm-test-run-nixbot-gitlab> gitlab # [    0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable96vm-test-run-nixbot-gitlab> gitlab # [    0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved97vm-test-run-nixbot-gitlab> gitlab # [    0.000000] NX (Execute Disable) protection: active98vm-test-run-nixbot-gitlab> gitlab # [    0.000000] APIC: Static calls initialized99vm-test-run-nixbot-gitlab> gitlab # [    0.000000] SMBIOS 2.8 present.100vm-test-run-nixbot-gitlab> gitlab # [    0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014101vm-test-run-nixbot-gitlab> gitlab # [    0.000000] DMI: Memory slots populated: 1/1102vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Hypervisor detected: KVM103vm-test-run-nixbot-gitlab> gitlab # [    0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000104vm-test-run-nixbot-gitlab> gitlab # [    0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00105vm-test-run-nixbot-gitlab> gitlab # [    0.000000] kvm-clock: using sched offset of 477718544 cycles106vm-test-run-nixbot-gitlab> gitlab # [    0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns107vm-test-run-nixbot-gitlab> gitlab # [    0.000005] tsc: Detected 2400.008 MHz processor108vm-test-run-nixbot-gitlab> gitlab # [    0.000811] last_pfn = 0x1c0000 max_arch_pfn = 0x10000000000109vm-test-run-nixbot-gitlab> gitlab # [    0.000847] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs110vm-test-run-nixbot-gitlab> gitlab # [    0.000850] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT111vm-test-run-nixbot-gitlab> gitlab # [    0.000901] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000112vm-test-run-nixbot-gitlab> gitlab # [    0.002760] found SMP MP-table at [mem 0x000f5470-0x000f547f]113vm-test-run-nixbot-gitlab> gitlab # [    0.002770] Using GB pages for direct mapping114vm-test-run-nixbot-gitlab> gitlab # [    0.002875] RAMDISK: [mem 0xbe4e0000-0xbffcffff]115vm-test-run-nixbot-gitlab> gitlab # [    0.002883] ACPI: Early table checksum verification disabled116vm-test-run-nixbot-gitlab> gitlab # [    0.002886] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )117vm-test-run-nixbot-gitlab> gitlab # [    0.002889] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS  BXPC     00000001 BXPC 00000001)118vm-test-run-nixbot-gitlab> gitlab # [    0.002893] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS  BXPC     00000001 BXPC 00000001)119vm-test-run-nixbot-gitlab> gitlab # [    0.002900] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS  BXPC     00000001 BXPC 00000001)120vm-test-run-nixbot-gitlab> gitlab # [    0.002902] ACPI: FACS 0x00000000BFFE0000 000040121vm-test-run-nixbot-gitlab> gitlab # [    0.002904] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS  BXPC     00000001 BXPC 00000001)122vm-test-run-nixbot-gitlab> gitlab # [    0.002905] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS  BXPC     00000001 BXPC 00000001)123vm-test-run-nixbot-gitlab> gitlab # [    0.002907] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS  BXPC     00000001 BXPC 00000001)124vm-test-run-nixbot-gitlab> gitlab # [    0.002908] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]125vm-test-run-nixbot-gitlab> gitlab # [    0.002909] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]126vm-test-run-nixbot-gitlab> gitlab # [    0.002910] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]127vm-test-run-nixbot-gitlab> gitlab # [    0.002910] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]128vm-test-run-nixbot-gitlab> gitlab # [    0.002911] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]129vm-test-run-nixbot-gitlab> gitlab # [    0.002911] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]130vm-test-run-nixbot-gitlab> gitlab # [    0.003389] No NUMA configuration found131vm-test-run-nixbot-gitlab> gitlab # [    0.003390] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]132vm-test-run-nixbot-gitlab> gitlab # [    0.003393] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]133vm-test-run-nixbot-gitlab> gitlab # [    0.006079] Zone ranges:134vm-test-run-nixbot-gitlab> gitlab # [    0.006080]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]135vm-test-run-nixbot-gitlab> gitlab # [    0.006082]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]136vm-test-run-nixbot-gitlab> gitlab # [    0.006083]   Normal   [mem 0x0000000100000000-0x00000001bfffffff]137vm-test-run-nixbot-gitlab> gitlab # [    0.006084]   Device   empty138vm-test-run-nixbot-gitlab> gitlab # [    0.006085] Movable zone start for each node139vm-test-run-nixbot-gitlab> gitlab # [    0.006086] Early memory node ranges140vm-test-run-nixbot-gitlab> gitlab # [    0.006086]   node   0: [mem 0x0000000000001000-0x000000000009efff]141vm-test-run-nixbot-gitlab> gitlab # [    0.006087]   node   0: [mem 0x0000000000100000-0x00000000bffd7fff]142vm-test-run-nixbot-gitlab> gitlab # [    0.006088]   node   0: [mem 0x0000000100000000-0x00000001bfffffff]143vm-test-run-nixbot-gitlab> gitlab # [    0.006089] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]144vm-test-run-nixbot-gitlab> gitlab # [    0.006112] On node 0, zone DMA: 1 pages in unavailable ranges145vm-test-run-nixbot-gitlab> gitlab # [    0.006444] On node 0, zone DMA: 97 pages in unavailable ranges146vm-test-run-nixbot-gitlab> gitlab # [    0.113979] On node 0, zone Normal: 40 pages in unavailable ranges147vm-test-run-nixbot-gitlab> gitlab # [    0.114995] ACPI: PM-Timer IO Port: 0x608148vm-test-run-nixbot-gitlab> gitlab # [    0.115012] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])149vm-test-run-nixbot-gitlab> gitlab # [    0.115050] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23150vm-test-run-nixbot-gitlab> gitlab # [    0.115053] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)151vm-test-run-nixbot-gitlab> gitlab # [    0.115055] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)152vm-test-run-nixbot-gitlab> gitlab # [    0.115056] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)153vm-test-run-nixbot-gitlab> gitlab # [    0.115057] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)154vm-test-run-nixbot-gitlab> gitlab # [    0.115057] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)155vm-test-run-nixbot-gitlab> gitlab # [    0.115060] ACPI: Using ACPI (MADT) for SMP configuration information156vm-test-run-nixbot-gitlab> gitlab # [    0.115061] ACPI: HPET id: 0x8086a201 base: 0xfed00000157vm-test-run-nixbot-gitlab> gitlab # [    0.115067] TSC deadline timer available158vm-test-run-nixbot-gitlab> gitlab # [    0.115072] CPU topo: Max. logical packages:   1159vm-test-run-nixbot-gitlab> gitlab # [    0.115073] CPU topo: Max. logical dies:       1160vm-test-run-nixbot-gitlab> gitlab # [    0.115073] CPU topo: Max. dies per package:   1161vm-test-run-nixbot-gitlab> gitlab # [    0.115076] CPU topo: Max. threads per core:   1162vm-test-run-nixbot-gitlab> gitlab # [    0.115077] CPU topo: Num. cores per package:     4163vm-test-run-nixbot-gitlab> gitlab # [    0.115077] CPU topo: Num. threads per package:   4164vm-test-run-nixbot-gitlab> gitlab # [    0.115078] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs165vm-test-run-nixbot-gitlab> gitlab # [    0.115103] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()166vm-test-run-nixbot-gitlab> gitlab # [    0.115120] kvm-guest: KVM setup pv remote TLB flush167vm-test-run-nixbot-gitlab> gitlab # [    0.115124] kvm-guest: setup PV sched yield168vm-test-run-nixbot-gitlab> gitlab # [    0.115143] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]169vm-test-run-nixbot-gitlab> gitlab # [    0.115145] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]170vm-test-run-nixbot-gitlab> gitlab # [    0.115146] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]171vm-test-run-nixbot-gitlab> gitlab # [    0.115147] [mem 0xc0000000-0xfeffbfff] available for PCI devices172vm-test-run-nixbot-gitlab> gitlab # [    0.115149] Booting paravirtualized kernel on KVM173vm-test-run-nixbot-gitlab> gitlab # [    0.115152] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns174vm-test-run-nixbot-gitlab> gitlab # [    0.119639] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1175vm-test-run-nixbot-gitlab> gitlab # [    0.121830] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288176vm-test-run-nixbot-gitlab> gitlab # [    0.121882] kvm-guest: PV spinlocks enabled177vm-test-run-nixbot-gitlab> gitlab # [    0.121884] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)178vm-test-run-nixbot-gitlab> gitlab # [    0.121887] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/w3f5kbj3l91xx2071j9aw23f0pgznfqg-nixos-system-gitlab-test/init regInfo=/nix/store/y0pfajf465in3r0h4f10j7pfzdpc4iyp-closure-info/registration console=ttyS0,115200n8 console=tty0179vm-test-run-nixbot-gitlab> gitlab # [    0.121981] Unknown kernel command line parameters "regInfo=/nix/store/y0pfajf465in3r0h4f10j7pfzdpc4iyp-closure-info/registration", will be passed to user space.180vm-test-run-nixbot-gitlab> gitlab # [    0.121993] random: crng init done181vm-test-run-nixbot-gitlab> gitlab # [    0.121994] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes182vm-test-run-nixbot-gitlab> gitlab # [    0.130793] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)183vm-test-run-nixbot-gitlab> gitlab # [    0.135258] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)184vm-test-run-nixbot-gitlab> gitlab # [    0.135332] software IO TLB: area num 4.185vm-test-run-nixbot-gitlab> gitlab # [    0.212201] Fallback order for Node 0: 0186vm-test-run-nixbot-gitlab> gitlab # [    0.212209] Built 1 zonelists, mobility grouping on.  Total pages: 1572726187vm-test-run-nixbot-gitlab> gitlab # [    0.212210] Policy zone: Normal188vm-test-run-nixbot-gitlab> gitlab # [    0.214720] mem auto-init: stack:all(zero), heap alloc:on, heap free:off189vm-test-run-nixbot-gitlab> gitlab # [    0.223879] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1190vm-test-run-nixbot-gitlab> gitlab # [    0.237489] allocated 12582912 bytes of page_ext191vm-test-run-nixbot-gitlab> gitlab # [    0.247371] ftrace: allocating 48565 entries in 192 pages192vm-test-run-nixbot-gitlab> gitlab # [    0.247373] ftrace: allocated 192 pages with 2 groups193vm-test-run-nixbot-gitlab> gitlab # [    0.248267] Dynamic Preempt: lazy194vm-test-run-nixbot-gitlab> gitlab # [    0.248438] rcu: Preemptible hierarchical RCU implementation.195vm-test-run-nixbot-gitlab> gitlab # [    0.248439] rcu: 	RCU event tracing is enabled.196vm-test-run-nixbot-gitlab> gitlab # [    0.248439] rcu: 	RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.197vm-test-run-nixbot-gitlab> gitlab # [    0.248441] 	Trampoline variant of Tasks RCU enabled.198vm-test-run-nixbot-gitlab> gitlab # [    0.248442] 	Rude variant of Tasks RCU enabled.199vm-test-run-nixbot-gitlab> gitlab # [    0.248442] 	Tracing variant of Tasks RCU enabled.200vm-test-run-nixbot-gitlab> gitlab # [    0.248443] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.201vm-test-run-nixbot-gitlab> gitlab # [    0.248443] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4202vm-test-run-nixbot-gitlab> gitlab # [    0.248459] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.203vm-test-run-nixbot-gitlab> gitlab # [    0.248461] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.204vm-test-run-nixbot-gitlab> gitlab # [    0.248462] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.205vm-test-run-nixbot-gitlab> gitlab # [    0.252834] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16206vm-test-run-nixbot-gitlab> gitlab # [    0.253138] rcu: srcu_init: Setting srcu_struct sizes based on contention.207vm-test-run-nixbot-gitlab> gitlab # [    0.253255] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)208vm-test-run-nixbot-gitlab> gitlab # [    0.260459] Console: colour VGA+ 80x25209vm-test-run-nixbot-gitlab> gitlab # [    0.260463] printk: legacy console [tty0] enabled210vm-test-run-nixbot-gitlab> gitlab # [    0.303979] printk: legacy console [ttyS0] enabled211vm-test-run-nixbot-gitlab> gitlab # [    0.501972] ACPI: Core revision 20250807212vm-test-run-nixbot-gitlab> gitlab # [    0.503558] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns213vm-test-run-nixbot-gitlab> gitlab # [    0.506451] APIC: Switch to symmetric I/O mode setup214vm-test-run-nixbot-gitlab> gitlab # [    0.508209] x2apic enabled215vm-test-run-nixbot-gitlab> gitlab # [    0.509437] APIC: Switched APIC routing to: physical x2apic216vm-test-run-nixbot-gitlab> gitlab # [    0.511135] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()217vm-test-run-nixbot-gitlab> gitlab # [    0.513360] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()218vm-test-run-nixbot-gitlab> gitlab # [    0.516092] kvm-guest: setup PV IPIs219vm-test-run-nixbot-gitlab> gitlab # [    0.518370] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1220vm-test-run-nixbot-gitlab> gitlab # [    0.520205] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns221vm-test-run-nixbot-gitlab> gitlab # [    0.523262] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008)222vm-test-run-nixbot-gitlab> gitlab # [    0.525376] x86/cpu: User Mode Instruction Prevention (UMIP) activated223vm-test-run-nixbot-gitlab> gitlab # [    0.526411] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127224vm-test-run-nixbot-gitlab> gitlab # [    0.527262] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0225vm-test-run-nixbot-gitlab> gitlab # [    0.528266] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto226vm-test-run-nixbot-gitlab> gitlab # [    0.530262] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl227vm-test-run-nixbot-gitlab> gitlab # [    0.531262] Spectre V2 : Mitigation: Enhanced / Automatic IBRS228vm-test-run-nixbot-gitlab> gitlab # [    0.532262] Speculative Return Stack Overflow: Mitigation: Safe RET229vm-test-run-nixbot-gitlab> gitlab # [    0.534262] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization230vm-test-run-nixbot-gitlab> gitlab # [    0.536268] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier231vm-test-run-nixbot-gitlab> gitlab # [    0.537263] active return thunk: srso_alias_return_thunk232vm-test-run-nixbot-gitlab> gitlab # [    0.539290] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'233vm-test-run-nixbot-gitlab> gitlab # [    0.541262] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'234vm-test-run-nixbot-gitlab> gitlab # [    0.543261] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'235vm-test-run-nixbot-gitlab> gitlab # [    0.545262] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'236vm-test-run-nixbot-gitlab> gitlab # [    0.547262] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'237vm-test-run-nixbot-gitlab> gitlab # [    0.548262] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'238vm-test-run-nixbot-gitlab> gitlab # [    0.549262] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'239vm-test-run-nixbot-gitlab> gitlab # [    0.550262] x86/fpu: Supporting XSAVE feature 0x800: 'Control-flow User registers'240vm-test-run-nixbot-gitlab> gitlab # [    0.552261] x86/fpu: Supporting XSAVE feature 0x1000: 'Control-flow Kernel registers (KVM only)'241vm-test-run-nixbot-gitlab> gitlab # [    0.553262] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256242vm-test-run-nixbot-gitlab> gitlab # [    0.554262] x86/fpu: xstate_offset[5]:  832, xstate_sizes[5]:   64243vm-test-run-nixbot-gitlab> gitlab # [    0.555262] x86/fpu: xstate_offset[6]:  896, xstate_sizes[6]:  512244vm-test-run-nixbot-gitlab> gitlab # [    0.556262] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024245vm-test-run-nixbot-gitlab> gitlab # [    0.557262] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]:    8246vm-test-run-nixbot-gitlab> gitlab # [    0.559262] x86/fpu: xstate_offset[11]: 2440, xstate_sizes[11]:   16247vm-test-run-nixbot-gitlab> gitlab # [    0.561262] x86/fpu: xstate_offset[12]: 2456, xstate_sizes[12]:   24248vm-test-run-nixbot-gitlab> gitlab # [    0.562262] x86/fpu: Enabled xstate features 0x1ae7, context size is 2480 bytes, using 'compacted' format.249vm-test-run-nixbot-gitlab> gitlab # [    0.591865] Freeing SMP alternatives memory: 44K250vm-test-run-nixbot-gitlab> gitlab # [    0.592264] pid_max: default: 32768 minimum: 301251vm-test-run-nixbot-gitlab> gitlab # [    0.593380] LSM: initializing lsm=capability,landlock,yama,bpf,ima252vm-test-run-nixbot-gitlab> gitlab # [    0.594379] landlock: Up and running.253vm-test-run-nixbot-gitlab> gitlab # [    0.595262] Yama: becoming mindful.254vm-test-run-nixbot-gitlab> gitlab # [    0.597287] LSM support for eBPF active255vm-test-run-nixbot-gitlab> gitlab # [    0.598494] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)256vm-test-run-nixbot-gitlab> gitlab # [    0.599410] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)257vm-test-run-nixbot-gitlab> gitlab # [    0.602664] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)258vm-test-run-nixbot-gitlab> gitlab # [    0.603874] Performance Events: Fam17h+ core perfctr, AMD PMU driver.259vm-test-run-nixbot-gitlab> gitlab # [    0.604272] ... version:                   2260vm-test-run-nixbot-gitlab> gitlab # [    0.605263] ... bit width:                 48261vm-test-run-nixbot-gitlab> gitlab # [    0.606263] ... generic counters:          6262vm-test-run-nixbot-gitlab> gitlab # [    0.607263] ... generic bitmap:            000000000000003f263vm-test-run-nixbot-gitlab> gitlab # [    0.608263] ... fixed-purpose counters:    0264vm-test-run-nixbot-gitlab> gitlab # [    0.609263] ... fixed-purpose bitmap:      0000000000000000265vm-test-run-nixbot-gitlab> gitlab # [    0.610264] ... value mask:                0000ffffffffffff266vm-test-run-nixbot-gitlab> gitlab # [    0.611263] ... max period:                00007fffffffffff267vm-test-run-nixbot-gitlab> gitlab # [    0.612263] ... global_ctrl mask:          000000000000003f268vm-test-run-nixbot-gitlab> gitlab # [    0.613377] signal: max sigframe size: 3376269vm-test-run-nixbot-gitlab> gitlab # [    0.614354] rcu: Hierarchical SRCU implementation.270vm-test-run-nixbot-gitlab> gitlab # [    0.615267] rcu: 	Max phase no-delay instances is 400.271vm-test-run-nixbot-gitlab> gitlab # [    0.616480] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level272vm-test-run-nixbot-gitlab> gitlab # [    0.621857] smp: Bringing up secondary CPUs ...273vm-test-run-nixbot-gitlab> gitlab # [    0.622706] smpboot: x86: Booting SMP configuration:274vm-test-run-nixbot-gitlab> gitlab # [    0.623266] .... node  #0, CPUs:      #1 #2 #3275vm-test-run-nixbot-gitlab> gitlab # [    0.625334] smp: Brought up 1 node, 4 CPUs276vm-test-run-nixbot-gitlab> gitlab # [    0.627264] smpboot: Total of 4 processors activated (19200.06 BogoMIPS)277vm-test-run-nixbot-gitlab> gitlab # [    0.628692] Memory: 6013400K/6290904K available (17098K kernel code, 2721K rwdata, 13520K rodata, 3644K init, 3008K bss, 258300K reserved, 0K cma-reserved)278vm-test-run-nixbot-gitlab> gitlab # [    0.629586] devtmpfs: initialized279vm-test-run-nixbot-gitlab> gitlab # [    0.630504] x86/mm: Memory block size: 128MB280vm-test-run-nixbot-gitlab> gitlab # [    0.633317] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns281vm-test-run-nixbot-gitlab> gitlab # [    0.634314] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)282vm-test-run-nixbot-gitlab> gitlab # [    0.635406] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).283vm-test-run-nixbot-gitlab> gitlab # [    0.636394] pinctrl core: initialized pinctrl subsystem284vm-test-run-nixbot-gitlab> gitlab # [    0.637669] PM: RTC time: 13:39:13, date: 2026-06-09285vm-test-run-nixbot-gitlab> gitlab # [    0.641676] NET: Registered PF_NETLINK/PF_ROUTE protocol family286vm-test-run-nixbot-gitlab> gitlab # [    0.643756] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations287vm-test-run-nixbot-gitlab> gitlab # [    0.644319] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations288vm-test-run-nixbot-gitlab> gitlab # [    0.646472] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations289vm-test-run-nixbot-gitlab> gitlab # [    0.647277] audit: initializing netlink subsys (disabled)290vm-test-run-nixbot-gitlab> gitlab # [    0.648351] audit: type=2000 audit(1781012353.866:1): state=initialized audit_enabled=0 res=1291vm-test-run-nixbot-gitlab> gitlab # [    0.648570] thermal_sys: Registered thermal governor 'fair_share'292vm-test-run-nixbot-gitlab> gitlab # [    0.649265] thermal_sys: Registered thermal governor 'bang_bang'293vm-test-run-nixbot-gitlab> gitlab # [    0.650264] thermal_sys: Registered thermal governor 'step_wise'294vm-test-run-nixbot-gitlab> gitlab # [    0.651264] thermal_sys: Registered thermal governor 'user_space'295vm-test-run-nixbot-gitlab> gitlab # [    0.652264] thermal_sys: Registered thermal governor 'power_allocator'296vm-test-run-nixbot-gitlab> gitlab # [    0.653281] cpuidle: using governor menu297vm-test-run-nixbot-gitlab> gitlab # [    0.656489] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5298vm-test-run-nixbot-gitlab> gitlab # [    0.657619] PCI: Using configuration type 1 for base access299vm-test-run-nixbot-gitlab> gitlab # [    0.658264] PCI: Using configuration type 1 for extended access300vm-test-run-nixbot-gitlab> gitlab # [    0.659400] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.301vm-test-run-nixbot-gitlab> gitlab # [    0.661321] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages302vm-test-run-nixbot-gitlab> gitlab # [    0.662264] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page303vm-test-run-nixbot-gitlab> gitlab # [    0.663264] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages304vm-test-run-nixbot-gitlab> gitlab # [    0.664264] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page305vm-test-run-nixbot-gitlab> gitlab # [    0.667560] ACPI: Added _OSI(Module Device)306vm-test-run-nixbot-gitlab> gitlab # [    0.669265] ACPI: Added _OSI(Processor Device)307vm-test-run-nixbot-gitlab> gitlab # [    0.670265] ACPI: Added _OSI(Processor Aggregator Device)308vm-test-run-nixbot-gitlab> gitlab # [    0.674303] ACPI: 1 ACPI AML tables successfully acquired and loaded309vm-test-run-nixbot-gitlab> gitlab # [    0.678513] ACPI: Interpreter enabled310vm-test-run-nixbot-gitlab> gitlab # [    0.679325] ACPI: PM: (supports S0 S3 S4 S5)311vm-test-run-nixbot-gitlab> gitlab # [    0.680266] ACPI: Using IOAPIC for interrupt routing312vm-test-run-nixbot-gitlab> gitlab # [    0.681394] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug313vm-test-run-nixbot-gitlab> gitlab # [    0.684265] PCI: Using E820 reservations for host bridge windows314vm-test-run-nixbot-gitlab> gitlab # [    0.686600] ACPI: Enabled 2 GPEs in block 00 to 0F315vm-test-run-nixbot-gitlab> gitlab # [    0.693544] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])316vm-test-run-nixbot-gitlab> gitlab # [    0.695271] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]317vm-test-run-nixbot-gitlab> gitlab # [    0.697842] acpiphp: Slot [3] registered318vm-test-run-nixbot-gitlab> gitlab # [    0.699307] acpiphp: Slot [4] registered319vm-test-run-nixbot-gitlab> gitlab # [    0.700305] acpiphp: Slot [5] registered320vm-test-run-nixbot-gitlab> gitlab # [    0.701319] acpiphp: Slot [6] registered321vm-test-run-nixbot-gitlab> gitlab # [    0.703304] acpiphp: Slot [7] registered322vm-test-run-nixbot-gitlab> gitlab # [    0.704305] acpiphp: Slot [8] registered323vm-test-run-nixbot-gitlab> gitlab # [    0.705306] acpiphp: Slot [9] registered324vm-test-run-nixbot-gitlab> gitlab # [    0.706321] acpiphp: Slot [10] registered325vm-test-run-nixbot-gitlab> gitlab # [    0.708306] acpiphp: Slot [11] registered326vm-test-run-nixbot-gitlab> gitlab # [    0.709306] acpiphp: Slot [12] registered327vm-test-run-nixbot-gitlab> gitlab # [    0.710318] acpiphp: Slot [13] registered328vm-test-run-nixbot-gitlab> gitlab # [    0.712332] acpiphp: Slot [14] registered329vm-test-run-nixbot-gitlab> gitlab # [    0.713298] acpiphp: Slot [15] registered330vm-test-run-nixbot-gitlab> gitlab # [    0.714297] acpiphp: Slot [16] registered331vm-test-run-nixbot-gitlab> gitlab # [    0.715311] acpiphp: Slot [17] registered332vm-test-run-nixbot-gitlab> gitlab # [    0.717298] acpiphp: Slot [18] registered333vm-test-run-nixbot-gitlab> gitlab # [    0.718297] acpiphp: Slot [19] registered334vm-test-run-nixbot-gitlab> gitlab # [    0.719296] acpiphp: Slot [20] registered335vm-test-run-nixbot-gitlab> gitlab # [    0.720326] acpiphp: Slot [21] registered336vm-test-run-nixbot-gitlab> gitlab # [    0.722306] acpiphp: Slot [22] registered337vm-test-run-nixbot-gitlab> gitlab # [    0.723296] acpiphp: Slot [23] registered338vm-test-run-nixbot-gitlab> gitlab # [    0.724296] acpiphp: Slot [24] registered339vm-test-run-nixbot-gitlab> gitlab # [    0.726311] acpiphp: Slot [25] registered340vm-test-run-nixbot-gitlab> gitlab # [    0.727297] acpiphp: Slot [26] registered341vm-test-run-nixbot-gitlab> gitlab # [    0.728312] acpiphp: Slot [27] registered342vm-test-run-nixbot-gitlab> gitlab # [    0.729310] acpiphp: Slot [28] registered343vm-test-run-nixbot-gitlab> gitlab # [    0.731297] acpiphp: Slot [29] registered344vm-test-run-nixbot-gitlab> gitlab # [    0.732296] acpiphp: Slot [30] registered345vm-test-run-nixbot-gitlab> gitlab # [    0.733297] acpiphp: Slot [31] registered346vm-test-run-nixbot-gitlab> gitlab # [    0.734284] PCI host bridge to bus 0000:00347vm-test-run-nixbot-gitlab> gitlab # [    0.736270] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]348vm-test-run-nixbot-gitlab> gitlab # [    0.738273] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]349vm-test-run-nixbot-gitlab> gitlab # [    0.740265] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]350vm-test-run-nixbot-gitlab> gitlab # [    0.742269] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]351vm-test-run-nixbot-gitlab> gitlab # [    0.744265] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]352vm-test-run-nixbot-gitlab> gitlab # [    0.746341] pci_bus 0000:00: root bus resource [bus 00-ff]353vm-test-run-nixbot-gitlab> gitlab # [    0.751763] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint354vm-test-run-nixbot-gitlab> gitlab # [    0.761110] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint355vm-test-run-nixbot-gitlab> gitlab # [    0.769493] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint356vm-test-run-nixbot-gitlab> gitlab # [    0.779448] pci 0000:00:01.1: BAR 4 [io  0xc220-0xc22f]357vm-test-run-nixbot-gitlab> gitlab # [    0.783436] pci 0000:00:01.1: BAR 0 [io  0x01f0-0x01f7]: legacy IDE quirk358vm-test-run-nixbot-gitlab> gitlab # [    0.788273] pci 0000:00:01.1: BAR 1 [io  0x03f6]: legacy IDE quirk359vm-test-run-nixbot-gitlab> gitlab # [    0.793273] pci 0000:00:01.1: BAR 2 [io  0x0170-0x0177]: legacy IDE quirk360vm-test-run-nixbot-gitlab> gitlab # [    0.798270] pci 0000:00:01.1: BAR 3 [io  0x0376]: legacy IDE quirk361vm-test-run-nixbot-gitlab> gitlab # [    0.801890] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint362vm-test-run-nixbot-gitlab> gitlab # [    0.809399] pci 0000:00:01.2: BAR 4 [io  0xc140-0xc15f]363vm-test-run-nixbot-gitlab> gitlab # [    0.815401] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint364vm-test-run-nixbot-gitlab> gitlab # [    0.818073] pci 0000:00:01.3: quirk: [io  0x0600-0x063f] claimed by PIIX4 ACPI365vm-test-run-nixbot-gitlab> gitlab # [    0.820279] pci 0000:00:01.3: quirk: [io  0x0700-0x070f] claimed by PIIX4 SMB366vm-test-run-nixbot-gitlab> gitlab # [    0.822802] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint367vm-test-run-nixbot-gitlab> gitlab # [    0.833362] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]368vm-test-run-nixbot-gitlab> gitlab # [    0.835291] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]369vm-test-run-nixbot-gitlab> gitlab # [    0.837316] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]370vm-test-run-nixbot-gitlab> gitlab # [    0.838530] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]371vm-test-run-nixbot-gitlab> gitlab # [    0.842697] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint372vm-test-run-nixbot-gitlab> gitlab # [    0.861279] pci 0000:00:03.0: BAR 0 [io  0xc160-0xc17f]373vm-test-run-nixbot-gitlab> gitlab # [    0.863279] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]374vm-test-run-nixbot-gitlab> gitlab # [    0.864325] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]375vm-test-run-nixbot-gitlab> gitlab # [    0.866279] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]376vm-test-run-nixbot-gitlab> gitlab # [    0.871478] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint377vm-test-run-nixbot-gitlab> gitlab # [    0.876281] pci 0000:00:04.0: BAR 0 [io  0xc180-0xc19f]378vm-test-run-nixbot-gitlab> gitlab # [    0.878290] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]379vm-test-run-nixbot-gitlab> gitlab # [    0.880329] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]380vm-test-run-nixbot-gitlab> gitlab # [    0.884629] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint381vm-test-run-nixbot-gitlab> gitlab # [    0.891281] pci 0000:00:05.0: BAR 0 [io  0xc1a0-0xc1bf]382vm-test-run-nixbot-gitlab> gitlab # [    0.893279] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]383vm-test-run-nixbot-gitlab> gitlab # [    0.894317] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]384vm-test-run-nixbot-gitlab> gitlab # [    0.899264] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint385vm-test-run-nixbot-gitlab> gitlab # [    0.904283] pci 0000:00:06.0: BAR 0 [io  0xc1c0-0xc1df]386vm-test-run-nixbot-gitlab> gitlab # [    0.906279] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]387vm-test-run-nixbot-gitlab> gitlab # [    0.908317] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]388vm-test-run-nixbot-gitlab> gitlab # [    0.912264] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint389vm-test-run-nixbot-gitlab> gitlab # [    0.917278] pci 0000:00:07.0: BAR 0 [io  0xc000-0xc07f]390vm-test-run-nixbot-gitlab> gitlab # [    0.919279] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]391vm-test-run-nixbot-gitlab> gitlab # [    0.921317] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]392vm-test-run-nixbot-gitlab> gitlab # [    0.925502] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint393vm-test-run-nixbot-gitlab> gitlab # [    0.930293] pci 0000:00:08.0: BAR 0 [io  0xc080-0xc0ff]394vm-test-run-nixbot-gitlab> gitlab # [    0.932279] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]395vm-test-run-nixbot-gitlab> gitlab # [    0.934329] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]396vm-test-run-nixbot-gitlab> gitlab # [    0.939469] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint397vm-test-run-nixbot-gitlab> gitlab # [    0.947708] pci 0000:00:09.0: BAR 0 [io  0xc1e0-0xc1ff]398vm-test-run-nixbot-gitlab> gitlab # [    0.951312] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]399vm-test-run-nixbot-gitlab> gitlab # [    0.955408] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]400vm-test-run-nixbot-gitlab> gitlab # [    0.961311] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]401vm-test-run-nixbot-gitlab> gitlab # [    0.971368] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint402vm-test-run-nixbot-gitlab> gitlab # [    0.980369] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]403vm-test-run-nixbot-gitlab> gitlab # [    0.984377] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]404vm-test-run-nixbot-gitlab> gitlab # [    0.992347] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint405vm-test-run-nixbot-gitlab> gitlab # [    0.998397] pci 0000:00:0b.0: BAR 0 [io  0xc100-0xc13f]406vm-test-run-nixbot-gitlab> gitlab # [    1.000280] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]407vm-test-run-nixbot-gitlab> gitlab # [    1.002320] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]408vm-test-run-nixbot-gitlab> gitlab # [    1.006926] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint409vm-test-run-nixbot-gitlab> gitlab # [    1.013281] pci 0000:00:0c.0: BAR 0 [io  0xc200-0xc21f]410vm-test-run-nixbot-gitlab> gitlab # [    1.014279] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]411vm-test-run-nixbot-gitlab> gitlab # [    1.016317] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]412vm-test-run-nixbot-gitlab> gitlab # [    1.025648] ACPI: PCI: Interrupt link LNKA configured for IRQ 10413vm-test-run-nixbot-gitlab> gitlab # [    1.028472] ACPI: PCI: Interrupt link LNKB configured for IRQ 10414vm-test-run-nixbot-gitlab> gitlab # [    1.029469] ACPI: PCI: Interrupt link LNKC configured for IRQ 11415vm-test-run-nixbot-gitlab> gitlab # [    1.032477] ACPI: PCI: Interrupt link LNKD configured for IRQ 11416vm-test-run-nixbot-gitlab> gitlab # [    1.034380] ACPI: PCI: Interrupt link LNKS configured for IRQ 9417vm-test-run-nixbot-gitlab> gitlab # [    1.037540] iommu: Default domain type: Translated418vm-test-run-nixbot-gitlab> gitlab # [    1.039264] iommu: DMA domain TLB invalidation policy: lazy mode419vm-test-run-nixbot-gitlab> gitlab # [    1.041508] ACPI: bus type USB registered420vm-test-run-nixbot-gitlab> gitlab # [    1.042343] usbcore: registered new interface driver usbfs421vm-test-run-nixbot-gitlab> gitlab # [    1.044339] usbcore: registered new interface driver hub422vm-test-run-nixbot-gitlab> gitlab # [    1.046276] usbcore: registered new device driver usb423vm-test-run-nixbot-gitlab> gitlab # [    1.048921] NetLabel: Initializing424vm-test-run-nixbot-gitlab> gitlab # [    1.050264] NetLabel:  domain hash size = 128425vm-test-run-nixbot-gitlab> gitlab # [    1.051263] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO426vm-test-run-nixbot-gitlab> gitlab # [    1.053318] NetLabel:  unlabeled traffic allowed by default427vm-test-run-nixbot-gitlab> gitlab # [    1.054278] PCI: Using ACPI for IRQ routing428vm-test-run-nixbot-gitlab> gitlab # [    1.057297] pci 0000:00:02.0: vgaarb: setting as boot VGA device429vm-test-run-nixbot-gitlab> gitlab # [    1.058259] pci 0000:00:02.0: vgaarb: bridge control possible430vm-test-run-nixbot-gitlab> gitlab # [    1.058259] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none431vm-test-run-nixbot-gitlab> gitlab # [    1.062268] vgaarb: loaded432vm-test-run-nixbot-gitlab> gitlab # [    1.063625] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0433vm-test-run-nixbot-gitlab> gitlab # [    1.065264] hpet0: 3 comparators, 64-bit 100.000000 MHz counter434vm-test-run-nixbot-gitlab> gitlab # [    1.070357] clocksource: Switched to clocksource kvm-clock435vm-test-run-nixbot-gitlab> gitlab # [    1.077125] VFS: Disk quotas dquot_6.6.0436vm-test-run-nixbot-gitlab> gitlab # [    1.079705] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)437vm-test-run-nixbot-gitlab> gitlab # [    1.084575] pnp: PnP ACPI init438vm-test-run-nixbot-gitlab> gitlab # [    1.088098] pnp: PnP ACPI: found 6 devices439vm-test-run-nixbot-gitlab> gitlab # [    1.101827] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns440vm-test-run-nixbot-gitlab> gitlab # [    1.107249] clocksource: Switched to clocksource acpi_pm441vm-test-run-nixbot-gitlab> gitlab # [    1.110811] NET: Registered PF_INET protocol family442vm-test-run-nixbot-gitlab> gitlab # [    1.114533] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)443vm-test-run-nixbot-gitlab> gitlab # [    1.134750] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)444vm-test-run-nixbot-gitlab> gitlab # [    1.137412] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)445vm-test-run-nixbot-gitlab> gitlab # [    1.140573] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)446vm-test-run-nixbot-gitlab> gitlab # [    1.152388] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)447vm-test-run-nixbot-gitlab> gitlab # [    1.158404] TCP: Hash tables configured (established 65536 bind 65536)448vm-test-run-nixbot-gitlab> gitlab # [    1.164280] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)449vm-test-run-nixbot-gitlab> gitlab # [    1.170943] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)450vm-test-run-nixbot-gitlab> gitlab # [    1.176827] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)451vm-test-run-nixbot-gitlab> gitlab # [    1.182385] NET: Registered PF_UNIX/PF_LOCAL protocol family452vm-test-run-nixbot-gitlab> gitlab # [    1.185918] NET: Registered PF_XDP protocol family453vm-test-run-nixbot-gitlab> gitlab # [    1.189029] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]454vm-test-run-nixbot-gitlab> gitlab # [    1.192761] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]455vm-test-run-nixbot-gitlab> gitlab # [    1.196498] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]456vm-test-run-nixbot-gitlab> gitlab # [    1.200581] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]457vm-test-run-nixbot-gitlab> gitlab # [    1.204626] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]458vm-test-run-nixbot-gitlab> gitlab # [    1.209326] pci 0000:00:01.0: PIIX3: Enabling Passive Release459vm-test-run-nixbot-gitlab> gitlab # [    1.211282] pci 0000:00:00.0: Limiting direct PCI/PCI transfers460vm-test-run-nixbot-gitlab> gitlab # [    1.218333] ACPI: \_SB_.LNKD: Enabled at IRQ 11461vm-test-run-nixbot-gitlab> gitlab # [    1.225923] pci 0000:00:01.2: quirk_usb_early_handoff+0x0/0x7c0 took 10604 usecs462vm-test-run-nixbot-gitlab> gitlab # [    1.232238] PCI: CLS 0 bytes, default 64463vm-test-run-nixbot-gitlab> gitlab # [    1.235634] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)464vm-test-run-nixbot-gitlab> gitlab # [    1.236029] Trying to unpack rootfs image as initramfs...465vm-test-run-nixbot-gitlab> gitlab # [    1.236541] software IO TLB: mapped [mem 0x00000000ba4e0000-0x00000000be4e0000] (64MB)466vm-test-run-nixbot-gitlab> gitlab # [    1.248957] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns467vm-test-run-nixbot-gitlab> gitlab # [    1.278973] Initialise system trusted keyrings468vm-test-run-nixbot-gitlab> gitlab # [    1.281056] workingset: timestamp_bits=40 max_order=21 bucket_order=0469vm-test-run-nixbot-gitlab> gitlab # [    1.313224] Key type asymmetric registered470vm-test-run-nixbot-gitlab> gitlab # [    1.315860] Asymmetric key parser 'x509' registered471vm-test-run-nixbot-gitlab> gitlab # [    1.319258] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)472vm-test-run-nixbot-gitlab> gitlab # [    1.324297] io scheduler mq-deadline registered473vm-test-run-nixbot-gitlab> gitlab # [    1.327188] io scheduler kyber registered474vm-test-run-nixbot-gitlab> gitlab # [    1.335827] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled475vm-test-run-nixbot-gitlab> gitlab # [    1.340975] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A476vm-test-run-nixbot-gitlab> gitlab # [    1.351386] Linux agpgart interface v0.103477vm-test-run-nixbot-gitlab> gitlab # [    1.354748] ACPI: bus type drm_connector registered478vm-test-run-nixbot-gitlab> gitlab # [    1.362264] usbcore: registered new interface driver usbserial_generic479vm-test-run-nixbot-gitlab> gitlab # [    1.367089] usbserial: USB Serial support registered for generic480vm-test-run-nixbot-gitlab> gitlab # [    1.371599] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.481vm-test-run-nixbot-gitlab> gitlab # [    1.371599] Please enable it if your BIOS has the CPPC option.482vm-test-run-nixbot-gitlab> gitlab # [    1.381461] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled483vm-test-run-nixbot-gitlab> gitlab # [    1.386792] drop_monitor: Initializing network drop monitor service484vm-test-run-nixbot-gitlab> gitlab # [    1.390743] NET: Registered PF_INET6 protocol family485vm-test-run-nixbot-gitlab> gitlab # [    1.396025] Segment Routing with IPv6486vm-test-run-nixbot-gitlab> gitlab # [    1.398593] In-situ OAM (IOAM) with IPv6487vm-test-run-nixbot-gitlab> gitlab # [    1.403644] IPI shorthand broadcast: enabled488vm-test-run-nixbot-gitlab> gitlab # [    1.416701] sched_clock: Marking stable (1158076018, 258110589)->(1498026487, -81839880)489vm-test-run-nixbot-gitlab> gitlab # [    1.424369] registered taskstats version 1490vm-test-run-nixbot-gitlab> gitlab # [    1.428679] Loading compiled-in X.509 certificates491vm-test-run-nixbot-gitlab> gitlab # [    1.452367] Demotion targets for Node 0: null492vm-test-run-nixbot-gitlab> gitlab # [    1.454415] Key type .fscrypt registered493vm-test-run-nixbot-gitlab> gitlab # [    1.455662] Key type fscrypt-provisioning registered494vm-test-run-nixbot-gitlab> gitlab # [    1.458439] ima: No TPM chip found, activating TPM-bypass!495vm-test-run-nixbot-gitlab> gitlab # [    1.460091] ima: Allocated hash algorithm: sha1496vm-test-run-nixbot-gitlab> gitlab # [    1.461568] ima: No architecture policies found497vm-test-run-nixbot-gitlab> gitlab # [    1.463354] PM:   Magic number: 14:187:685498vm-test-run-nixbot-gitlab> gitlab # [    1.464685]  clocksource: hash matches499vm-test-run-nixbot-gitlab> gitlab # [    1.466818] RAS: Correctable Errors collector initialized.500vm-test-run-nixbot-gitlab> gitlab # [    1.472600] clk: Disabling unused clocks501vm-test-run-nixbot-gitlab> gitlab # [    1.473883] PM: genpd: Disabling unused power domains502vm-test-run-nixbot-gitlab> gitlab # [    1.489399] Freeing initrd memory: 27584K503vm-test-run-nixbot-gitlab> gitlab # [    1.493643] Freeing unused decrypted memory: 2028K504vm-test-run-nixbot-gitlab> gitlab # [    1.497362] Freeing unused kernel image (initmem) memory: 3644K505vm-test-run-nixbot-gitlab> gitlab # [    1.499275] Write protecting the kernel read-only data: 32768k506vm-test-run-nixbot-gitlab> gitlab # [    1.502431] Freeing unused kernel image (text/rodata gap) memory: 1332K507vm-test-run-nixbot-gitlab> gitlab # [    1.505014] Freeing unused kernel image (rodata/data gap) memory: 816K508vm-test-run-nixbot-gitlab> gitlab # [    1.557510] x86/mm: Checked W+X mappings: passed, no W+X pages found.509vm-test-run-nixbot-gitlab> gitlab # [    1.559571] Run /init as init process510vm-test-run-nixbot-gitlab> gitlab # [    1.575030] systemd[1]: Inserted module 'autofs4'511vm-test-run-nixbot-gitlab> gitlab # [    1.605076] fuse: init (API version 7.45)512vm-test-run-nixbot-gitlab> gitlab # [    1.615829] ACPI: \_SB_.LNKC: Enabled at IRQ 10513vm-test-run-nixbot-gitlab> gitlab # [    1.625190] ACPI: \_SB_.LNKA: Enabled at IRQ 10514vm-test-run-nixbot-gitlab> gitlab # [    1.641979] ACPI: \_SB_.LNKB: Enabled at IRQ 11515vm-test-run-nixbot-gitlab> gitlab # [    1.691205] systemd[1]: Successfully made /usr/ read-only.516vm-test-run-nixbot-gitlab> gitlab # [    2.029211] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)517vm-test-run-nixbot-gitlab> gitlab # [    2.037940] systemd[1]: Detected virtualization kvm.518vm-test-run-nixbot-gitlab> gitlab # [    2.039516] systemd[1]: Detected architecture x86-64.519vm-test-run-nixbot-gitlab> gitlab # [    2.041082] systemd[1]: Running in initrd.520vm-test-run-nixbot-gitlab> gitlab # [    2.042787] systemd[1]: Initializing machine ID from random generator.521vm-test-run-nixbot-gitlab> gitlab # [    2.044924] systemd[1]: Hostname set to <gitlab>.522vm-test-run-nixbot-gitlab> gitlab # [    2.101756] systemd[1]: Queued start job for default target Initrd Default Target.523vm-test-run-nixbot-gitlab> gitlab # [    2.183566] systemd[1]: Created slice Slice /system/modprobe.524vm-test-run-nixbot-gitlab> gitlab # [    2.185625] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.525vm-test-run-nixbot-gitlab> gitlab # [    2.188056] systemd[1]: Expecting device /dev/disk/by-label/nix-store...526vm-test-run-nixbot-gitlab> gitlab # [    2.190155] systemd[1]: Expecting device /dev/disk/by-label/nixos...527vm-test-run-nixbot-gitlab> gitlab # [    2.192194] systemd[1]: Reached target Path Units.528vm-test-run-nixbot-gitlab> gitlab # [    2.193779] systemd[1]: Reached target Slice Units.529vm-test-run-nixbot-gitlab> gitlab # [    2.195360] systemd[1]: Reached target Swaps.530vm-test-run-nixbot-gitlab> gitlab # [    2.198362] systemd[1]: Reached target Timer Units.531vm-test-run-nixbot-gitlab> gitlab # [    2.201028] systemd[1]: Listening on D-Bus System Message Bus Socket.532vm-test-run-nixbot-gitlab> gitlab # [    2.203273] systemd[1]: Listening on Journal Socket (/dev/log).533vm-test-run-nixbot-gitlab> gitlab # [    2.205310] systemd[1]: Listening on Journal Sockets.534vm-test-run-nixbot-gitlab> gitlab # [    2.207080] systemd[1]: Listening on udev Control Socket.535vm-test-run-nixbot-gitlab> gitlab # [    2.208914] systemd[1]: Listening on udev Kernel Socket.536vm-test-run-nixbot-gitlab> gitlab # [    2.210624] systemd[1]: Reached target Socket Units.537vm-test-run-nixbot-gitlab> gitlab # [    2.216025] systemd[1]: Starting Create List of Static Device Nodes...538vm-test-run-nixbot-gitlab> gitlab # [    2.230457] systemd[1]: Starting Load Kernel Module 9pnet_virtio...539vm-test-run-nixbot-gitlab> gitlab # [    2.234482] systemd[1]: Starting Load Kernel Module configfs...540vm-test-run-nixbot-gitlab> gitlab # [    2.239608] systemd[1]: Starting Journal Service...541vm-test-run-nixbot-gitlab> gitlab # [    2.243251] systemd[1]: Starting Load Kernel Modules...542vm-test-run-nixbot-gitlab> gitlab # [    2.244948] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki543vm-test-run-nixbot-gitlab> gitlab # [    2.249741] systemd[1]: Starting Coldplug All udev Devices...544vm-test-run-nixbot-gitlab> gitlab # [    2.265065] systemd[1]: Finished Create List of Static Device Nodes.545vm-test-run-nixbot-gitlab> gitlab # [    2.271734] netfs: FS-Cache loaded546vm-test-run-nixbot-gitlab> gitlab # [    2.274239] systemd[1]: modprobe@configfs.service: Deactivated successfully.547vm-test-run-nixbot-gitlab> gitlab # [    2.277902] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.548vm-test-run-nixbot-gitlab> gitlab # [    2.282065] systemd[1]: Finished Load Kernel Module configfs.549vm-test-run-nixbot-gitlab> gitlab # [    2.284309] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev550vm-test-run-nixbot-gitlab> gitlab # [    2.286758] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config551vm-test-run-nixbot-gitlab> gitlab # [    2.287393] systemd-journald[152]: Collecting audit messages is disabled.552vm-test-run-nixbot-gitlab> gitlab # [    2.293916] 9pnet: Installing 9P2000 support553vm-test-run-nixbot-gitlab> gitlab # [    2.296224] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...554vm-test-run-nixbot-gitlab> gitlab # [    2.304362] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.555vm-test-run-nixbot-gitlab> gitlab # [    2.311750] systemd[1]: Finished Load Kernel Module 9pnet_virtio.556vm-test-run-nixbot-gitlab> gitlab # [    2.318413] systemd[1]: Finished Load Kernel Modules.557vm-test-run-nixbot-gitlab> gitlab # [    2.321999] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.558vm-test-run-nixbot-gitlab> gitlab # [    2.326997] systemd[1]: Starting Apply Kernel Variables...559vm-test-run-nixbot-gitlab> gitlab # [    2.335460] systemd[1]: Starting Create Static Device Nodes in /dev...560vm-test-run-nixbot-gitlab> gitlab # [    2.343327] systemd[1]: Finished Apply Kernel Variables.561vm-test-run-nixbot-gitlab> gitlab # [    2.349783] systemd[1]: Finished Create Static Device Nodes in /dev.562vm-test-run-nixbot-gitlab> gitlab # [    2.352078] systemd[1]: Reached target Preparation for Local File Systems.563vm-test-run-nixbot-gitlab> gitlab # [    2.354338] systemd[1]: Reached target Local File Systems.564vm-test-run-nixbot-gitlab> gitlab # [    2.096278] systemd-modules-load[154]: Using 4 probe threads565vm-test-run-nixbot-gitlab> gitlab # [    2.099837] systemd-modules-load[154]: Inserted module 'virtio_balloon'566vm-test-run-nixbot-gitlab> gitlab # [    2.358491] systemd[1]: Starting Rule-based Manager for Device Events and Files...567vm-test-run-nixbot-gitlab> gitlab # [    2.103076] systemd-modules-l[    2.360940] systemd[1]: Started Journal Service.568vm-test-run-nixbot-gitlab> gitlab # oad[154]: Inserted module 'dm_mod'569vm-test-run-nixbot-gitlab> gitlab # [    2.105555] systemd-modules-load[154]: Inserted module 'virtio_gpu'570vm-test-run-nixbot-gitlab> gitlab # [    2.117703] systemd[1]: Starting Create System Files and Directories...571vm-test-run-nixbot-gitlab> gitlab # [    2.131819] systemd-udevd[183]: Using default interface naming scheme 'v260'.572vm-test-run-nixbot-gitlab> gitlab # [    2.136256] systemd[1]: Finished Create System Files and Directories.573vm-test-run-nixbot-gitlab> gitlab # [    2.147914] systemd[1]: Started Rule-based Manager for Device Events and Files.574vm-test-run-nixbot-gitlab> gitlab # [    2.164659] systemd[1]: Finished Coldplug All udev Devices.575vm-test-run-nixbot-gitlab> gitlab # [    2.166107] systemd[1]: Reached target System Initialization.576vm-test-run-nixbot-gitlab> gitlab # [    2.167520] systemd[1]: Reached target Basic System.577vm-test-run-nixbot-gitlab> gitlab # [    2.542397] uhci_hcd 0000:00:01.2: UHCI Host Controller578vm-test-run-nixbot-gitlab> gitlab # [    2.543720] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1579vm-test-run-nixbot-gitlab> gitlab # [    2.545649] uhci_hcd 0000:00:01.2: detected 2 ports580vm-test-run-nixbot-gitlab> gitlab # [    2.547057] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140581vm-test-run-nixbot-gitlab> gitlab # [    2.548773] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18582vm-test-run-nixbot-gitlab> gitlab # [    2.550742] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1583vm-test-run-nixbot-gitlab> gitlab # [    2.552521] usb usb1: Product: UHCI Host Controller584vm-test-run-nixbot-gitlab> gitlab # [    2.553735] usb usb1: Manufacturer: Linux 6.18.34 uhci_hcd585vm-test-run-nixbot-gitlab> gitlab # [    2.555046] usb usb1: SerialNumber: 0000:00:01.2586vm-test-run-nixbot-gitlab> gitlab # [    2.559012] hub 1-0:1.0: USB hub found587vm-test-run-nixbot-gitlab> gitlab # [    2.560161] hub 1-0:1.0: 2 ports detected588vm-test-run-nixbot-gitlab> gitlab # [    2.560532] virtio_blk virtio4: 4/0/0 default/read/poll queues589vm-test-run-nixbot-gitlab> gitlab # [    2.566299] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)590vm-test-run-nixbot-gitlab> gitlab # [    2.568368] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12591vm-test-run-nixbot-gitlab> gitlab # [    2.572265] serio: i8042 KBD port at 0x60,0x64 irq 1592vm-test-run-nixbot-gitlab> gitlab # [    2.573456] serio: i8042 AUX port at 0x60,0x64 irq 12593vm-test-run-nixbot-gitlab> gitlab # [    2.574555] virtio_blk virtio5: 4/0/0 default/read/poll queues594vm-test-run-nixbot-gitlab> gitlab # [    2.580455] SCSI subsystem initialized595vm-test-run-nixbot-gitlab> gitlab # [    2.599686] virtio_blk virtio5: [vdb] 11527040 512-byte logical blocks (5.90 GB/5.50 GiB)596vm-test-run-nixbot-gitlab> gitlab # [    2.396340] (udev-worker)[211]:     2.654498] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0597vm-test-run-nixbot-gitlab> gitlab # 1;38:5:185meth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.598vm-test-run-nixbot-gitlab> gitlab # [    2.402647] (udev-worker)[211]: Network interface NamePolicy= disabled on kernel command line.599vm-test-run-nixbot-gitlab> gitlab # [    2.405337] (udev-worker)[213]: Network interface NamePolicy= disabled on ker[    2.664323] scsi host0: ata_piix600vm-test-run-nixbot-gitlab> gitlab # nel command line.601vm-test-run-nixbot-gitlab> gitlab # [    2.408248] systemd[1]: Starting Virtual Console Setup...602vm-test-run-nixbot-gitlab> gitlab # [    2.412347] systemd[1]: Found device /dev/disk/by-label/nixos.603vm-test-run-nixbot-gitlab> gitlab # [    2.413969] systemd[1]: Reached target Initrd Root Device.[    2.673216] scsi host1: ata_piix604vm-test-run-nixbot-gitlab> gitlab # [    2.674513] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0605vm-test-run-nixbot-gitlab> gitlab # 606vm-test-run-nixbot-gitlab> gitlab # [    2.676325] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0607vm-test-run-nixbot-gitlab> gitlab # [    2.423785] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...608vm-test-run-nixbot-gitlab> gitlab # [    2.429110] systemd[1]: Found device /dev/disk/by-label/nix-store.609vm-test-run-nixbot-gitlab> gitlab # [    2.433737] systemd-vconsole-setup[230]: Configuration of first virtual console was skipped, ignoring remaining ones.610vm-test-run-nixbot-gitlab> gitlab # [    2.438746] systemd[1]: Finished Virtual Console Setup.611vm-test-run-nixbot-gitlab> gitlab # [    2.440341] systemd-fsck[239]: nixos: clean, 12/65536 files, 13019/262144 blocks612vm-test-run-nixbot-gitlab> gitlab # [    2.444914] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.613vm-test-run-nixbot-gitlab> gitlab # [    2.785360] usb 1-1: new full-speed USB device number 2 using uhci_hcd614vm-test-run-nixbot-gitlab> gitlab # [    2.833531] ata2: found unknown device (class 0)615vm-test-run-nixbot-gitlab> gitlab # [    2.838360] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100616vm-test-run-nixbot-gitlab> gitlab # [    2.845526] scsi 1:0:0:0: CD-ROM            QEMU     QEMU DVD-ROM     2.5+ PQ: 0 ANSI: 5617vm-test-run-nixbot-gitlab> gitlab # [    2.918548] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray618vm-test-run-nixbot-gitlab> gitlab # [    2.954664] cdrom: Uniform CD-ROM driver Revision: 3.20619vm-test-run-nixbot-gitlab> gitlab # [    2.954669] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00620vm-test-run-nixbot-gitlab> gitlab # [    2.962680] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10621vm-test-run-nixbot-gitlab> gitlab # [    2.967004] usb 1-1: Product: QEMU USB Tablet622vm-test-run-nixbot-gitlab> gitlab # [    2.969938] usb 1-1: Manufacturer: QEMU623vm-test-run-nixbot-gitlab> gitlab # [    2.972529] usb 1-1: SerialNumber: 28754-0000:00:01.2-1624vm-test-run-nixbot-gitlab> gitlab # [    3.011541] hid: raw HID events driver (C) Jiri Kosina625vm-test-run-nixbot-gitlab> gitlab # [    3.028290] usbcore: registered new interface driver usbhid626vm-test-run-nixbot-gitlab> gitlab # [    3.031621] usbhid: USB HID core driver627vm-test-run-nixbot-gitlab> gitlab # [    3.044536] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2628vm-test-run-nixbot-gitlab> gitlab # [    3.051937] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0629vm-test-run-nixbot-gitlab> gitlab # [    3.010246] systemd[1]: Mounting /sysroot...630vm-test-run-nixbot-gitlab> gitlab # [    3.443083] EXT4-fs (vda): mounted filesystem 6d1207e1-b29f-4134-be0c-9340828284b1 r/w with ordered data mode. Quota mode: none.631vm-test-run-nixbot-gitlab> gitlab # [    3.192318] systemd[1]: Mounted /sysroot.632vm-test-run-nixbot-gitlab> gitlab # [    3.194206] systemd[1]: Reached target Initrd Root File System.633vm-test-run-nixbot-gitlab> gitlab # [    3.197763] systemd[1]: Mounting /sysroot/nix/.ro-store...634vm-test-run-nixbot-gitlab> gitlab # [    3.200958] systemd[1]: Mounting /sysroot/nix/.rw-store...635vm-test-run-nixbot-gitlab> gitlab # [    3.220290] systemd[1]: Mounting /sysroot/run...636vm-test-run-nixbot-gitlab> gitlab # [    3.222501] systemd[1]: Mounting /sysroot/tmp/shared...637vm-test-run-nixbot-gitlab> gitlab # [    3.226391] systemd[1]: Mounting /sysroot/tmp/xchg...638vm-test-run-nixbot-gitlab> gitlab # [    3.231428] systemd[1]: Starting Mountpoints Configured in the Real Root...639vm-test-run-nixbot-gitlab> gitlab # [    3.238626] systemd-sysroot-fstab-check[271]: /sysroot should be mounted in the initrd, will request daemon-reload.640vm-test-run-nixbot-gitlab> gitlab # [    3.243332] systemd[1]: Mounted /sysroot/nix/[    3.501522] erofs (device vdb): mounted with root inode @ nid 128.641vm-test-run-nixbot-gitlab> gitlab # .rw-store.642vm-test-run-nixbot-gitlab> gitlab # [    3.247264] systemd[1]: Mounted /sysroot/run.643vm-test-run-nixbot-gitlab> gitlab # [    3.248855] systemd[1]: Mount[    3.506926] 9p: Installing v9fs 9p2000 file system support644vm-test-run-nixbot-gitlab> gitlab # ed /sysroot/nix/.ro-store.645vm-test-run-nixbot-gitlab> gitlab # [    3.251749] systemd[1]: Reload requested from client PID 271 ('systemd-sysroot') (unit initrd-parse-etc.service)...646vm-test-run-nixbot-gitlab> gitlab # [    3.254808] systemd[1]: Reloading...647vm-test-run-nixbot-gitlab> gitlab # [    3.429409] systemd[1]: Reloading finished in 180 ms.648vm-test-run-nixbot-gitlab> gitlab # [    3.481761] systemd-sysroot-fstab-check[271]: Requesting initrd-fs.target/start/replace...649vm-test-run-nixbot-gitlab> gitlab # [    3.632927] systemd[1]: Mounted /sysroot/tmp/shared.650vm-test-run-nixbot-gitlab> gitlab # [    3.636253] systemd[1]: Mounted /sysroot/tmp/xchg.651vm-test-run-nixbot-gitlab> gitlab # [    3.641000] systemd-sysroot-fstab-check[271]: Requesting swap.target/start/replace...652vm-test-run-nixbot-gitlab> gitlab # [    3.647620] systemd[1]: Starting rw-sysroot-nix-store.service...653vm-test-run-nixbot-gitlab> gitlab # [    3.651263] systemd[1]: initrd-parse-etc.service: Deactivated successfully.654vm-test-run-nixbot-gitlab> gitlab # [    3.655408] systemd[1]: Finished Mountpoints Configured in the Real Root.655vm-test-run-nixbot-gitlab> gitlab # [    3.658836] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.656vm-test-run-nixbot-gitlab> gitlab # [    3.691266] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.657vm-test-run-nixbot-gitlab> gitlab # [    3.695253] systemd[1]: Finished rw-sysroot-nix-store.service.658vm-test-run-nixbot-gitlab> gitlab # [    4.010646] systemd[1]: Mounting /sysroot/nix/store...659vm-test-run-nixbot-gitlab> gitlab # [    4.070371] systemd[1]: Mounted /sysroot/nix/store.660vm-test-run-nixbot-gitlab> gitlab # [    4.073822] systemd[1]: Reached target Initrd File Systems.661vm-test-run-nixbot-gitlab> gitlab # [    4.078943] systemd[1]: Starting Find NixOS closure...662vm-test-run-nixbot-gitlab> gitlab # [    4.084981] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...663vm-test-run-nixbot-gitlab> gitlab # [    4.114235] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.664vm-test-run-nixbot-gitlab> gitlab # [    4.118486] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.665vm-test-run-nixbot-gitlab> gitlab # [    4.133814] systemd[1]: Finished Find NixOS closure.666vm-test-run-nixbot-gitlab> gitlab # [    4.138678] systemd[1]: Reached target Initrd Default Target.667vm-test-run-nixbot-gitlab> gitlab # [    4.145234] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...668vm-test-run-nixbot-gitlab> gitlab # [    4.186552] systemd[1]: Stopped target Initrd Default Target.669vm-test-run-nixbot-gitlab> gitlab # [    4.190580] systemd[1]: Stopped target Basic System.670vm-test-run-nixbot-gitlab> gitlab # [    4.194490] systemd[1]: Stopped target Initrd Root Device.671vm-test-run-nixbot-gitlab> gitlab # [    4.198242] systemd[1]: Stopped target Path Units.672vm-test-run-nixbot-gitlab> gitlab # [    4.201573] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.673vm-test-run-nixbot-gitlab> gitlab # [    4.206464] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.674vm-test-run-nixbot-gitlab> gitlab # [    4.211463] systemd[1]: Stopped target Slice Units.675vm-test-run-nixbot-gitlab> gitlab # [    4.214923] systemd[1]: Stopped target Socket Units.676vm-test-run-nixbot-gitlab> gitlab # [    4.218476] systemd[1]: Stopped target System Initialization.677vm-test-run-nixbot-gitlab> gitlab # [    4.222391] systemd[1]: Stopped target Swaps.678vm-test-run-nixbot-gitlab> gitlab # [    4.225565] systemd[1]: Stopped target Timer Units.679vm-test-run-nixbot-gitlab> gitlab # [    4.228920] systemd[1]: dbus.socket: Deactivated successfully.680vm-test-run-nixbot-gitlab> gitlab # [    4.232184] systemd[1]: Closed D-Bus System Message Bus Socket.681vm-test-run-nixbot-gitlab> gitlab # [    4.235296] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.682vm-test-run-nixbot-gitlab> gitlab # [    4.238749] systemd[1]: Stopped Find NixOS closure.683vm-test-run-nixbot-gitlab> gitlab # [    4.241149] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio684vm-test-run-nixbot-gitlab> gitlab # [    4.246333] systemd[1]: Starting rw-sysroot-nix-store.service...685vm-test-run-nixbot-gitlab> gitlab # [    4.249488] systemd[1]: systemd-sysctl.service: Deactivated successfully.686vm-test-run-nixbot-gitlab> gitlab # [    4.252336] systemd[1]: Stopped Apply Kernel Variables.687vm-test-run-nixbot-gitlab> gitlab # [    4.254202] systemd[1]: systemd-modules-load.service: Deactivated successfully.688vm-test-run-nixbot-gitlab> gitlab # [    4.255918] systemd[1]: Stopped Load Kernel Modules.689vm-test-run-nixbot-gitlab> gitlab # [    4.257209] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.690vm-test-run-nixbot-gitlab> gitlab # [    4.259083] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.691vm-test-run-nixbot-gitlab> gitlab # [    4.260962] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.692vm-test-run-nixbot-gitlab> gitlab # [    4.262688] systemd[1]: Stopped Create System Files and Directories.693vm-test-run-nixbot-gitlab> gitlab # [    4.264228] systemd[1]: Stopped target Local File Systems.694vm-test-run-nixbot-gitlab> gitlab # [    4.265534] systemd[1]: Stopped target Preparation for Local File Systems.695vm-test-run-nixbot-gitlab> gitlab # [    4.267165] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.696vm-test-run-nixbot-gitlab> gitlab # [    4.268851] systemd[1]: Stopped Coldplug All udev Devices.697vm-test-run-nixbot-gitlab> gitlab # [    4.270188] systemd[1]: Stopping Rule-based Manager for Device Events and Files...698vm-test-run-nixbot-gitlab> gitlab # [    4.271965] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.699vm-test-run-nixbot-gitlab> gitlab # [    4.273947] systemd[1]: Stopped Virtual Console Setup.700vm-test-run-nixbot-gitlab> gitlab # [    4.277528] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.701vm-test-run-nixbot-gitlab> gitlab # [    4.282182] systemd[1]: Finished rw-sysroot-nix-store.service.702vm-test-run-nixbot-gitlab> gitlab # [    4.288169] systemd[1]: systemd-udevd.service: Deactivated successfully.703vm-test-run-nixbot-gitlab> gitlab # [    4.292841] systemd[1]: Stopped Rule-based Manager for Device Events and Files.704vm-test-run-nixbot-gitlab> gitlab # [    4.302329] systemd[1]: initrd-cleanup.service: Deactivated successfully.705vm-test-run-nixbot-gitlab> gitlab # [    4.305467] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.706vm-test-run-nixbot-gitlab> gitlab # [    4.312662] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.707vm-test-run-nixbot-gitlab> gitlab # [    4.314361] systemd[1]: Closed udev Control Socket.708vm-test-run-nixbot-gitlab> gitlab # [    4.318412] systemd[1]: Starting Cleanup udev Database...709vm-test-run-nixbot-gitlab> gitlab # [    4.319760] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.710vm-test-run-nixbot-gitlab> gitlab # [    4.321533] systemd[1]: Stopped Create Static Device Nodes in /dev.711vm-test-run-nixbot-gitlab> gitlab # [    4.323951] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.712vm-test-run-nixbot-gitlab> gitlab # [    4.325869] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.713vm-test-run-nixbot-gitlab> gitlab # [    4.330581] systemd[1]: kmod-static-nodes.service: Deactivated successfully.714vm-test-run-nixbot-gitlab> gitlab # [    4.332221] systemd[1]: Stopped Create List of Static Device Nodes.715vm-test-run-nixbot-gitlab> gitlab # [    4.342706] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.716vm-test-run-nixbot-gitlab> gitlab # [    4.346710] systemd[1]: Finished Cleanup udev Database.717vm-test-run-nixbot-gitlab> gitlab # [    4.351807] systemd[1]: Reached target Switch Root.718vm-test-run-nixbot-gitlab> gitlab # [    4.355165] systemd[1]: Starting NixOS Activation...719vm-test-run-nixbot-gitlab> gitlab # [    4.459645] initrd-nixos-activation-start[566]: booting system configuration /nix/store/w3f5kbj3l91xx2071j9aw23f0pgznfqg-nixos-system-gitlab-test720vm-test-run-nixbot-gitlab> gitlab # [    4.490227] initrd-nixos-activation-start[566]: running activation script...721vm-test-run-nixbot-gitlab> gitlab # [    4.683627] initrd-nixos-activation-start[589]: setting up /etc...722vm-test-run-nixbot-gitlab> gitlab # [    4.783645] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.723vm-test-run-nixbot-gitlab> gitlab # [    4.788621] systemd[1]: Finished NixOS Activation.724vm-test-run-nixbot-gitlab> gitlab # [    4.796107] systemd[1]: Starting Switch Root...725vm-test-run-nixbot-gitlab> gitlab # [    4.821112] systemd[1]: Switching root.726vm-test-run-nixbot-gitlab> gitlab # [    5.352944] systemd-journald[152]: Received SIGTERM from PID 1 (systemd).727vm-test-run-nixbot-gitlab> gitlab # [    5.465068] NET: Registered PF_VSOCK protocol family728vm-test-run-nixbot-gitlab> gitlab # [    5.847000] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)729vm-test-run-nixbot-gitlab> gitlab # [    5.863235] systemd[1]: Detected virtualization kvm.730vm-test-run-nixbot-gitlab> gitlab # [    5.866294] systemd[1]: Detected architecture x86-64.731vm-test-run-nixbot-gitlab> gitlab # [    5.869458] systemd[1]: Detected first boot.732vm-test-run-nixbot-gitlab> gitlab # [    5.873310] systemd[1]: Initializing machine ID from random generator.733vm-test-run-nixbot-gitlab> gitlab # [    6.009937] systemd[1]: bpf-restrict-fs: LSM BPF program attached734vm-test-run-nixbot-gitlab> gitlab # [    6.074575] systemd[1]: Applying preset policy.735vm-test-run-nixbot-gitlab> gitlab # [    6.213781] systemd[1]: Populated /etc with preset unit settings.736vm-test-run-nixbot-gitlab> gitlab # [    6.316780] systemd[1]: initrd-switch-root.service: Deactivated successfully.737vm-test-run-nixbot-gitlab> gitlab # [    6.319152] systemd[1]: Stopped initrd-switch-root.service.738vm-test-run-nixbot-gitlab> gitlab # [    6.322601] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.739vm-test-run-nixbot-gitlab> gitlab # [    6.325537] systemd[1]: Created slice Slice /system/getty.740vm-test-run-nixbot-gitlab> gitlab # [    6.327576] systemd[1]: Created slice GitLab DevOps Platform Slice.741vm-test-run-nixbot-gitlab> gitlab # [    6.329748] systemd[1]: Created slice User and Session Slice.742vm-test-run-nixbot-gitlab> gitlab # [    6.331341] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.743vm-test-run-nixbot-gitlab> gitlab # [    6.333345] systemd[1]: Started Forward Password Requests to Wall Directory Watch.744vm-test-run-nixbot-gitlab> gitlab # [    6.335232] systemd[1]: Expecting device /dev/hvc0...745vm-test-run-nixbot-gitlab> gitlab # [    6.336505] systemd[1]: Expecting device /dev/ttyS0...746vm-test-run-nixbot-gitlab> gitlab # [    6.337886] systemd[1]: Reached target Local Encrypted Volumes.747vm-test-run-nixbot-gitlab> gitlab # [    6.339380] systemd[1]: Stopped target initrd-fs.target.748vm-test-run-nixbot-gitlab> gitlab # [    6.340706] systemd[1]: Stopped target initrd-root-fs.target.749vm-test-run-nixbot-gitlab> gitlab # [    6.342176] systemd[1]: Stopped target initrd-switch-root.target.750vm-test-run-nixbot-gitlab> gitlab # [    6.343781] systemd[1]: Reached target Virtual Machines and Containers.751vm-test-run-nixbot-gitlab> gitlab # [    6.345441] systemd[1]: Reached target Path Units.752vm-test-run-nixbot-gitlab> gitlab # [    6.346714] systemd[1]: Reached target Remote File Systems.753vm-test-run-nixbot-gitlab> gitlab # [    6.348186] systemd[1]: Reached target Slice Units.754vm-test-run-nixbot-gitlab> gitlab # [    6.349492] systemd[1]: Reached target Swaps.755vm-test-run-nixbot-gitlab> gitlab # [    6.351711] systemd[1]: Listening on Process Core Dump Socket.756vm-test-run-nixbot-gitlab> gitlab # [    6.353802] systemd[1]: Listening on Credential Encryption/Decryption.757vm-test-run-nixbot-gitlab> gitlab # [    6.357083] systemd[1]: Starting Journal Log Access Socket...758vm-test-run-nixbot-gitlab> gitlab # [    6.359315] systemd[1]: Listening on Journal Audit Socket.759vm-test-run-nixbot-gitlab> gitlab # [    6.361087] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.760vm-test-run-nixbot-gitlab> gitlab # [    6.362994] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki761vm-test-run-nixbot-gitlab> gitlab # [    6.365407] systemd[1]: Listening on udev Control Socket.762vm-test-run-nixbot-gitlab> gitlab # [    6.368421] systemd[1]: Mounting Huge Pages File System...763vm-test-run-nixbot-gitlab> gitlab # [    6.371312] systemd[1]: Mounting POSIX Message Queue File System...764vm-test-run-nixbot-gitlab> gitlab # [    6.379956] systemd[1]: Mounting Kernel Debug File System...765vm-test-run-nixbot-gitlab> gitlab # [    6.383880] systemd[1]: Mounting Kernel Trace File System...766vm-test-run-nixbot-gitlab> gitlab # [    6.387078] systemd[1]: Starting Create List of Static Device Nodes...767vm-test-run-nixbot-gitlab> gitlab # [    6.388863] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio768vm-test-run-nixbot-gitlab> gitlab # [    6.394398] systemd[1]: Starting Load Kernel Module configfs...769vm-test-run-nixbot-gitlab> gitlab # [    6.398360] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm770vm-test-run-nixbot-gitlab> gitlab # [    6.404700] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore771vm-test-run-nixbot-gitlab> gitlab # [    6.441555] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse772vm-test-run-nixbot-gitlab> gitlab # [    6.448879] systemd[1]: Mounting FUSE Control File System...773vm-test-run-nixbot-gitlab> gitlab # [    6.451961] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67774vm-test-run-nixbot-gitlab> gitlab # [    6.457974] systemd[1]: Starting Journal Service...775vm-test-run-nixbot-gitlab> gitlab # [    6.460601] systemd[1]: Starting Load Kernel Modules...776vm-test-run-nixbot-gitlab> gitlab # [    6.463658] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...777vm-test-run-nixbot-gitlab> gitlab # [    6.468404] systemd[1]: Starting Remount Root and Kernel File Systems...778vm-test-run-nixbot-gitlab> gitlab # [    6.471781] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki779vm-test-run-nixbot-gitlab> gitlab # [    6.481599] loop: module loaded780vm-test-run-nixbot-gitlab> gitlab # [    6.484722] systemd[1]: Starting Coldplug All udev Devices...781vm-test-run-nixbot-gitlab> gitlab # [    6.488852] systemd[1]: Listening on Journal Log Access Socket.782vm-test-run-nixbot-gitlab> gitlab # [    6.490512] systemd[1]: Mounted Huge Pages File System.783vm-test-run-nixbot-gitlab> gitlab # [    6.490842] systemd-journald[785]: Collecting audit messages is enabled.784vm-test-run-nixbot-gitlab> gitlab # [    6.492077] systemd[1]: Mounted POSIX Message Queue File System.785vm-test-run-nixbot-gitlab> gitlab # [    6.495226] systemd[1]: Mounted Kernel Debug File System.786vm-test-run-nixbot-gitlab> gitlab # [    6.496771] systemd[1]: Mounted Kernel Trace File System.787vm-test-run-nixbot-gitlab> gitlab # [    6.503358] EXT4-fs (vda): re-mounted 6d1207e1-b29f-4134-be0c-9340828284b1.788vm-test-run-nixbot-gitlab> gitlab # [    6.505675] systemd[1]: Finished Create List of Static Device Nodes.789vm-test-run-nixbot-gitlab> gitlab # [    6.507713] systemd[1]: modprobe@configfs.service: Deactivated successfully.790vm-test-run-nixbot-gitlab> gitlab # [    6.510176] systemd[1]: Finished Load Kernel Module configfs.791vm-test-run-nixbot-gitlab> gitlab # [    6.254918] s[    6.512781] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.792vm-test-run-nixbot-gitlab> gitlab # ystemd[1]: Queued start job for default target Multi-User System[    6.514960] systemd[1]: Started Journal Service.793vm-test-run-nixbot-gitlab> gitlab # .794vm-test-run-nixbot-gitlab> gitlab # [    6.259475] systemd[1]: Unnecessary job was removed for /dev/vdb.795vm-test-run-nixbot-gitlab> gitlab # [    6.261621] systemd[1]: systemd-journald.service: Deactivated successfully.796vm-test-run-nixbot-gitlab> gitlab # [    6.263789] systemd-modules-load[786]: Using 3 probe threads797vm-test-run-nixbot-gitlab> gitlab # [    6.265627] systemd-modules-load[786]: Inserted module 'loop'798vm-test-run-nixbot-gitlab> gitlab # [    6.267437] systemd-modules-load[786]: Inserted module 'tls'799vm-test-run-nixbot-gitlab> gitlab # [    6.269487] systemd-oomd[787]: No swap; memory pressure usage will be degraded800vm-test-run-nixbot-gitlab> gitlab # [    6.272208] systemd[1]: Mounted FUSE Control File System.801vm-test-run-nixbot-gitlab> gitlab # [    6.273948] systemd[1]: Finished Load Kernel Modules.802vm-test-run-nixbot-gitlab> gitlab # [    6.276468] systemd[1]: Finished Remount Root and Kernel File Systems.803vm-test-run-nixbot-gitlab> gitlab # [    6.278600] systemd[1]: Mounting Kernel Configuration File System...804vm-test-run-nixbot-gitlab> gitlab # [    6.280588] systemd[1]: Starting Firewall...805vm-test-run-nixbot-gitlab> gitlab # [    6.282102] systemd[1]: Starting Flush Journal to Persistent Storage...806vm-test-run-nixbot-gitlab> gitlab # [    6.284331] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore807vm-test-run-nixbot-gitlab> gitlab # [    6.545545] systemd-journald[785]: Received client request to flush runtime journal.808vm-test-run-nixbot-gitlab> gitlab # [    6.359931] systemd[1]: Starting Load/Save OS Random Seed...809vm-test-run-nixbot-gitlab> gitlab # [    6.362730] systemd[1]: Starting Apply Kernel Variables...810vm-test-run-nixbot-gitlab> gitlab # [    6.365975] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...811vm-test-run-nixbot-gitlab> gitlab # [    6.368300] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki812vm-test-run-nixbot-gitlab> gitlab # [    6.371074] systemd[1]: Mounted Kernel Configuration File System.813vm-test-run-nixbot-gitlab> gitlab # [    6.373114] systemd[1]: Finished Load/Save OS Random Seed.814vm-test-run-nixbot-gitlab> gitlab # [    6.374462] systemd[1]: Finished Apply Kernel Variables.815vm-test-run-nixbot-gitlab> gitlab # [    6.375833] systemd[1]: Reached target First Boot Complete.816vm-test-run-nixbot-gitlab> gitlab # [    6.377222] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.817vm-test-run-nixbot-gitlab> gitlab # [    6.378908] systemd[1]: Starting Create Static Device Nodes in /dev...818vm-test-run-nixbot-gitlab> gitlab # [    6.380423] systemd[1]: Finished Create Static Device Nodes in /dev.819vm-test-run-nixbot-gitlab> gitlab # [    6.382141] systemd[1]: Reached target Preparation for Local File Systems.820vm-test-run-nixbot-gitlab> gitlab # [    6.383756] systemd[1]: Starting Rule-based Manager for Device Events and Files...821vm-test-run-nixbot-gitlab> gitlab # [    6.385489] systemd[1]: Finished Flush Journal to Persistent Storage.822vm-test-run-nixbot-gitlab> gitlab # [    6.388957] systemd-udevd[833]: Using default interface naming scheme 'v260'.823vm-test-run-nixbot-gitlab> gitlab # [    6.426577] systemd[1]: Started Rule-based Manager for Device Events and Files.824vm-test-run-nixbot-gitlab> gitlab # [    6.431261] systemd[1]: Finished Coldplug All udev Devices.825vm-test-run-nixbot-gitlab> gitlab # [    6.522510] systemd[1]: Finished Firewall.826vm-test-run-nixbot-gitlab> gitlab # [    6.543644] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse827vm-test-run-nixbot-gitlab> gitlab # [    6.584939] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.828vm-test-run-nixbot-gitlab> gitlab # [    6.588471] (udev-worker)[914]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.829vm-test-run-nixbot-gitlab> gitlab # [    6.592376] (udev-worker)[914]: Network interface NamePolicy= disabled on kernel command line.830vm-test-run-nixbot-gitlab> gitlab # [    6.594754] (udev-worker)[936]: Network interface NamePolicy= disabled on kernel command line.831vm-test-run-nixbot-gitlab> gitlab # [    6.596903] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.832vm-test-run-nixbot-gitlab> gitlab # [    6.608145] systemd[1]: Condition check resulted in Virtio network device being skipped.833vm-test-run-nixbot-gitlab> gitlab # [    6.610196] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore834vm-test-run-nixbot-gitlab> gitlab # [    6.612791] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67835vm-test-run-nixbot-gitlab> gitlab # [    6.616907] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore836vm-test-run-nixbot-gitlab> gitlab # [    6.619771] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki837vm-test-run-nixbot-gitlab> gitlab # [    6.622088] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki838vm-test-run-nixbot-gitlab> gitlab # [    6.898238] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3839vm-test-run-nixbot-gitlab> gitlab # [    6.913077] mousedev: PS/2 mouse device common for all mice840vm-test-run-nixbot-gitlab> gitlab # [    6.916596] rtc_cmos 00:05: RTC can wake from S4841vm-test-run-nixbot-gitlab> gitlab # [    6.919205] ACPI: button: Power Button [PWRF]842vm-test-run-nixbot-gitlab> gitlab # [    6.922551] Floppy drive(s): fd0 is 2.88M AMI BIOS843vm-test-run-nixbot-gitlab> gitlab # [    6.927538] parport_pc 00:03: reported by Plug and Play ACPI844vm-test-run-nixbot-gitlab> gitlab # [    6.929516] rtc_cmos 00:05: registered as rtc0845vm-test-run-nixbot-gitlab> gitlab # [    6.930951] rtc_cmos 00:05: setting system clock to 2026-06-09T13:39:19 UTC (1781012359)846vm-test-run-nixbot-gitlab> gitlab # [    6.934285] systemd-journald[785]: Time jumped backwards, rotating.847vm-test-run-nixbot-gitlab> gitlab # [    6.936283] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs848vm-test-run-nixbot-gitlab> gitlab # [    6.936556] FDC 0 is a S82078B849vm-test-run-nixbot-gitlab> gitlab # [    6.937343] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]850vm-test-run-nixbot-gitlab> gitlab # [    6.954626] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console851vm-test-run-nixbot-gitlab> gitlab # [    6.972965] Console: switching to colour dummy device 80x25852vm-test-run-nixbot-gitlab> gitlab # [    6.974306] [drm] Found bochs VGA, ID 0xb0c5.853vm-test-run-nixbot-gitlab> gitlab # [    6.975173] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.854vm-test-run-nixbot-gitlab> gitlab # [    6.977289] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0855vm-test-run-nixbot-gitlab> gitlab # [    6.977349] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic856vm-test-run-nixbot-gitlab> gitlab # [    6.978758] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD857vm-test-run-nixbot-gitlab> gitlab # [    6.981275] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0858vm-test-run-nixbot-gitlab> gitlab # [    6.986999] fbcon: bochs-drmdrmfb (fb0) is primary device859vm-test-run-nixbot-gitlab> gitlab # [    6.993008] Console: switching to colour frame buffer device 160x50860vm-test-run-nixbot-gitlab> gitlab # [    6.993429] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4861vm-test-run-nixbot-gitlab> gitlab # [    6.998192] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device862vm-test-run-nixbot-gitlab> gitlab # [    6.812595] systemd[1]: Starting Virtual Console Setup...863vm-test-run-nixbot-gitlab> gitlab # [    6.830977] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.864vm-test-run-nixbot-gitlab> gitlab # [    6.835351] systemd[1]: Stopped Virtual Console Setup.865vm-test-run-nixbot-gitlab> gitlab # [    6.864571] systemd[1]: Starting Virtual Console Setup...866vm-test-run-nixbot-gitlab> gitlab # [    7.125236] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6867vm-test-run-nixbot-gitlab> gitlab # [    7.128235] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5868vm-test-run-nixbot-gitlab> gitlab # [    6.877726] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.869vm-test-run-nixbot-gitlab> gitlab # [    7.140140] ppdev: user-space parallel port driver870vm-test-run-nixbot-gitlab> gitlab # [    6.883940] systemd[1]: Stopped Virtual Console Setup.871vm-test-run-nixbot-gitlab> gitlab # [    6.889358] systemd[1]: Starting Virtual Console Setup...872vm-test-run-nixbot-gitlab> gitlab # [    7.169991] kvm_amd: TSC scaling supported873vm-test-run-nixbot-gitlab> gitlab # [    7.171544] kvm_amd: Nested Virtualization enabled874vm-test-run-nixbot-gitlab> gitlab # [    7.172964] kvm_amd: Nested Paging enabled875vm-test-run-nixbot-gitlab> gitlab # [    7.174172] kvm_amd: LBR virtualization supported876vm-test-run-nixbot-gitlab> gitlab # [    7.175868] kvm_amd: Virtual VMLOAD VMSAVE supported877vm-test-run-nixbot-gitlab> gitlab # [    7.177221] kvm_amd: Virtual GIF supported878vm-test-run-nixbot-gitlab> gitlab # [    7.179068] kvm_amd: Virtual NMI enabled879vm-test-run-nixbot-gitlab> gitlab # [    6.970796] systemd-vconsole-setup[957]: Configuration of first virtual console was skipped, ignoring remaining ones.880vm-test-run-nixbot-gitlab> gitlab # [    6.975555] systemd[1]: Finished Virtual Console Setup.881vm-test-run-nixbot-gitlab> gitlab # [    7.234955] EDAC MC: Ver: 3.0.0882vm-test-run-nixbot-gitlab> gitlab # [    7.060870] systemd[1]: Mounting /run/wrappers...883vm-test-run-nixbot-gitlab> gitlab # [    7.090892] systemd[1]: Mounted /run/wrappers.884vm-test-run-nixbot-gitlab> gitlab # [    7.093866] systemd[1]: Reached target Local File Systems.885vm-test-run-nixbot-gitlab> gitlab # [    7.097564] systemd[1]: Listening on Boot Loader Control Service Socket.886vm-test-run-nixbot-gitlab> gitlab # [    7.101963] systemd[1]: Starting register-nix-paths.service...887vm-test-run-nixbot-gitlab> gitlab # [    7.105930] systemd[1]: Starting Create SUID/SGID Wrappers...888vm-test-run-nixbot-gitlab> gitlab # [    7.109975] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.889vm-test-run-nixbot-gitlab> gitlab # [    7.115655] systemd[1]: Starting Save Transient machine-id to Disk...890vm-test-run-nixbot-gitlab> gitlab # [    7.120323] systemd[1]: Starting Create System Files and Directories...891vm-test-run-nixbot-gitlab> gitlab # [    7.143441] systemd[1]: Finished Create System Files and Directories.892vm-test-run-nixbot-gitlab> gitlab # [    7.149185] systemd[1]: Starting Rebuild Journal Catalog...893vm-test-run-nixbot-gitlab> gitlab # [    7.151551] systemd[1]: Starting Record System Boot/Shutdown in UTMP...894vm-test-run-nixbot-gitlab> gitlab # [    7.154391] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.895vm-test-run-nixbot-gitlab> gitlab # [    7.157218] systemd[1]: Finished Save Transient machine-id to Disk.896vm-test-run-nixbot-gitlab> gitlab # [    7.173838] systemd[1]: Finished Record System Boot/Shutdown in UTMP.897vm-test-run-nixbot-gitlab> gitlab # [    7.185348] systemd[1]: Finished Rebuild Journal Catalog.898vm-test-run-nixbot-gitlab> gitlab # [    7.187565] systemd[1]: Starting Update is Completed...899vm-test-run-nixbot-gitlab> gitlab # [    7.208512] systemd[1]: Finished Update is Completed.900vm-test-run-nixbot-gitlab> gitlab # [    7.243977] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.901vm-test-run-nixbot-gitlab> gitlab # [    7.245820] systemd[1]: Finished Create SUID/SGID Wrappers.902vm-test-run-nixbot-gitlab> gitlab # [    7.247197] systemd[1]: suid-sgid-wrappers.service: Consumed 103ms CPU time over 145ms wall clock time, 4.4M memory peak, 1.1M read from disk.903vm-test-run-nixbot-gitlab> gitlab # [    7.464982] systemd[1]: Finished register-nix-paths.service.904vm-test-run-nixbot-gitlab> gitlab # [    7.467791] systemd[1]: Reached target System Initialization.905vm-test-run-nixbot-gitlab> gitlab # [    7.470486] systemd[1]: Started Discard unused filesystem blocks once a week.906vm-test-run-nixbot-gitlab> gitlab # [    7.473792] systemd[1]: Started logrotate.timer.907vm-test-run-nixbot-gitlab> gitlab # [    7.475954] systemd[1]: Started Daily Cleanup of Temporary Directories.908vm-test-run-nixbot-gitlab> gitlab # [    7.479161] systemd[1]: Reached target Timer Units.909vm-test-run-nixbot-gitlab> gitlab # [    7.481462] systemd[1]: Listening on D-Bus System Message Bus Socket.910vm-test-run-nixbot-gitlab> gitlab # [    7.484486] systemd[1]: Listening on Nix Daemon Socket.911vm-test-run-nixbot-gitlab> gitlab # [    7.487506] systemd[1]: Starting nixbot CI service socket...912vm-test-run-nixbot-gitlab> gitlab # [    7.490189] systemd[1]: Listening on Hostname Service Socket.913vm-test-run-nixbot-gitlab> gitlab # [    7.492891] systemd[1]: Starting D-Bus System Message Bus...914vm-test-run-nixbot-gitlab> gitlab # [    7.500768] systemd[1]: Listening on nixbot CI service socket.915vm-test-run-nixbot-gitlab> gitlab # [    7.503846] systemd[1]: Reached target Socket Units.916vm-test-run-nixbot-gitlab> gitlab # [    7.547553] dbus-broker-launch[1048]: Looking up NSS user entry for 'systemd-timesync'...917vm-test-run-nixbot-gitlab> gitlab # [    7.551483] dbus-broker-launch[1048]: NSS returned no entry for 'systemd-timesync'918vm-test-run-nixbot-gitlab> gitlab # [    7.555171] dbus-broker-launch[1048]: Invalid user-name in /nix/store/89zj9nmrajvcy9c3c08wv0ir9ww7lgmq-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"919vm-test-run-nixbot-gitlab> gitlab # [    7.563490] systemd[1]: Started D-Bus System Message Bus.920vm-test-run-nixbot-gitlab> gitlab # [    7.583937] dbus-broker-launch[1048]: Ready921vm-test-run-nixbot-gitlab> gitlab # [    7.591308] systemd[1]: Reached target Basic System.922vm-test-run-nixbot-gitlab> gitlab # [    7.594738] systemd[1]: Started backdoor.service.923vm-test-run-nixbot-gitlab> gitlab # [    7.599909] systemd[1]: Starting gitlab-config.service...924vm-test-run-nixbot-gitlab> gitlab # [    7.603313] systemd[1]: Starting Import lastlog data into lastlog2 database...925vm-test-run-nixbot-gitlab> gitlab # [    7.607451] systemd[1]: Starting Logrotate configuration check...926vm-test-run-nixbot-gitlab> gitlab # [    7.610745] systemd[1]: Starting Name Service Cache Daemon (nsncd)...927vm-test-run-nixbot-gitlab> gitlab # [    7.614309] systemd[1]: Starting Post-Boot Actions...928vm-test-run-nixbot-gitlab> gitlab # [    7.628519] systemd[1]: Started Reset console on configuration changes.929vm-test-run-nixbot-gitlab> gitlab # [    7.630875] logrotate[1053]: warning: logrotate in debug mode does nothing except printing debug messages!  Consider using verbose mode (-v) instead if this is not what you want.930vm-test-run-nixbot-gitlab> gitlab # [    7.634400] logrotate[1053]: reading config file /nix/store/sn4bd2nqi3yg4r51djm9i2rmfgbwvmhb-logrotate.conf931vm-test-run-nixbot-gitlab> gitlab # [    7.636550] logrotate[1053]: note: 'monthly' overrides previously specified 'weekly'932vm-test-run-nixbot-gitlab> gitlab # [    7.637687] logrotate[1053]: Reading state from file: /var/lib/logrotate.status933vm-test-run-nixbot-gitlab> gitlab # connecting to host...934vm-test-run-nixbot-gitlab> gitlab # [    7.638795] logrotate[1053]: state file /var/lib/logrotate.status does not exist935vm-test-run-nixbot-gitlab> gitlab # [    7.640356] logrotate[1053]: Allocating hash table for state file, size 64 entries936vm-test-run-nixbot-gitlab> gitlab # [    7.641275] logrotate[1053]: Handling 4 logs937vm-test-run-nixbot-gitlab> gitlab # [    7.642780] logrotate[1053]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed938vm-test-run-nixbot-gitlab> gitlab # [    7.643919] logrotate[1053]: considering log /var/log/btmp939vm-test-run-nixbot-gitlab> gitlab # [    7.645107] logrotate[1053]: Creating new state940vm-test-run-nixbot-gitlab> gitlab: Guest shell says: b'Spawning backdoor root shell...\n'941vm-test-run-nixbot-gitlab> gitlab: connected to guest root shell942vm-test-run-nixbot-gitlab> gitlab # [    7.645758] logrotate[1053]:   Now: 2026-06-09 13:39943vm-test-run-nixbot-gitlab> gitlab: (connecting took 8.47 seconds)944vm-test-run-nixbot-gitlab> gitlab # [    7.646966] logrotate[1053]:   Last rotated at 2026-06-09 13:00945vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for the VM to finish booting, in 8.47 seconds)946vm-test-run-nixbot-gitlab> gitlab # [    7.648175] logrotate[1053]:   log does not need rotating (log has already been rotated)947vm-test-run-nixbot-gitlab> gitlab # [    7.649044] logrotate[1053]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed948vm-test-run-nixbot-gitlab> gitlab # [    7.649640] logrotate[1053]: considering log /var/log/wtmp949vm-test-run-nixbot-gitlab> gitlab # [    7.650762] logrotate[1053]: Creating new state950vm-test-run-nixbot-gitlab> gitlab # [    7.651570] logrotate[1053]:   Now: 2026-06-09 13:39951vm-test-run-nixbot-gitlab> gitlab # [    7.652636] logrotate[1053]:   Last rotated at 2026-06-09 13:00952vm-test-run-nixbot-gitlab> gitlab # [    7.653713] logrotate[1053]:   log does not need rotating (log has already been rotated)953vm-test-run-nixbot-gitlab> gitlab # [    7.654793] logrotate[1053]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed954vm-test-run-nixbot-gitlab> gitlab # [    7.655859] logrotate[1053]: switching euid from 0 to 165 and egid from 0 to 165 (pid 1053)955vm-test-run-nixbot-gitlab> gitlab # [    7.656945] logrotate[1053]: considering log /var/gitlab/state/log/*.log956vm-test-run-nixbot-gitlab> gitlab # [    7.658001] logrotate[1053]:   log /var/gitlab/state/log/*.log does not exist -- skipping957vm-test-run-nixbot-gitlab> gitlab # [    7.658811] logrotate[1053]: Creating new state958vm-test-run-nixbot-gitlab> gitlab # [    7.659346] logrotate[1053]: switching euid from 165 to 0 and egid from 165 to 0 (pid 1053)959vm-test-run-nixbot-gitlab> gitlab # [    7.660202] logrotate[1053]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed960vm-test-run-nixbot-gitlab> gitlab # [    7.661038] logrotate[1053]: switching euid from 0 to 60 and egid from 0 to 60 (pid 1053)961vm-test-run-nixbot-gitlab> gitlab # [    7.661918] logrotate[1053]: considering log /var/log/nginx/*.log962vm-test-run-nixbot-gitlab> gitlab # [    7.663327] logrotate[1053]:   log /var/log/nginx/*.log does not exist -- skipping963vm-test-run-nixbot-gitlab> gitlab # [    7.664307] logrotate[1053]: Creating new state964vm-test-run-nixbot-gitlab> gitlab # [    7.664895] logrotate[1053]: switching euid from 60 to 0 and egid from 60 to 0 (pid 1053)965vm-test-run-nixbot-gitlab> gitlab # [    7.666237] systemd[1]: Starting resolvconf update...966vm-test-run-nixbot-gitlab> gitlab # [    7.693130] systemd[1]: Finished Logrotate configuration check.967vm-test-run-nixbot-gitlab> gitlab # [    7.696825] systemd[1]: Finished Post-Boot Actions.968vm-test-run-nixbot-gitlab> gitlab # [    7.701482] systemd[1]: Finished Import lastlog data into lastlog2 database.969vm-test-run-nixbot-gitlab> gitlab # [    7.714893] systemd[1]: Started Name Service Cache Daemon (nsncd).970vm-test-run-nixbot-gitlab> gitlab # [    7.716592] systemd[1]: Reached target Host and Network Name Lookups.971vm-test-run-nixbot-gitlab> gitlab # [    7.719313] systemd[1]: Reached target User and Group Name Lookups.972vm-test-run-nixbot-gitlab> gitlab # [    7.720635] nsncd[1054]: Jun 09 13:39:20.541 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"973vm-test-run-nixbot-gitlab> gitlab # [    7.724147] systemd[1]: Starting User Login Management...974vm-test-run-nixbot-gitlab> gitlab # [    7.738129] systemd[1]: Stopped target Host and Network Name Lookups.975vm-test-run-nixbot-gitlab> gitlab # [    7.739235] systemd[1]: Stopping Host and Network Name Lookups...976vm-test-run-nixbot-gitlab> gitlab # [    7.740078] systemd[1]: Stopped target User and Group Name Lookups.977vm-test-run-nixbot-gitlab> gitlab # [    7.740891] systemd[1]: Stopping User and Group Name Lookups...978vm-test-run-nixbot-gitlab> gitlab # [    7.743675] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...979vm-test-run-nixbot-gitlab> gitlab # [    7.745616] systemd[1]: nscd.service: Deactivated successfully.980vm-test-run-nixbot-gitlab> gitlab # [    7.748262] systemd[1]: Stopped Name Service Cache Daemon (nsncd).981vm-test-run-nixbot-gitlab> gitlab # [    7.749335] systemd[1]: nscd.service: Consumed 19ms CPU time over 142ms wall clock time, 8.1M memory peak, 5.7M read from disk.982vm-test-run-nixbot-gitlab> gitlab # [    7.752806] systemd[1]: Starting Name Service Cache Daemon (nsncd)...983vm-test-run-nixbot-gitlab> gitlab # [    7.767599] systemd-logind[1115]: New seat seat0.984vm-test-run-nixbot-gitlab> gitlab # [    7.771252] systemd[1]: Started Name Service Cache Daemon (nsncd).985vm-test-run-nixbot-gitlab> gitlab # [    7.772892] systemd-logind[1115]: Watching system buttons on /dev/input/event2 (Power Button)986vm-test-run-nixbot-gitlab> gitlab # [    7.775346] nsncd[1139]: Jun 09 13:39:20.598 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"987vm-test-run-nixbot-gitlab> gitlab # [    7.778902] systemd-logind[1115]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)988vm-test-run-nixbot-gitlab> gitlab # [    7.781197] systemd-logind[1115]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)989vm-test-run-nixbot-gitlab> gitlab # [    7.783524] systemd[1]: Started User Login Management.990vm-test-run-nixbot-gitlab> gitlab # [    7.784938] systemd[1]: Reached target Host and Network Name Lookups.991vm-test-run-nixbot-gitlab> gitlab # [    7.786075] systemd[1]: Reached target User and Group Name Lookups.992vm-test-run-nixbot-gitlab> gitlab # [    7.786877] systemd[1]: Starting linger-users.service...993vm-test-run-nixbot-gitlab> gitlab # [    7.789974] systemd[1]: Finished resolvconf update.994vm-test-run-nixbot-gitlab> gitlab # [    7.791414] systemd[1]: Reached target Preparation for Network.995vm-test-run-nixbot-gitlab> gitlab # [    7.794190] systemd[1]: Starting DHCP Client...996vm-test-run-nixbot-gitlab> gitlab # [    7.798375] systemd[1]: Starting Address configuration of eth1...997vm-test-run-nixbot-gitlab> gitlab # [    7.809561] systemd[1]: Starting Extra networking commands....998vm-test-run-nixbot-gitlab> gitlab # [    7.813459] systemd[1]: linger-users.service: Deactivated successfully.999vm-test-run-nixbot-gitlab> gitlab # [    7.815050] systemd[1]: Finished linger-users.service.1000vm-test-run-nixbot-gitlab> gitlab # [    7.829813] network-addresses-eth1-start[1165]: adding address 192.168.1.1/24... done1001vm-test-run-nixbot-gitlab> gitlab # [    7.832781] network-addresses-eth1-start[1165]: adding address 2001:db8:1::1/64... done1002vm-test-run-nixbot-gitlab> gitlab # [    7.839404] systemd[1]: Finished Address configuration of eth1.1003vm-test-run-nixbot-gitlab> gitlab # [    7.875716] systemd[1]: Finished Extra networking commands..1004vm-test-run-nixbot-gitlab> gitlab # [    7.877943] systemd[1]: Reached target Network.1005vm-test-run-nixbot-gitlab> gitlab # [    7.881855] systemd[1]: Starting gitlab-workhorse.service...1006vm-test-run-nixbot-gitlab> gitlab # [    7.883141] systemd[1]: Starting Nginx Web Server...1007vm-test-run-nixbot-gitlab> gitlab # [    7.886317] systemd[1]: Starting PostgreSQL Server...1008vm-test-run-nixbot-gitlab> gitlab # [    7.887578] dhcpcd[1182]: dhcpcd-10.3.2 starting1009vm-test-run-nixbot-gitlab> gitlab # [    7.891338] systemd[1]: Starting Redis Server - redis-gitlab...1010vm-test-run-nixbot-gitlab> gitlab # [    7.893453] dhcpcd[1227]: dev: loaded udev1011vm-test-run-nixbot-gitlab> gitlab # [    7.896612] systemd[1]: Starting Permit User Sessions...1012vm-test-run-nixbot-gitlab> gitlab # [    8.157670] 8021q: 802.1Q VLAN Support v1.81013vm-test-run-nixbot-gitlab> gitlab # [    8.158563] 8021q: adding VLAN 0 to HW filter on device eth11014vm-test-run-nixbot-gitlab> gitlab # [    7.907495] systemd[1]: Finished Permit User Sessions.1015vm-test-run-nixbot-gitlab> gitlab # [    7.916391] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.1016vm-test-run-nixbot-gitlab> gitlab # [    7.921570] systemd[1]: Started Getty on tty1.1017vm-test-run-nixbot-gitlab> gitlab # [    7.924395] systemd[1]: Reached target Login Prompts.1018vm-test-run-nixbot-gitlab> gitlab # [    8.259922] cfg80211: Loading compiled-in X.509 certificates for regulatory database1019vm-test-run-nixbot-gitlab> gitlab # [    8.264956] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'1020vm-test-run-nixbot-gitlab> gitlab # [    8.266343] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'1021vm-test-run-nixbot-gitlab> gitlab # [    8.268562] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -21022vm-test-run-nixbot-gitlab> gitlab # [    8.270332] cfg80211: failed to load regulatory.db1023vm-test-run-nixbot-gitlab> gitlab # [    8.036142] redis-server[1249]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.1024vm-test-run-nixbot-gitlab> gitlab # [    8.040150] redis-server[1249]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1025vm-test-run-nixbot-gitlab> gitlab # [    8.042656] redis-server[1249]: Redi[    8.301637] 8021q: adding VLAN 0 to HW filter on device eth01026vm-test-run-nixbot-gitlab> gitlab # s version=8.8.0, bits=64, commit=00000000, modified=0, pid=1249, just started1027vm-test-run-nixbot-gitlab> gitlab # [    8.047531] postgresql-pre-start[1248]: The files belonging to this database system will be owned by user "postgres".1028vm-test-run-nixbot-gitlab> gitlab # [    8.050343] postgresql-pre-start[1248]: This user must also own the server process.1029vm-test-run-nixbot-gitlab> gitlab # [    8.052356] postgresql-pre-start[1248]: The database cluster will be initialized with locale "en_US.UTF-8".1030vm-test-run-nixbot-gitlab> gitlab # [    8.054748] postgresql-pre-start[1248]: The default database encoding has accordingly been set to "UTF8".1031vm-test-run-nixbot-gitlab> gitlab # [    8.057494] postgresql-pre-start[1248]: The default text search configuration will be set to "english".1032vm-test-run-nixbot-gitlab> gitlab # [    8.060109] postgresql-pre-start[1248]: Data page checksums are disabled.1033vm-test-run-nixbot-gitlab> gitlab # [    8.062149] postgresql-pre-start[1248]: fixing permissions on existing directory /var/lib/postgresql/17 ... ok1034vm-test-run-nixbot-gitlab> gitlab # [    8.064957] postgresql-pre-start[1248]: creating subdirectories ... ok1035vm-test-run-nixbot-gitlab> gitlab # [    8.066044] postgresql-pre-start[1248]: selecting dynamic shared memory implementation ... posix1036vm-test-run-nixbot-gitlab> gitlab # [    8.069124] nginx-pre-start[1254]: nginx: the configuration file /nix/store/nlpb2pnbsk0921apkv5yml2qxbm30d7w-nginx.conf syntax is ok1037vm-test-run-nixbot-gitlab> gitlab # [    8.070243] nginx-pre-start[1254]: nginx: configuration file /nix/store/nlpb2pnbsk0921apkv5yml2qxbm30d7w-nginx.conf test is successful1038vm-test-run-nixbot-gitlab> gitlab # [    8.071257] redis-server[1249]: Configuration loaded1039vm-test-run-nixbot-gitlab> gitlab # [    8.072410] systemd[1]: Started Redis Server - redis-gitlab.1040vm-test-run-nixbot-gitlab> gitlab # [    8.073365] redis[1249]: monotonic clock: POSIX clock_gettime1041vm-test-run-nixbot-gitlab> gitlab # [    8.074428] systemd[1]: Started Nginx Web Server.1042vm-test-run-nixbot-gitlab> gitlab # [    8.075388] redis[1249]: Running mode=standalone, port=0.1043vm-test-run-nixbot-gitlab> gitlab # [    8.076409] redis[1249]: Server initialized1044vm-test-run-nixbot-gitlab> gitlab # [    8.077416] redis[1249]: Ready to accept connections unix1045vm-test-run-nixbot-gitlab> gitlab # [    8.078269] redis[1249]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1046vm-test-run-nixbot-gitlab> gitlab # [    8.078912] dhcpcd[1227]: eth0: waiting for carrier1047vm-test-run-nixbot-gitlab> gitlab # [    8.080320] dhcpcd[1227]: eth0: carrier acquired1048vm-test-run-nixbot-gitlab> gitlab # [    8.081235] dhcpcd[1227]: DUID 00:01:00:01:31:ba:d4:08:52:54:00:12:34:561049vm-test-run-nixbot-gitlab> gitlab # [    8.082119] dhcpcd[1227]: eth0: IAID 00:12:34:561050vm-test-run-nixbot-gitlab> gitlab # [    8.083109] dhcpcd[1227]: eth0: adding address fe80::5054:ff:fe12:34561051vm-test-run-nixbot-gitlab> gitlab # [    8.099499] postgresql-pre-start[1248]: selecting default "max_connections" ... 1001052vm-test-run-nixbot-gitlab> gitlab # [    8.133901] postgresql-pre-start[1248]: selecting default "shared_buffers" ... 128MB1053vm-test-run-nixbot-gitlab> gitlab # [    8.310581] systemd[1]: Started gitlab-workhorse.service.1054vm-test-run-nixbot-gitlab> gitlab # [    8.462293] postgresql-pre-start[1248]: selecting default time zone ... UTC1055vm-test-run-nixbot-gitlab> gitlab # [    8.466734] postgresql-pre-start[1248]: creating configuration files ... ok1056vm-test-run-nixbot-gitlab> gitlab # [    8.538747] gitlab-workhorse[1284]: time="2026-06-09T13:39:21Z" level=info msg=Starting build_time=19700101.000000 version=18.11.41057vm-test-run-nixbot-gitlab> gitlab # [    8.541576] gitlab-workhorse[1284]: time="2026-06-09T13:39:21Z" level=info msg="Using redis/go-redis"1058vm-test-run-nixbot-gitlab> gitlab # [    8.544157] gitlab-workhorse[1284]: time="2026-06-09T13:39:21Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1059vm-test-run-nixbot-gitlab> gitlab # [    8.630714] postgresql-pre-start[1248]: running bootstrap script ... ok1060vm-test-run-nixbot-gitlab> gitlab # [    8.658349] dhcpcd[1227]: eth0: soliciting a DHCP lease1061vm-test-run-nixbot-gitlab> gitlab # [    8.921839] NET: Registered PF_PACKET protocol family1062vm-test-run-nixbot-gitlab> gitlab # [    8.670873] dhcpcd[1227]: eth0: offered 10.0.2.15 from 10.0.2.21063vm-test-run-nixbot-gitlab> gitlab # [    8.683334] dhcpcd[1227]: eth0: probing address 10.0.2.15/241064vm-test-run-nixbot-gitlab> gitlab # [    9.085869] postgresql-pre-start[1248]: performing post-bootstrap initialization ... ok1065vm-test-run-nixbot-gitlab> gitlab # [    9.393136] postgresql-pre-start[1248]: syncing data to disk ... ok1066vm-test-run-nixbot-gitlab> gitlab # [    9.394942] postgresql-pre-start[1248]: initdb: warning: enabling "trust" authentication for local connections1067vm-test-run-nixbot-gitlab> gitlab # [    9.396940] postgresql-pre-start[1248]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1068vm-test-run-nixbot-gitlab> gitlab # [    9.398229] postgresql-pre-start[1248]: Success. You can now start the database server using:1069vm-test-run-nixbot-gitlab> gitlab # [    9.399886] postgresql-pre-start[1248]:     pg_ctl -D /var/lib/postgresql/17 -l logfile start1070vm-test-run-nixbot-gitlab> gitlab # [    9.483722] postgres[1310]: [1310] LOG:  starting PostgreSQL 17.10 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1071vm-test-run-nixbot-gitlab> gitlab # [    9.489792] postgres[1310]: [1310] LOG:  listening on IPv6 address "::1", port 54321072vm-test-run-nixbot-gitlab> gitlab # [    9.493803] postgres[1310]: [1310] LOG:  listening on IPv4 address "127.0.0.1", port 54321073vm-test-run-nixbot-gitlab> gitlab # [    9.497676] postgres[1310]: [1310] LOG:  listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1074vm-test-run-nixbot-gitlab> gitlab # [    9.502427] postgres[1316]: [1316] LOG:  database system was shut down at 2026-06-09 13:39:21 GMT1075vm-test-run-nixbot-gitlab> gitlab # [    9.506421] postgres[1310]: [1310] LOG:  database system is ready to accept connections1076vm-test-run-nixbot-gitlab> gitlab # [    9.510143] systemd[1]: Started PostgreSQL Server.1077vm-test-run-nixbot-gitlab> gitlab # [    9.513440] systemd[1]: Starting PostgreSQL Setup Scripts...1078vm-test-run-nixbot-gitlab> gitlab # [    9.652688] postgresql-setup-start[1327]: CREATE DATABASE1079vm-test-run-nixbot-gitlab> gitlab # [    9.674492] postgresql-setup-start[1332]: CREATE ROLE1080vm-test-run-nixbot-gitlab> gitlab # [    9.684601] postgresql-setup-start[1334]: ALTER DATABASE1081vm-test-run-nixbot-gitlab> gitlab # [    9.708465] postgresql-setup-start[1339]: CREATE ROLE1082vm-test-run-nixbot-gitlab> gitlab # [    9.710308] systemd[1]: Finished PostgreSQL Setup Scripts.1083vm-test-run-nixbot-gitlab> gitlab # [    9.712386] systemd[1]: Reached target PostgreSQL.1084vm-test-run-nixbot-gitlab> gitlab # [    9.716533] systemd[1]: Starting gitlab-postgresql.service...1085vm-test-run-nixbot-gitlab> gitlab # [    9.848353] gitlab-postgresql-start[1347]: CREATE DATABASE1086vm-test-run-nixbot-gitlab> gitlab # [    9.881989] gitlab-postgresql-start[1364]: CREATE EXTENSION1087vm-test-run-nixbot-gitlab> gitlab # [    9.917934] gitlab-postgresql-start[1367]: CREATE EXTENSION1088vm-test-run-nixbot-gitlab> gitlab # [    9.922565] systemd[1]: Finished gitlab-postgresql.service.1089vm-test-run-nixbot-gitlab> gitlab # [    9.967738] 119c5p75zqwmpdrsjsd5cszxwrq2hgfq-gitlab-config[1361]: mkdir -p /var/gitlab/state/home/.ssh: OK1090vm-test-run-nixbot-gitlab> gitlab # [    9.971906] 119c5p75zqwmpdrsjsd5cszxwrq2hgfq-gitlab-config[1361]: chmod 700 /var/gitlab/state/home/.ssh: OK1091vm-test-run-nixbot-gitlab> gitlab # [   10.021973] systemd[1]: Finished gitlab-config.service.1092vm-test-run-nixbot-gitlab> gitlab # [   10.027784] systemd[1]: Started gitaly.service.1093vm-test-run-nixbot-gitlab> gitlab # [   10.030731] systemd[1]: Starting gitlab-db-config.service...1094vm-test-run-nixbot-gitlab> gitlab # [   10.677594] gitaly[1382]: time="2026-06-09T13:39:23.504Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/2wcq0nlg508fs5wq7jnpg1lw2pib950g-gitaly.toml' and fix the errors that are printed." pid=13821095vm-test-run-nixbot-gitlab> gitlab # [   10.679058] gitaly[1382]: time="2026-06-09T13:39:23.504Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=13821096vm-test-run-nixbot-gitlab> gitlab # [   10.679823] gitaly[1382]: time="2026-06-09T13:39:23.504Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=13821097vm-test-run-nixbot-gitlab> gitlab # [   10.680753] gitaly[1382]: time="2026-06-09T13:39:23.504Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=13821098vm-test-run-nixbot-gitlab> gitlab # [   10.681730] gitaly[1382]: time="2026-06-09T13:39:23.504Z" level=info msg="Starting Gitaly" pid=1382 version=18.11.41099vm-test-run-nixbot-gitlab> gitlab # [   10.752900] dhcpcd[1227]: eth0: soliciting an IPv6 router1100vm-test-run-nixbot-gitlab> gitlab # [   10.754250] dhcpcd[1227]: eth0: Router Advertisement from fe80::21101vm-test-run-nixbot-gitlab> gitlab # [   10.755871] dhcpcd[1227]: eth0: adding address fec0::5054:ff:fe12:3456/641102vm-test-run-nixbot-gitlab> gitlab # [   10.760189] dhcpcd[1227]: eth0: adding route to fec0::/641103vm-test-run-nixbot-gitlab> gitlab # [   10.761552] dhcpcd[1227]: eth0: adding default route via fe80::21104vm-test-run-nixbot-gitlab> gitlab # [   10.851745] gitaly[1382]: time="2026-06-09T13:39:23.678Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=172 pid=13821105vm-test-run-nixbot-gitlab> gitlab # [   10.852967] gitaly[1382]: time="2026-06-09T13:39:23.678Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=13821106vm-test-run-nixbot-gitlab> gitlab # [   10.853644] gitaly[1382]: time="2026-06-09T13:39:23.679Z" level=info msg="finished initializing command factory" duration_ms=0 pid=13821107vm-test-run-nixbot-gitlab> gitlab # [   10.854768] gitaly[1382]: time="2026-06-09T13:39:23.679Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-1382/git-exec-1926271583.d/git pid=13821108vm-test-run-nixbot-gitlab> gitlab # [   10.855910] gitaly[1382]: time="2026-06-09T13:39:23.682Z" level=info msg="finished detecting git version" duration_ms=3 pid=13821109vm-test-run-nixbot-gitlab> gitlab # [   10.857065] gitaly[1382]: time="2026-06-09T13:39:23.682Z" level=info msg="using Git version" pid=1382 version=2.53.g1110vm-test-run-nixbot-gitlab> gitlab # [   10.857911] gitaly[1382]: time="2026-06-09T13:39:23.683Z" level=info msg="clearing disk cache object folder" pid=1382 storage=default1111vm-test-run-nixbot-gitlab> gitlab # [   10.859456] gitaly[1382]: time="2026-06-09T13:39:23.683Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache260086046 pid=1382 storage=default1112vm-test-run-nixbot-gitlab> gitlab # [   10.860752] gitaly[1382]: time="2026-06-09T13:39:23.683Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache260086046 pid=1382 storage=default1113vm-test-run-nixbot-gitlab> gitlab # [   10.862104] gitaly[1382]: time="2026-06-09T13:39:23.683Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=13821114vm-test-run-nixbot-gitlab> gitlab # [   10.862968] gitaly[1382]: time="2026-06-09T13:39:23.683Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=13821115vm-test-run-nixbot-gitlab> gitlab # [   10.864122] gitaly[1382]: time="2026-06-09T13:39:23.684Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache260086046 clear_duration_ms=0 pid=1382 storage=default1116vm-test-run-nixbot-gitlab> gitlab # [   10.955967] gitaly[1382]: time="2026-06-09T13:39:23.782Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=13821117vm-test-run-nixbot-gitlab> gitlab # [   10.957447] gitaly[1382]: time="2026-06-09T13:39:23.783Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=1382 schema=unix1118vm-test-run-nixbot-gitlab> gitlab # [   10.958419] gitaly[1382]: time="2026-06-09T13:39:23.783Z" level=info msg="listening at address" address=/run/gitaly/gitaly-1382/sock.d/intern pid=1382 schema=unix1119vm-test-run-nixbot-gitlab> gitlab # [   10.959106] gitaly[1382]: time="2026-06-09T13:39:23.785Z" level=info msg="finished tempdir cleaner walk" pid=1382 storage=default time_ms=01120vm-test-run-nixbot-gitlab> gitlab # [   10.960111] gitaly[1382]: time="2026-06-09T13:39:23.786Z" level=info msg="counting repositories" pid=13821121vm-test-run-nixbot-gitlab> gitlab # [   10.961303] gitaly[1382]: time="2026-06-09T13:39:23.786Z" level=info msg="starting to count repositories" pid=1382 storage_path=/var/gitlab/state/repositories1122vm-test-run-nixbot-gitlab> gitlab # [   10.962065] gitaly[1382]: time="2026-06-09T13:39:23.786Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=1382 storage_path=/var/gitlab/state/repositories1123vm-test-run-nixbot-gitlab> gitlab # [   10.963798] gitaly[1382]: time="2026-06-09T13:39:23.786Z" level=info msg="completed counting all repositories" counting_duration=0 pid=13821124vm-test-run-nixbot-gitlab> gitlab # [   10.965224] gitaly[1382]: time="2026-06-09T13:39:23.790Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=13821125vm-test-run-nixbot-gitlab> gitlab # [   10.965883] gitaly[1382]: time="2026-06-09T13:39:23.790Z" level=info msg="Started Gitaly" duration_ms=285 pid=13821126vm-test-run-nixbot-gitlab> gitlab # [   10.967349] gitaly[1382]: time="2026-06-09T13:39:23.791Z" level=info msg="maintenance: daily scheduled" pid=1382 scheduled="2026-06-10 12:00:00 +0000 UTC"1127vm-test-run-nixbot-gitlab> gitlab # [   11.096465] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1385]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1128vm-test-run-nixbot-gitlab> gitlab # [   11.099254] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1385]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1129vm-test-run-nixbot-gitlab> gitlab # [   11.114101] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1385]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1130vm-test-run-nixbot-gitlab> gitlab # [   12.952796] gitaly[1382]: time="2026-06-09T13:39:25.778Z" level=info msg="License database preloaded" duration_ms=2252 pid=13821131vm-test-run-nixbot-gitlab> gitlab # [   13.421285] dhcpcd[1227]: eth0: leased 10.0.2.15 for 86400 seconds1132vm-test-run-nixbot-gitlab> gitlab # [   13.423227] dhcpcd[1227]: eth0: adding route to 10.0.2.0/241133vm-test-run-nixbot-gitlab> gitlab # [   13.425313] dhcpcd[1227]: eth0: adding default route via 10.0.2.21134vm-test-run-nixbot-gitlab> gitlab # [   13.507737] systemd[1]: Started DHCP Client.1135vm-test-run-nixbot-gitlab> gitlab # [   13.509408] systemd[1]: Reached target Network is Online.1136vm-test-run-nixbot-gitlab> gitlab # [   39.423335] postgres[1723]: [1723] ERROR:  relation "feature_gates" does not exist at character 5231137vm-test-run-nixbot-gitlab> gitlab # [   39.425677] postgres[1723]: [1723] STATEMENT:  SELECT a.attname, format_type(a.atttypid, a.atttypmod),1138vm-test-run-nixbot-gitlab> gitlab # [   39.427844] postgres[1723]: 	       pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1139vm-test-run-nixbot-gitlab> gitlab # [   39.430162] postgres[1723]: 	       c.collname, col_description(a.attrelid, a.attnum) AS comment,1140vm-test-run-nixbot-gitlab> gitlab # [   39.432329] postgres[1723]: 	       attidentity AS identity,1141vm-test-run-nixbot-gitlab> gitlab # [   39.433771] postgres[1723]: 	       attgenerated as attgenerated1142vm-test-run-nixbot-gitlab> gitlab # [   39.435316] postgres[1723]: 	  FROM pg_attribute a1143vm-test-run-nixbot-gitlab> gitlab # [   39.436606] postgres[1723]: 	  LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1144vm-test-run-nixbot-gitlab> gitlab # [   39.438824] postgres[1723]: 	  LEFT JOIN pg_type t ON a.atttypid = t.oid1145vm-test-run-nixbot-gitlab> gitlab # [   39.440448] postgres[1723]: 	  LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1146vm-test-run-nixbot-gitlab> gitlab # [   39.442921] postgres[1723]: 	 WHERE a.attrelid = '"feature_gates"'::regclass1147vm-test-run-nixbot-gitlab> gitlab # [   39.444646] postgres[1723]: 	   AND a.attnum > 0 AND NOT a.attisdropped1148vm-test-run-nixbot-gitlab> gitlab # [   39.446265] postgres[1723]: 	 ORDER BY a.attnum1149vm-test-run-nixbot-gitlab> gitlab # [   39.447468] postgres[1723]:1150vm-test-run-nixbot-gitlab> gitlab # [   39.637964] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1385]: W, [2026-06-09T13:39:52.464294 #1385]  WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1151vm-test-run-nixbot-gitlab> gitlab # [   45.098200] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1779]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE:  extension "btree_gist" already exists, skipping1152vm-test-run-nixbot-gitlab> gitlab # [   45.106808] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1779]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE:  extension "pg_trgm" already exists, skipping1153vm-test-run-nixbot-gitlab> gitlab # [   48.606261] gitlab-workhorse[1284]: time="2026-06-09T13:40:01Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1154vm-test-run-nixbot-gitlab> gitlab # [   58.616321] gitlab-workhorse[1284]: time="2026-06-09T13:40:11Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1155vm-test-run-nixbot-gitlab> gitlab # [   60.938583] postgres[1854]: [1854] ERROR:  relation "table_without_models" does not exist1156vm-test-run-nixbot-gitlab> gitlab # [   60.943634] postgres[1854]: [1854] STATEMENT:  SELECT pg_get_serial_sequence('table_without_models', 'id')1157vm-test-run-nixbot-gitlab> gitlab # [   68.617226] gitlab-workhorse[1284]: time="2026-06-09T13:40:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1158vm-test-run-nixbot-gitlab> gitlab # [   74.194869] systemd[1]: Finished gitlab-db-config.service.1159vm-test-run-nixbot-gitlab> gitlab # [   74.197279] systemd[1]: Started gitlab-sidekiq.service.1160vm-test-run-nixbot-gitlab> gitlab # [   74.199295] systemd[1]: Starting gitlab.service...1161vm-test-run-nixbot-gitlab> gitlab # [   74.555767] bundle[2039]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1162vm-test-run-nixbot-gitlab> gitlab # [   74.564318] bundle[2039]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1163vm-test-run-nixbot-gitlab> gitlab # [   74.572794] bundle[2039]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1164vm-test-run-nixbot-gitlab> gitlab # [   77.267556] sidekiq-cluster[2038]: {"severity":"INFO","time":"2026-06-09T13:40:30.077Z","message":"Starting cluster with 1 processes"}1165vm-test-run-nixbot-gitlab> gitlab # [   77.391891] bundle[2039]: {"timestamp":"2026-06-09T13:40:30.198Z","pid":2039,"message":"* Enabling systemd notification integration"}1166vm-test-run-nixbot-gitlab> gitlab # [   77.395260] bundle[2039]: {"timestamp":"2026-06-09T13:40:30.218Z","pid":2039,"message":"Puma starting in cluster mode..."}1167vm-test-run-nixbot-gitlab> gitlab # [   77.398194] bundle[2039]: {"timestamp":"2026-06-09T13:40:30.218Z","pid":2039,"message":"* Puma version: 7.2.0 (\"On The Corner\")"}1168vm-test-run-nixbot-gitlab> gitlab # [   77.401328] bundle[2039]: {"timestamp":"2026-06-09T13:40:30.218Z","pid":2039,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1169vm-test-run-nixbot-gitlab> gitlab # [   77.405055] bundle[2039]: {"timestamp":"2026-06-09T13:40:30.218Z","pid":2039,"message":"*  Min threads: 0"}1170vm-test-run-nixbot-gitlab> gitlab # [   77.407559] bundle[2039]: {"timestamp":"2026-06-09T13:40:30.218Z","pid":2039,"message":"*  Max threads: 4"}1171vm-test-run-nixbot-gitlab> gitlab # [   77.410132] bundle[2039]: {"timestamp":"2026-06-09T13:40:30.218Z","pid":2039,"message":"*  Environment: production"}1172vm-test-run-nixbot-gitlab> gitlab # [   77.412932] bundle[2039]: {"timestamp":"2026-06-09T13:40:30.219Z","pid":2039,"message":"*   Master PID: 2039"}1173vm-test-run-nixbot-gitlab> gitlab # [   77.415541] bundle[2039]: {"timestamp":"2026-06-09T13:40:30.219Z","pid":2039,"message":"*      Workers: 2"}1174vm-test-run-nixbot-gitlab> gitlab # [   77.418119] bundle[2039]: {"timestamp":"2026-06-09T13:40:30.219Z","pid":2039,"message":"*     Restarts: (✔) hot (✖) phased (✖) refork"}1175vm-test-run-nixbot-gitlab> gitlab # [   77.421346] bundle[2039]: {"timestamp":"2026-06-09T13:40:30.219Z","pid":2039,"message":"* Preloading application"}1176vm-test-run-nixbot-gitlab> gitlab # [   78.619135] gitlab-workhorse[1284]: time="2026-06-09T13:40:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1177vm-test-run-nixbot-gitlab> gitlab # [   88.629169] gitlab-workhorse[1284]: time="2026-06-09T13:40:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1178vm-test-run-nixbot-gitlab> gitlab # [   98.639564] gitlab-workhorse[1284]: time="2026-06-09T13:40:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1179vm-test-run-nixbot-gitlab> gitlab # [   99.998686] bundle[2039]: W, [2026-06-09T13:40:52.824904 #2039]  WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1180vm-test-run-nixbot-gitlab> gitlab # [  102.745145] sidekiq-cluster[2069]: 2026-06-09T13:40:55.571Z pid=2069 tid=ty5 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2069, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>429264896}1181vm-test-run-nixbot-gitlab> gitlab # [  102.925723] sidekiq-cluster[2069]: W, [2026-06-09T13:40:55.752495 #2069]  WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1182vm-test-run-nixbot-gitlab> gitlab # [  102.964426] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:55.791Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1183vm-test-run-nixbot-gitlab> gitlab # [  104.880835] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.706Z","message":"GitLab reliable fetch activated!"}1184vm-test-run-nixbot-gitlab> gitlab # [  104.882886] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.707Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1185vm-test-run-nixbot-gitlab> gitlab # [  104.903941] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.730Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1186vm-test-run-nixbot-gitlab> gitlab # [  104.906888] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.733Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1187vm-test-run-nixbot-gitlab> gitlab # [  104.909514] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.736Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1188vm-test-run-nixbot-gitlab> gitlab # [  104.912537] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.739Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1189vm-test-run-nixbot-gitlab> gitlab # [  104.915238] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.742Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1190vm-test-run-nixbot-gitlab> gitlab # [  104.917880] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.744Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1191vm-test-run-nixbot-gitlab> gitlab # [  104.920315] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.747Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1192vm-test-run-nixbot-gitlab> gitlab # [  104.922567] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.749Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1193vm-test-run-nixbot-gitlab> gitlab # [  104.924818] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.751Z","message":"Cron Jobs - added job with name expire_build_artifacts_worker in the namespace default"}1194vm-test-run-nixbot-gitlab> gitlab # [  104.927255] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.754Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1195vm-test-run-nixbot-gitlab> gitlab # [  104.929792] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.756Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1196vm-test-run-nixbot-gitlab> gitlab # [  104.934203] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.761Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1197vm-test-run-nixbot-gitlab> gitlab # [  104.937514] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.764Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1198vm-test-run-nixbot-gitlab> gitlab # [  104.940686] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.767Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1199vm-test-run-nixbot-gitlab> gitlab # [  104.944172] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.771Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1200vm-test-run-nixbot-gitlab> gitlab # [  104.947523] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.774Z","message":"Cron Jobs - added job with name environments_auto_delete_cron_worker in the namespace default"}1201vm-test-run-nixbot-gitlab> gitlab # [  104.950932] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.777Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1202vm-test-run-nixbot-gitlab> gitlab # [  104.955346] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.782Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1203vm-test-run-nixbot-gitlab> gitlab # [  104.959559] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.786Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1204vm-test-run-nixbot-gitlab> gitlab # [  104.963535] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.790Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1205vm-test-run-nixbot-gitlab> gitlab # [  104.967467] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.794Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1206vm-test-run-nixbot-gitlab> gitlab # [  104.970759] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.797Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1207vm-test-run-nixbot-gitlab> gitlab # [  104.974475] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.801Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1208vm-test-run-nixbot-gitlab> gitlab # [  104.978046] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.805Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1209vm-test-run-nixbot-gitlab> gitlab # [  104.981443] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.808Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1210vm-test-run-nixbot-gitlab> gitlab # [  104.984952] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.811Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1211vm-test-run-nixbot-gitlab> gitlab # [  104.988779] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.815Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1212vm-test-run-nixbot-gitlab> gitlab # [  104.992822] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.819Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1213vm-test-run-nixbot-gitlab> gitlab # [  104.996760] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.823Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1214vm-test-run-nixbot-gitlab> gitlab # [  105.000337] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.827Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1215vm-test-run-nixbot-gitlab> gitlab # [  105.003762] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.830Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1216vm-test-run-nixbot-gitlab> gitlab # [  105.006835] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.833Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1217vm-test-run-nixbot-gitlab> gitlab # [  105.010471] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.837Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1218vm-test-run-nixbot-gitlab> gitlab # [  105.014295] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.841Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1219vm-test-run-nixbot-gitlab> gitlab # [  105.017828] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.844Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1220vm-test-run-nixbot-gitlab> gitlab # [  105.020884] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.847Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1221vm-test-run-nixbot-gitlab> gitlab # [  105.023973] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.851Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1222vm-test-run-nixbot-gitlab> gitlab # [  105.027179] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.854Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1223vm-test-run-nixbot-gitlab> gitlab # [  105.030624] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.857Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1224vm-test-run-nixbot-gitlab> gitlab # [  105.033508] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.860Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1225vm-test-run-nixbot-gitlab> gitlab # [  105.036496] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.863Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1226vm-test-run-nixbot-gitlab> gitlab # [  105.039574] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.866Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1227vm-test-run-nixbot-gitlab> gitlab # [  105.042119] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.868Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1228vm-test-run-nixbot-gitlab> gitlab # [  105.044380] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.871Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1229vm-test-run-nixbot-gitlab> gitlab # [  105.046845] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.873Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1230vm-test-run-nixbot-gitlab> gitlab # [  105.049545] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.876Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1231vm-test-run-nixbot-gitlab> gitlab # [  105.052315] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.879Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1232vm-test-run-nixbot-gitlab> gitlab # [  105.054643] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.881Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1233vm-test-run-nixbot-gitlab> gitlab # [  105.057103] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.884Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1234vm-test-run-nixbot-gitlab> gitlab # [  105.059758] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.886Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1235vm-test-run-nixbot-gitlab> gitlab # [  105.063394] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.890Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1236vm-test-run-nixbot-gitlab> gitlab # [  105.066970] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.894Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1237vm-test-run-nixbot-gitlab> gitlab # [  105.070719] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.897Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1238vm-test-run-nixbot-gitlab> gitlab # [  105.081649] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.908Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1239vm-test-run-nixbot-gitlab> gitlab # [  105.085327] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.912Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1240vm-test-run-nixbot-gitlab> gitlab # [  105.088655] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.915Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1241vm-test-run-nixbot-gitlab> gitlab # [  105.091726] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.918Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1242vm-test-run-nixbot-gitlab> gitlab # [  105.095063] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.922Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1243vm-test-run-nixbot-gitlab> gitlab # [  105.098653] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.925Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1244vm-test-run-nixbot-gitlab> gitlab # [  105.101429] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.928Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1245vm-test-run-nixbot-gitlab> gitlab # [  105.104684] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.931Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1246vm-test-run-nixbot-gitlab> gitlab # [  105.107883] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.934Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1247vm-test-run-nixbot-gitlab> gitlab # [  105.110599] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.937Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1248vm-test-run-nixbot-gitlab> gitlab # [  105.114579] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.941Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1249vm-test-run-nixbot-gitlab> gitlab # [  105.118081] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.945Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1250vm-test-run-nixbot-gitlab> gitlab # [  105.151220] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.978Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1251vm-test-run-nixbot-gitlab> gitlab # [  105.157308] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.984Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1252vm-test-run-nixbot-gitlab> gitlab # [  105.163318] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.990Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1253vm-test-run-nixbot-gitlab> gitlab # [  105.170050] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:57.996Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1254vm-test-run-nixbot-gitlab> gitlab # [  105.175884] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.002Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1255vm-test-run-nixbot-gitlab> gitlab # [  105.180433] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.007Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1256vm-test-run-nixbot-gitlab> gitlab # [  105.186192] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.013Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1257vm-test-run-nixbot-gitlab> gitlab # [  105.190677] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.017Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1258vm-test-run-nixbot-gitlab> gitlab # [  105.195810] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.022Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1259vm-test-run-nixbot-gitlab> gitlab # [  105.200253] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.027Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1260vm-test-run-nixbot-gitlab> gitlab # [  105.204697] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.031Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1261vm-test-run-nixbot-gitlab> gitlab # [  105.208511] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.035Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1262vm-test-run-nixbot-gitlab> gitlab # [  105.211892] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.038Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1263vm-test-run-nixbot-gitlab> gitlab # [  105.215399] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.042Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1264vm-test-run-nixbot-gitlab> gitlab # [  105.218464] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.045Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1265vm-test-run-nixbot-gitlab> gitlab # [  105.222481] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.049Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1266vm-test-run-nixbot-gitlab> gitlab # [  105.225269] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.052Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1267vm-test-run-nixbot-gitlab> gitlab # [  105.228545] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.055Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1268vm-test-run-nixbot-gitlab> gitlab # [  105.232077] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.059Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1269vm-test-run-nixbot-gitlab> gitlab # [  105.235431] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.062Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1270vm-test-run-nixbot-gitlab> gitlab # [  105.238456] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.065Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1271vm-test-run-nixbot-gitlab> gitlab # [  105.241712] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.068Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1272vm-test-run-nixbot-gitlab> gitlab # [  105.245349] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.072Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1273vm-test-run-nixbot-gitlab> gitlab # [  105.248614] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.075Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1274vm-test-run-nixbot-gitlab> gitlab # [  105.251797] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.078Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1275vm-test-run-nixbot-gitlab> gitlab # [  105.255124] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.082Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1276vm-test-run-nixbot-gitlab> gitlab # [  105.257680] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.084Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1277vm-test-run-nixbot-gitlab> gitlab # [  105.261082] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.088Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1278vm-test-run-nixbot-gitlab> gitlab # [  105.263958] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.091Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1279vm-test-run-nixbot-gitlab> gitlab # [  105.267198] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.094Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1280vm-test-run-nixbot-gitlab> gitlab # [  105.270717] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.097Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1281vm-test-run-nixbot-gitlab> gitlab # [  105.274624] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.101Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1282vm-test-run-nixbot-gitlab> gitlab # [  105.277913] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.104Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1283vm-test-run-nixbot-gitlab> gitlab # [  105.281403] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.108Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1284vm-test-run-nixbot-gitlab> gitlab # [  105.292456] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.119Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1285vm-test-run-nixbot-gitlab> gitlab # [  105.296841] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.123Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1286vm-test-run-nixbot-gitlab> gitlab # [  105.299780] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.126Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1287vm-test-run-nixbot-gitlab> gitlab # [  105.304242] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.131Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1288vm-test-run-nixbot-gitlab> gitlab # [  105.308183] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.135Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1289vm-test-run-nixbot-gitlab> gitlab # [  105.311689] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.138Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1290vm-test-run-nixbot-gitlab> gitlab # [  105.315730] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.142Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1291vm-test-run-nixbot-gitlab> gitlab # [  105.318740] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.145Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1292vm-test-run-nixbot-gitlab> gitlab # [  105.321898] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.148Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1293vm-test-run-nixbot-gitlab> gitlab # [  105.326210] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.153Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1294vm-test-run-nixbot-gitlab> gitlab # [  105.329762] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:40:58.156Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1295vm-test-run-nixbot-gitlab> gitlab # [  108.645729] gitlab-workhorse[1284]: time="2026-06-09T13:41:01Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1296vm-test-run-nixbot-gitlab> gitlab # [  118.659491] gitlab-workhorse[1284]: time="2026-06-09T13:41:11Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1297vm-test-run-nixbot-gitlab> gitlab # [  125.768384] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:18.594Z","message":"Booted Rails 7.2.3 application in production environment"}1298vm-test-run-nixbot-gitlab> gitlab # [  125.773924] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:18.600Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1299vm-test-run-nixbot-gitlab> gitlab # [  125.774698] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:18.600Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1300vm-test-run-nixbot-gitlab> gitlab # [  125.775767] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:18.600Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1301vm-test-run-nixbot-gitlab> gitlab # [  125.784134] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:18.610Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1302vm-test-run-nixbot-gitlab> gitlab # [  127.086325] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:19.912Z","message":"Cleaning working queues"}1303vm-test-run-nixbot-gitlab> gitlab # [  127.092698] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:19.914Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"23ca201321684d530ebfefce","created_at":"2026-06-09T13:40:26.426Z","trace_propagation_headers":{"sentry-trace":"461bf656c53f4f7db65e8bf93afd7376-63a7c3c4bb924833","baggage":"sentry-trace_id=461bf656c53f4f7db65e8bf93afd7376,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"b07011d224c12690b1ac78c9373aa8e4","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-06-09T13:40:26.436Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-23ca201321684d530ebfefce: start","job_status":"start","queue_duration_s":53.478062,"scheduling_latency_s":53.478109}1304vm-test-run-nixbot-gitlab> gitlab # [  127.301340] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:20.128Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"23ca201321684d530ebfefce","created_at":"2026-06-09T13:40:26.426Z","trace_propagation_headers":{"sentry-trace":"461bf656c53f4f7db65e8bf93afd7376-63a7c3c4bb924833","baggage":"sentry-trace_id=461bf656c53f4f7db65e8bf93afd7376,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"b07011d224c12690b1ac78c9373aa8e4","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-06-09T13:40:26.436Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-23ca201321684d530ebfefce: done: 0.213693 sec","job_status":"done","queue_duration_s":53.478062,"scheduling_latency_s":53.478109,"redis_calls":31,"redis_duration_s":0.010079000000000001,"redis_read_bytes":284,"redis_write_bytes":3897,"redis_feature_flag_calls":20,"redis_feature_flag_duration_s":0.006765,"redis_feature_flag_read_bytes":274,"redis_feature_flag_write_bytes":2650,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001938,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001376,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":16,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.071656,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09238325,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.213693,"completed_at":"2026-06-09T13:41:20.127Z","load_balancing_strategy":"primary","db_duration_s":0.075486,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1305vm-test-run-nixbot-gitlab> gitlab # [  127.580274] bundle[2039]: {"timestamp":"2026-06-09T13:41:20.406Z","pid":2039,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1306vm-test-run-nixbot-gitlab> gitlab # [  127.581941] bundle[2039]: {"timestamp":"2026-06-09T13:41:20.406Z","pid":2039,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1307vm-test-run-nixbot-gitlab> gitlab # [  127.583603] bundle[2039]: {"timestamp":"2026-06-09T13:41:20.406Z","pid":2039,"message":"! #\u003cThread:0x00007dd712e3f938 /nix/store/g5qraa51hgg5fl7n3da89ygf00qfv95x-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/g5qraa51hgg5fl7n3da89ygf00qfv95x-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1308vm-test-run-nixbot-gitlab> gitlab # [  127.585450] bundle[2039]: {"timestamp":"2026-06-09T13:41:20.406Z","pid":2039,"message":"! #\u003cThread:0x00007dd71304b7b8 /nix/store/wg5r0zmy3rh1kga7z4z7mbs298p0wxli-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/wg5r0zmy3rh1kga7z4z7mbs298p0wxli-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1309vm-test-run-nixbot-gitlab> gitlab # [  127.587207] bundle[2039]: {"timestamp":"2026-06-09T13:41:20.406Z","pid":2039,"message":"Use Ctrl-C to stop"}1310vm-test-run-nixbot-gitlab> gitlab # [  127.604820] bundle[2039]: {"timestamp":"2026-06-09T13:41:20.407Z","pid":2039,"message":"Sending status to systemd every 1.0 sec"}1311vm-test-run-nixbot-gitlab> gitlab # [  127.952562] bundle[2039]: {"timestamp":"2026-06-09T13:41:20.779Z","pid":2039,"message":"- Worker 0 (PID: 2559) booted in 0.32s, phase: 0"}1312vm-test-run-nixbot-gitlab> gitlab # [  127.993568] bundle[2039]: {"timestamp":"2026-06-09T13:41:20.820Z","pid":2039,"message":"- Worker 1 (PID: 2563) booted in 0.34s, phase: 0"}1313vm-test-run-nixbot-gitlab> gitlab # [  128.003607] systemd[1]: Started gitlab.service.1314vm-test-run-nixbot-gitlab> gitlab # [  128.005735] systemd[1]: Reached target Common target for all GitLab services..1315vm-test-run-nixbot-gitlab> gitlab # [  128.007586] systemd[1]: Starting setup-gitlab.service...1316vm-test-run-nixbot-gitlab> gitlab # [  128.026263] setup-gitlab-start[2596]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1317vm-test-run-nixbot-gitlab> gitlab # [  130.383090] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:41:23 +0000] "GET /users/sign_in HTTP/1.1" 200 10624 "" "curl/8.20.0" 23351318vm-test-run-nixbot-gitlab> gitlab # [  130.387740] setup-gitlab-start[2621]: ++ curl -fs -X POST -H 'Content-Type: application/json' -d '{"grant_type":"password","username":"root","password":"notproduction"}' http://gitlab/oauth/token1319vm-test-run-nixbot-gitlab> gitlab # [  130.390208] setup-gitlab-start[2622]: ++ jq -r .access_token1320vm-test-run-nixbot-gitlab> gitlab # [  131.133356] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:41:23 +0000] "POST /oauth/token HTTP/1.1" 200 244 "" "curl/8.20.0" 7301321vm-test-run-nixbot-gitlab> gitlab # [  131.143911] setup-gitlab-start[2596]: + BEARER=0cc86333dbbbee008c8049607e8be6b017adb93599c2ed75636dd6d4482a61ac1322vm-test-run-nixbot-gitlab> gitlab # [  131.145145] setup-gitlab-start[2596]: + AUTH='Authorization: Bearer 0cc86333dbbbee008c8049607e8be6b017adb93599c2ed75636dd6d4482a61ac'1323vm-test-run-nixbot-gitlab> gitlab # [  131.147108] setup-gitlab-start[2596]: + curl -fs -X PUT -H 'Authorization: Bearer 0cc86333dbbbee008c8049607e8be6b017adb93599c2ed75636dd6d4482a61ac' 'http://gitlab/api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true'1324vm-test-run-nixbot-gitlab> gitlab # [  131.867294] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:41:24 +0000] "PUT /api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true HTTP/1.1" 200 17133 "" "curl/8.20.0" 6851325vm-test-run-nixbot-gitlab> gitlab # [  131.877046] setup-gitlab-start[2596]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner Rails.cache.clear1326vm-test-run-nixbot-gitlab> gitlab # [  131.888401] runuser[2636]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1327vm-test-run-nixbot-gitlab> gitlab # [  132.236367] setup-gitlab-start[2637]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1328vm-test-run-nixbot-gitlab> gitlab # [  132.238994] setup-gitlab-start[2637]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1329vm-test-run-nixbot-gitlab> gitlab # [  132.241174] setup-gitlab-start[2637]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1330vm-test-run-nixbot-gitlab> gitlab # [  132.809162] setup-gitlab-start[2637]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1331vm-test-run-nixbot-gitlab> gitlab # [  132.812450] setup-gitlab-start[2637]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1332vm-test-run-nixbot-gitlab> gitlab # [  132.815157] setup-gitlab-start[2637]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1333vm-test-run-nixbot-gitlab> gitlab # [  137.868792] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:30.694Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"a5d35a7b87bef4ac4b8fd674","created_at":"2026-06-09T13:41:30.660Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ac0f85dc10924ddbedb309fc5647e9d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:30.691Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-a5d35a7b87bef4ac4b8fd674: start","job_status":"start","queue_duration_s":0.003012,"scheduling_latency_s":0.003066}1334vm-test-run-nixbot-gitlab> gitlab # [  137.936593] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:30.763Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1335vm-test-run-nixbot-gitlab> gitlab # [  137.956343] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:30.782Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"a5d35a7b87bef4ac4b8fd674","created_at":"2026-06-09T13:41:30.660Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ac0f85dc10924ddbedb309fc5647e9d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:30.691Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-a5d35a7b87bef4ac4b8fd674: done: 0.088567 sec","job_status":"done","queue_duration_s":0.003012,"scheduling_latency_s":0.003066,"redis_calls":10,"redis_duration_s":0.013644,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001846,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009438,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00236,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001159924,"duration_s":0.088567,"completed_at":"2026-06-09T13:41:30.782Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001282,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336vm-test-run-nixbot-gitlab> gitlab # [  138.027561] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:30.854Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"8d606ad8e8307cc48a3b2abe","created_at":"2026-06-09T13:41:30.731Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc4ade5a62b74d923d428905b99d69a7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-06-09T13:41:30.752Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-8d606ad8e8307cc48a3b2abe: start","job_status":"start","queue_duration_s":0.10161,"scheduling_latency_s":0.101642}1337vm-test-run-nixbot-gitlab> gitlab # [  138.076436] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:30.903Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1338vm-test-run-nixbot-gitlab> gitlab # [  138.100441] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:30.927Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"8d606ad8e8307cc48a3b2abe","created_at":"2026-06-09T13:41:30.731Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc4ade5a62b74d923d428905b99d69a7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-06-09T13:41:30.752Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-8d606ad8e8307cc48a3b2abe: done: 0.072967 sec","job_status":"done","queue_duration_s":0.10161,"scheduling_latency_s":0.101642,"redis_calls":10,"redis_duration_s":0.018162,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003058,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013513,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001591,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000906261,"duration_s":0.072967,"completed_at":"2026-06-09T13:41:30.927Z","load_balancing_strategy":"primary","db_duration_s":0.000472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339vm-test-run-nixbot-gitlab> gitlab # [  138.136612] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:30.934Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"70c2bededbffa3a1d1820aa4","created_at":"2026-06-09T13:41:30.767Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b5736fcd7844cbe7db2a6f87e2f4ed47","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:30.853Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-70c2bededbffa3a1d1820aa4: start","job_status":"start","queue_duration_s":0.081322,"scheduling_latency_s":0.081345}1340vm-test-run-nixbot-gitlab> gitlab # [  138.227251] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:31.053Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"70c2bededbffa3a1d1820aa4","created_at":"2026-06-09T13:41:30.767Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b5736fcd7844cbe7db2a6f87e2f4ed47","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:30.853Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-70c2bededbffa3a1d1820aa4: done: 0.119566 sec","job_status":"done","queue_duration_s":0.081322,"scheduling_latency_s":0.081345,"redis_calls":19,"redis_duration_s":0.020764,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003175,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000598,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.014878,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002113,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.061,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.061,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001023594,"duration_s":0.119566,"completed_at":"2026-06-09T13:41:31.053Z","load_balancing_strategy":"primary","db_duration_s":0.061197,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341vm-test-run-nixbot-gitlab> gitlab # [  138.292892] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:31.069Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"520b7bd98e6dc09e45c1748a","created_at":"2026-06-09T13:41:30.888Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"720a3483deac9cc63031da761e254128","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:30.901Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-520b7bd98e6dc09e45c1748a: start","job_status":"start","queue_duration_s":0.167814,"scheduling_latency_s":0.167839}1342vm-test-run-nixbot-gitlab> gitlab # [  138.315330] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:31.125Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"520b7bd98e6dc09e45c1748a","created_at":"2026-06-09T13:41:30.888Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"720a3483deac9cc63031da761e254128","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:30.901Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-520b7bd98e6dc09e45c1748a: done: 0.05658 sec","job_status":"done","queue_duration_s":0.167814,"scheduling_latency_s":0.167839,"redis_calls":12,"redis_duration_s":0.005352,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002836,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001383,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001133,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000592533,"exclusive_lock_hold_duration_s":0.014238122999999998,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.05658,"completed_at":"2026-06-09T13:41:31.125Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027197,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343vm-test-run-nixbot-gitlab> gitlab # [  138.317240] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:31.128Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"0c88669f592d7bc69308bedb","created_at":"2026-06-09T13:41:30.924Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3cd0874d082fdd63c933113b7d0eba41","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:30.937Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-0c88669f592d7bc69308bedb: start","job_status":"start","queue_duration_s":0.191258,"scheduling_latency_s":0.191295}1344vm-test-run-nixbot-gitlab> gitlab # [  138.473292] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:31.299Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"0c88669f592d7bc69308bedb","created_at":"2026-06-09T13:41:30.924Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3cd0874d082fdd63c933113b7d0eba41","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:30.937Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-0c88669f592d7bc69308bedb: done: 0.170668 sec","job_status":"done","queue_duration_s":0.191258,"scheduling_latency_s":0.191295,"redis_calls":12,"redis_duration_s":0.130383,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.035399,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003488,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.091496,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001021917,"duration_s":0.170668,"completed_at":"2026-06-09T13:41:31.299Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004123,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345vm-test-run-nixbot-gitlab> gitlab # [  138.543320] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:31.370Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"b99571d8ce439d68234f6ce3","created_at":"2026-06-09T13:41:30.974Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe2808ad12764c51658db16182ad1058","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:30.983Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-b99571d8ce439d68234f6ce3: start","job_status":"start","queue_duration_s":0.386859,"scheduling_latency_s":0.386891}1346vm-test-run-nixbot-gitlab> gitlab # [  138.640985] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:31.467Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"b99571d8ce439d68234f6ce3","created_at":"2026-06-09T13:41:30.974Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe2808ad12764c51658db16182ad1058","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:30.983Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-b99571d8ce439d68234f6ce3: done: 0.096993 sec","job_status":"done","queue_duration_s":0.386859,"scheduling_latency_s":0.386891,"redis_calls":12,"redis_duration_s":0.012931999999999999,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002116,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007148,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003668,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001194845,"exclusive_lock_hold_duration_s":0.01522065,"duration_s":0.096993,"completed_at":"2026-06-09T13:41:31.467Z","load_balancing_strategy":"primary","db_duration_s":0.01141,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347vm-test-run-nixbot-gitlab> gitlab # [  138.712973] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:31.539Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"5588442bed4060d6d3156127","created_at":"2026-06-09T13:41:30.990Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"798fb9c1993cedaaefc15180a155e943","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-06-09T13:41:30.994Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-5588442bed4060d6d3156127: start","job_status":"start","queue_duration_s":0.544721,"scheduling_latency_s":0.544784}1348vm-test-run-nixbot-gitlab> gitlab # [  138.809941] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:31.635Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"5588442bed4060d6d3156127","created_at":"2026-06-09T13:41:30.990Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"798fb9c1993cedaaefc15180a155e943","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-06-09T13:41:30.994Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-5588442bed4060d6d3156127: done: 0.09673 sec","job_status":"done","queue_duration_s":0.544721,"scheduling_latency_s":0.544784,"redis_calls":10,"redis_duration_s":0.019271,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003917,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.014019,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001335,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.003048712,"duration_s":0.09673,"completed_at":"2026-06-09T13:41:31.635Z","load_balancing_strategy":"primary","db_duration_s":0.011362,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349vm-test-run-nixbot-gitlab> gitlab # [  138.852105] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:31.642Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"2990b40b30e543df988924e7","created_at":"2026-06-09T13:41:30.997Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ca35be77628fa9864b9f805792b6a0a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.001Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-2990b40b30e543df988924e7: start","job_status":"start","queue_duration_s":0.64031,"scheduling_latency_s":0.640336}1350vm-test-run-nixbot-gitlab> gitlab # [  139.278337] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.104Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"2990b40b30e543df988924e7","created_at":"2026-06-09T13:41:30.997Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ca35be77628fa9864b9f805792b6a0a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.001Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-2990b40b30e543df988924e7: done: 0.462448 sec","job_status":"done","queue_duration_s":0.64031,"scheduling_latency_s":0.640336,"redis_calls":14,"redis_duration_s":0.02343,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.013285,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004468,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005677,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":125,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":125,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.09,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":123,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":80,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.049,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.31035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001142882,"exclusive_lock_hold_duration_s":0.365535283,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.462448,"completed_at":"2026-06-09T13:41:32.104Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.124334,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351vm-test-run-nixbot-gitlab> gitlab # [  139.379052] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.205Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"56549296c79d40e483871927","created_at":"2026-06-09T13:41:31.015Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d532c69a3881dd8e3992f11216f27a7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.029Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-56549296c79d40e483871927: start","job_status":"start","queue_duration_s":1.176545,"scheduling_latency_s":1.176583}1352vm-test-run-nixbot-gitlab> gitlab # [  139.412194] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.239Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1353vm-test-run-nixbot-gitlab> gitlab # [  139.422864] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.249Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"56549296c79d40e483871927","created_at":"2026-06-09T13:41:31.015Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d532c69a3881dd8e3992f11216f27a7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.029Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-56549296c79d40e483871927: done: 0.04403 sec","job_status":"done","queue_duration_s":1.176545,"scheduling_latency_s":1.176583,"redis_calls":10,"redis_duration_s":0.006569,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000433,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005644,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000346133,"duration_s":0.04403,"completed_at":"2026-06-09T13:41:32.249Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000531,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354vm-test-run-nixbot-gitlab> gitlab # [  139.489188] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.315Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ea959731c1f77f35f1194c40","created_at":"2026-06-09T13:41:31.015Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-ae5c22b7b34b4c0c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b5736fcd7844cbe7db2a6f87e2f4ed47","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.043Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ea959731c1f77f35f1194c40: start","job_status":"start","queue_duration_s":1.27267,"scheduling_latency_s":1.272704}1355vm-test-run-nixbot-gitlab> gitlab # [  139.536183] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.362Z","message":"No existing merge request to be cleaned up."}1356vm-test-run-nixbot-gitlab> gitlab # [  139.561937] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.388Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ea959731c1f77f35f1194c40","created_at":"2026-06-09T13:41:31.015Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-ae5c22b7b34b4c0c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b5736fcd7844cbe7db2a6f87e2f4ed47","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.043Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ea959731c1f77f35f1194c40: done: 0.072241 sec","job_status":"done","queue_duration_s":1.27267,"scheduling_latency_s":1.272704,"redis_calls":13,"redis_duration_s":0.007645,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001228,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003035,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003382,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000945651,"duration_s":0.072241,"completed_at":"2026-06-09T13:41:32.388Z","load_balancing_strategy":"primary","db_duration_s":0.00676,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357vm-test-run-nixbot-gitlab> gitlab # [  139.598974] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.391Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a6a24c784ee4afd49a8aea2d","created_at":"2026-06-09T13:41:31.015Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-ae5c22b7b34b4c0c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b5736fcd7844cbe7db2a6f87e2f4ed47","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.043Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a6a24c784ee4afd49a8aea2d: start","job_status":"start","queue_duration_s":1.34819,"scheduling_latency_s":1.348231}1358vm-test-run-nixbot-gitlab> gitlab # [  139.600248] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.409Z","message":"No existing merge request to be cleaned up."}1359vm-test-run-nixbot-gitlab> gitlab # [  139.601103] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.417Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a6a24c784ee4afd49a8aea2d","created_at":"2026-06-09T13:41:31.015Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-ae5c22b7b34b4c0c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b5736fcd7844cbe7db2a6f87e2f4ed47","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.043Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a6a24c784ee4afd49a8aea2d: done: 0.026001 sec","job_status":"done","queue_duration_s":1.34819,"scheduling_latency_s":1.348231,"redis_calls":10,"redis_duration_s":0.005123,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002272,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002851,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026001,"completed_at":"2026-06-09T13:41:32.417Z","load_balancing_strategy":"primary","db_duration_s":0.002594,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360vm-test-run-nixbot-gitlab> gitlab # [  139.674265] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.419Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0f9fc3fd2f30dfe7c2f28187","created_at":"2026-06-09T13:41:31.015Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-ae5c22b7b34b4c0c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b5736fcd7844cbe7db2a6f87e2f4ed47","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.043Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0f9fc3fd2f30dfe7c2f28187: start","job_status":"start","queue_duration_s":1.376282,"scheduling_latency_s":1.376303}1361vm-test-run-nixbot-gitlab> gitlab # [  139.675119] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.438Z","message":"No existing merge request to be cleaned up."}1362vm-test-run-nixbot-gitlab> gitlab # [  139.675844] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.451Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0f9fc3fd2f30dfe7c2f28187","created_at":"2026-06-09T13:41:31.015Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-ae5c22b7b34b4c0c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b5736fcd7844cbe7db2a6f87e2f4ed47","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.043Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0f9fc3fd2f30dfe7c2f28187: done: 0.032298 sec","job_status":"done","queue_duration_s":1.376282,"scheduling_latency_s":1.376303,"redis_calls":10,"redis_duration_s":0.00454,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002251,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002289,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0226,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032298,"completed_at":"2026-06-09T13:41:32.451Z","load_balancing_strategy":"primary","db_duration_s":0.003083,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363vm-test-run-nixbot-gitlab> gitlab # [  139.718218] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.454Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"62d398de4e81ec1bf03dc3e1","created_at":"2026-06-09T13:41:31.015Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-ae5c22b7b34b4c0c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b5736fcd7844cbe7db2a6f87e2f4ed47","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.043Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-62d398de4e81ec1bf03dc3e1: start","job_status":"start","queue_duration_s":1.411233,"scheduling_latency_s":1.411276}1364vm-test-run-nixbot-gitlab> gitlab # [  139.737800] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.468Z","message":"No existing merge request to be cleaned up."}1365vm-test-run-nixbot-gitlab> gitlab # [  139.806376] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.474Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"62d398de4e81ec1bf03dc3e1","created_at":"2026-06-09T13:41:31.015Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-ae5c22b7b34b4c0c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b5736fcd7844cbe7db2a6f87e2f4ed47","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.043Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-62d398de4e81ec1bf03dc3e1: done: 0.019633 sec","job_status":"done","queue_duration_s":1.411233,"scheduling_latency_s":1.411276,"redis_calls":10,"redis_duration_s":0.002382,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00144,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019633,"completed_at":"2026-06-09T13:41:32.474Z","load_balancing_strategy":"primary","db_duration_s":0.001526,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366vm-test-run-nixbot-gitlab> gitlab # [  139.808178] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.475Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b158e0338b4ad8fe1e38a857","created_at":"2026-06-09T13:41:31.043Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4086495eb02ea162adedfaa6e6c67a26","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.052Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b158e0338b4ad8fe1e38a857: start","job_status":"start","queue_duration_s":1.422984,"scheduling_latency_s":1.423005}1367vm-test-run-nixbot-gitlab> gitlab # [  139.882229] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.531Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b158e0338b4ad8fe1e38a857","created_at":"2026-06-09T13:41:31.043Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4086495eb02ea162adedfaa6e6c67a26","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.052Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b158e0338b4ad8fe1e38a857: done: 0.055979 sec","job_status":"done","queue_duration_s":1.422984,"scheduling_latency_s":1.423005,"redis_calls":12,"redis_duration_s":0.002811,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00041,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001363,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001038,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000635835,"exclusive_lock_hold_duration_s":0.011633881,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.055979,"completed_at":"2026-06-09T13:41:32.531Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033225,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368vm-test-run-nixbot-gitlab> gitlab # [  139.953958] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.532Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"07b514345840b36767b68241","created_at":"2026-06-09T13:41:31.068Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd8dcfa731252b89da916636694e6bd2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.092Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-07b514345840b36767b68241: start","job_status":"start","queue_duration_s":1.440947,"scheduling_latency_s":1.440969}1369vm-test-run-nixbot-gitlab> gitlab # [  139.954778] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.563Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"07b514345840b36767b68241","created_at":"2026-06-09T13:41:31.068Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd8dcfa731252b89da916636694e6bd2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.092Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-07b514345840b36767b68241: done: 0.030399 sec","job_status":"done","queue_duration_s":1.440947,"scheduling_latency_s":1.440969,"redis_calls":12,"redis_duration_s":0.0029449999999999997,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000584,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001414,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000474921,"exclusive_lock_hold_duration_s":0.012867558,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.030399,"completed_at":"2026-06-09T13:41:32.563Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006579,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370vm-test-run-nixbot-gitlab> gitlab # [  140.021745] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.564Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"32dc82db4c147ac3d3e6a1c6","created_at":"2026-06-09T13:41:31.098Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d187ff452dc004be9009f402e2a8024","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.123Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-32dc82db4c147ac3d3e6a1c6: start","job_status":"start","queue_duration_s":1.441516,"scheduling_latency_s":1.441537}1371vm-test-run-nixbot-gitlab> gitlab # [  140.023051] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.575Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1372vm-test-run-nixbot-gitlab> gitlab # [  140.078367] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.583Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"32dc82db4c147ac3d3e6a1c6","created_at":"2026-06-09T13:41:31.098Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d187ff452dc004be9009f402e2a8024","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.123Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-32dc82db4c147ac3d3e6a1c6: done: 0.018445 sec","job_status":"done","queue_duration_s":1.441516,"scheduling_latency_s":1.441537,"redis_calls":10,"redis_duration_s":0.002399,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000404,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001583,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000412,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000341105,"duration_s":0.018445,"completed_at":"2026-06-09T13:41:32.583Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000408,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373vm-test-run-nixbot-gitlab> gitlab # [  140.080185] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.584Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"78121362fb28ecfb3bb97746","created_at":"2026-06-09T13:41:31.135Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.233Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-78121362fb28ecfb3bb97746: start","job_status":"start","queue_duration_s":1.351796,"scheduling_latency_s":1.351824}1374vm-test-run-nixbot-gitlab> gitlab # [  140.096506] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.680Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"78121362fb28ecfb3bb97746","created_at":"2026-06-09T13:41:31.135Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.233Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-78121362fb28ecfb3bb97746: done: 0.095529 sec","job_status":"done","queue_duration_s":1.351796,"scheduling_latency_s":1.351824,"redis_calls":71,"redis_duration_s":0.016047,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002144,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.00072,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.01248,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000703,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.077516,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039614,"duration_s":0.095529,"completed_at":"2026-06-09T13:41:32.680Z","load_balancing_strategy":"primary","db_duration_s":0.001621,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375vm-test-run-nixbot-gitlab> gitlab # [  140.195505] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.681Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"da68821505251304c19ba578","created_at":"2026-06-09T13:41:31.271Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4df83a83485e07037fb0530073520878","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.287Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-da68821505251304c19ba578: start","job_status":"start","queue_duration_s":1.393847,"scheduling_latency_s":1.393867}1376vm-test-run-nixbot-gitlab> gitlab # [  140.196902] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.702Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"da68821505251304c19ba578","created_at":"2026-06-09T13:41:31.271Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4df83a83485e07037fb0530073520878","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.287Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-da68821505251304c19ba578: done: 0.020679 sec","job_status":"done","queue_duration_s":1.393847,"scheduling_latency_s":1.393867,"redis_calls":10,"redis_duration_s":0.002445,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000498,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001441,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000506,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000408153,"duration_s":0.020679,"completed_at":"2026-06-09T13:41:32.702Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00065,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377vm-test-run-nixbot-gitlab> gitlab # [  140.291141] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.704Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"50ddbf56f2a558b815f3dd7d","created_at":"2026-06-09T13:41:31.296Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"60ffbfa309c7b321a243b28e1bbd8afa","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.368Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-50ddbf56f2a558b815f3dd7d: start","job_status":"start","queue_duration_s":1.335118,"scheduling_latency_s":1.33514}1378vm-test-run-nixbot-gitlab> gitlab # [  140.292483] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.739Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"50ddbf56f2a558b815f3dd7d","created_at":"2026-06-09T13:41:31.296Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"60ffbfa309c7b321a243b28e1bbd8afa","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.368Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-50ddbf56f2a558b815f3dd7d: done: 0.035565 sec","job_status":"done","queue_duration_s":1.335118,"scheduling_latency_s":1.33514,"redis_calls":16,"redis_duration_s":0.003862,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001892,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00145,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00052,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000393625,"duration_s":0.035565,"completed_at":"2026-06-09T13:41:32.739Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00418,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379vm-test-run-nixbot-gitlab> gitlab # [  140.378334] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.741Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"5263d082035e1b4742c2735c","created_at":"2026-06-09T13:41:31.418Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d318177b268f855b3edf925651e8e7e0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-06-09T13:41:31.429Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-5263d082035e1b4742c2735c: start","job_status":"start","queue_duration_s":1.311427,"scheduling_latency_s":1.311448}1380vm-test-run-nixbot-gitlab> gitlab # [  140.379866] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.751Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1381vm-test-run-nixbot-gitlab> gitlab # [  140.381146] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.758Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"5263d082035e1b4742c2735c","created_at":"2026-06-09T13:41:31.418Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d318177b268f855b3edf925651e8e7e0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-06-09T13:41:31.429Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-5263d082035e1b4742c2735c: done: 0.017013 sec","job_status":"done","queue_duration_s":1.311427,"scheduling_latency_s":1.311448,"redis_calls":10,"redis_duration_s":0.0021,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000468,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001225,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000407,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000361498,"duration_s":0.017013,"completed_at":"2026-06-09T13:41:32.757Z","load_balancing_strategy":"primary","db_duration_s":0.000481,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382vm-test-run-nixbot-gitlab> gitlab # [  140.466796] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.759Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"69b4d1d6dd8afe6501922ee0","created_at":"2026-06-09T13:41:31.440Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c0e06dc317d71f465bd12c346d3891d0","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.452Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-69b4d1d6dd8afe6501922ee0: start","job_status":"start","queue_duration_s":1.307118,"scheduling_latency_s":1.307138}1383vm-test-run-nixbot-gitlab> gitlab # [  140.467863] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.785Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"69b4d1d6dd8afe6501922ee0","created_at":"2026-06-09T13:41:31.440Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c0e06dc317d71f465bd12c346d3891d0","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.452Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-69b4d1d6dd8afe6501922ee0: done: 0.02654 sec","job_status":"done","queue_duration_s":1.307118,"scheduling_latency_s":1.307138,"redis_calls":13,"redis_duration_s":0.0031219999999999998,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000409,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001722,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00812701,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.02654,"completed_at":"2026-06-09T13:41:32.785Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002948,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1384vm-test-run-nixbot-gitlab> gitlab # [  140.552259] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:32.787Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"c31c5150aba55035a365259c","created_at":"2026-06-09T13:41:31.468Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d11f29ed33260ccf1fb5351f62e57d3a","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.565Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-c31c5150aba55035a365259c: start","job_status":"start","queue_duration_s":1.221733,"scheduling_latency_s":1.221753}1385vm-test-run-nixbot-gitlab> gitlab # [  140.553818] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.233Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"c31c5150aba55035a365259c","created_at":"2026-06-09T13:41:31.468Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d11f29ed33260ccf1fb5351f62e57d3a","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.565Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-c31c5150aba55035a365259c: done: 0.446209 sec","job_status":"done","queue_duration_s":1.221733,"scheduling_latency_s":1.221753,"redis_calls":574,"redis_duration_s":0.130693,"redis_read_bytes":573,"redis_write_bytes":49866,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000445,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001309,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.128939,"redis_shared_state_read_bytes":567,"redis_shared_state_write_bytes":49017,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.347719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000392508,"duration_s":0.446209,"completed_at":"2026-06-09T13:41:33.233Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000369,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386vm-test-run-nixbot-gitlab> gitlab # [  140.634987] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.235Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"f656fb0de25a46023aa4c828","created_at":"2026-06-09T13:41:31.589Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9276f3500d3dbe29c7943367f8dbed98","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.615Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-f656fb0de25a46023aa4c828: start","job_status":"start","queue_duration_s":1.619653,"scheduling_latency_s":1.619676}1387vm-test-run-nixbot-gitlab> gitlab # [  140.636161] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.255Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"f656fb0de25a46023aa4c828","created_at":"2026-06-09T13:41:31.589Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9276f3500d3dbe29c7943367f8dbed98","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.615Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-f656fb0de25a46023aa4c828: done: 0.019854 sec","job_status":"done","queue_duration_s":1.619653,"scheduling_latency_s":1.619676,"redis_calls":10,"redis_duration_s":0.002039,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000396,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001199,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000444,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000310374,"duration_s":0.019854,"completed_at":"2026-06-09T13:41:33.255Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002074,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388vm-test-run-nixbot-gitlab> gitlab # [  140.710219] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.256Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"748a87e26a84221780ed926b","created_at":"2026-06-09T13:41:31.627Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48adc44065615a590ed837e72d3d0198","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.643Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-748a87e26a84221780ed926b: start","job_status":"start","queue_duration_s":1.612887,"scheduling_latency_s":1.612907}1389vm-test-run-nixbot-gitlab> gitlab # [  140.713283] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.280Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"748a87e26a84221780ed926b","created_at":"2026-06-09T13:41:31.627Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48adc44065615a590ed837e72d3d0198","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.643Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-748a87e26a84221780ed926b: done: 0.023768 sec","job_status":"done","queue_duration_s":1.612887,"scheduling_latency_s":1.612907,"redis_calls":10,"redis_duration_s":0.002046,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000379,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001248,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000419,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000364292,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.023768,"completed_at":"2026-06-09T13:41:33.280Z","load_balancing_strategy":"primary","db_duration_s":0.006483,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390vm-test-run-nixbot-gitlab> gitlab # [  140.793113] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.281Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"43984461ae0d81e345cfdee9","created_at":"2026-06-09T13:41:31.658Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f1765e330626f0dfaceda9b85b97faf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.671Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-43984461ae0d81e345cfdee9: start","job_status":"start","queue_duration_s":1.609756,"scheduling_latency_s":1.609775}1391vm-test-run-nixbot-gitlab> gitlab # [  140.800992] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.291Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1392vm-test-run-nixbot-gitlab> gitlab # [  140.806911] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.297Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"43984461ae0d81e345cfdee9","created_at":"2026-06-09T13:41:31.658Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f1765e330626f0dfaceda9b85b97faf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-06-09T13:41:31.671Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-43984461ae0d81e345cfdee9: done: 0.015692 sec","job_status":"done","queue_duration_s":1.609756,"scheduling_latency_s":1.609775,"redis_calls":10,"redis_duration_s":0.002123,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000379,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001246,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000498,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000345854,"duration_s":0.015692,"completed_at":"2026-06-09T13:41:33.297Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000365,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393vm-test-run-nixbot-gitlab> gitlab # [  140.893190] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35354a7063cf80ea49988706","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35354a7063cf80ea49988706: start","job_status":"start","queue_duration_s":0.626359,"scheduling_latency_s":0.626379}1394vm-test-run-nixbot-gitlab> gitlab # [  140.894573] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35354a7063cf80ea49988706","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35354a7063cf80ea49988706: done: 0.020507 sec","job_status":"done","queue_duration_s":0.626359,"scheduling_latency_s":0.626379,"redis_calls":16,"redis_duration_s":0.003491,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000455,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001066,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00197,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000308699,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020507,"completed_at":"2026-06-09T13:41:33.318Z","load_balancing_strategy":"primary","db_duration_s":0.001828,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395vm-test-run-nixbot-gitlab> gitlab # [  140.976195] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.320Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d9e3d56b96e8f978cee0efc","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d9e3d56b96e8f978cee0efc: start","job_status":"start","queue_duration_s":0.648106,"scheduling_latency_s":0.648126}1396vm-test-run-nixbot-gitlab> gitlab # [  140.977270] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d9e3d56b96e8f978cee0efc","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d9e3d56b96e8f978cee0efc: done: 0.014616 sec","job_status":"done","queue_duration_s":0.648106,"scheduling_latency_s":0.648126,"redis_calls":13,"redis_duration_s":0.002607,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000814,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001793,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009911,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014616,"completed_at":"2026-06-09T13:41:33.334Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397vm-test-run-nixbot-gitlab> gitlab # [  141.035216] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"613adfd80ab844f448b74065","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-613adfd80ab844f448b74065: start","job_status":"start","queue_duration_s":0.66386,"scheduling_latency_s":0.66388}1398vm-test-run-nixbot-gitlab> gitlab # [  141.116275] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.350Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"613adfd80ab844f448b74065","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-613adfd80ab844f448b74065: done: 0.014889 sec","job_status":"done","queue_duration_s":0.66386,"scheduling_latency_s":0.66388,"redis_calls":13,"redis_duration_s":0.002842,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000824,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014889,"completed_at":"2026-06-09T13:41:33.350Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399vm-test-run-nixbot-gitlab> gitlab # [  141.118055] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70804cad85ff1c889612b6cd","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70804cad85ff1c889612b6cd: start","job_status":"start","queue_duration_s":0.679939,"scheduling_latency_s":0.67996}1400vm-test-run-nixbot-gitlab> gitlab # [  141.184766] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70804cad85ff1c889612b6cd","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70804cad85ff1c889612b6cd: done: 0.014276 sec","job_status":"done","queue_duration_s":0.679939,"scheduling_latency_s":0.67996,"redis_calls":13,"redis_duration_s":0.002683,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000765,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014276,"completed_at":"2026-06-09T13:41:33.366Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401vm-test-run-nixbot-gitlab> gitlab # [  141.192983] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09527d0de2ca80c14facbfd1","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09527d0de2ca80c14facbfd1: start","job_status":"start","queue_duration_s":0.695635,"scheduling_latency_s":0.695655}1402vm-test-run-nixbot-gitlab> gitlab # [  141.271380] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.382Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09527d0de2ca80c14facbfd1","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09527d0de2ca80c14facbfd1: done: 0.014402 sec","job_status":"done","queue_duration_s":0.695635,"scheduling_latency_s":0.695655,"redis_calls":13,"redis_duration_s":0.002652,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000863,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001789,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009642,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014402,"completed_at":"2026-06-09T13:41:33.382Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403vm-test-run-nixbot-gitlab> gitlab # [  141.273419] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9930e63fd8139a3212017985","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9930e63fd8139a3212017985: start","job_status":"start","queue_duration_s":0.711389,"scheduling_latency_s":0.711409}1404vm-test-run-nixbot-gitlab> gitlab # [  141.295291] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.398Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9930e63fd8139a3212017985","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9930e63fd8139a3212017985: done: 0.014631 sec","job_status":"done","queue_duration_s":0.711389,"scheduling_latency_s":0.711409,"redis_calls":13,"redis_duration_s":0.002853,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000888,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014631,"completed_at":"2026-06-09T13:41:33.398Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405vm-test-run-nixbot-gitlab> gitlab # [  141.378938] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.399Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c705afc9d89206da3caf58dd","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c705afc9d89206da3caf58dd: start","job_status":"start","queue_duration_s":0.72726,"scheduling_latency_s":0.727281}1406vm-test-run-nixbot-gitlab> gitlab # [  141.380062] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.413Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c705afc9d89206da3caf58dd","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c705afc9d89206da3caf58dd: done: 0.014333 sec","job_status":"done","queue_duration_s":0.72726,"scheduling_latency_s":0.727281,"redis_calls":13,"redis_duration_s":0.002586,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000777,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001809,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014333,"completed_at":"2026-06-09T13:41:33.413Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407vm-test-run-nixbot-gitlab> gitlab # [  141.470160] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.414Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af0e4112534d41d6f7d02fa9","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af0e4112534d41d6f7d02fa9: start","job_status":"start","queue_duration_s":0.742803,"scheduling_latency_s":0.742823}1408vm-test-run-nixbot-gitlab> gitlab # [  141.471553] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.429Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af0e4112534d41d6f7d02fa9","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af0e4112534d41d6f7d02fa9: done: 0.014508 sec","job_status":"done","queue_duration_s":0.742803,"scheduling_latency_s":0.742823,"redis_calls":13,"redis_duration_s":0.0027589999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000777,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014508,"completed_at":"2026-06-09T13:41:33.429Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409vm-test-run-nixbot-gitlab> gitlab # [  141.553053] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.430Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6ed12d91e5a13abb931d5d2","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6ed12d91e5a13abb931d5d2: start","job_status":"start","queue_duration_s":0.758475,"scheduling_latency_s":0.758496}1410vm-test-run-nixbot-gitlab> gitlab # [  141.554128] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.445Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6ed12d91e5a13abb931d5d2","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6ed12d91e5a13abb931d5d2: done: 0.014539 sec","job_status":"done","queue_duration_s":0.758475,"scheduling_latency_s":0.758496,"redis_calls":13,"redis_duration_s":0.002539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00085,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001689,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009465,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014539,"completed_at":"2026-06-09T13:41:33.445Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411vm-test-run-nixbot-gitlab> gitlab # [  141.638591] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.446Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"526286d398ae6ccafa407542","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-526286d398ae6ccafa407542: start","job_status":"start","queue_duration_s":0.77423,"scheduling_latency_s":0.77425}1412vm-test-run-nixbot-gitlab> gitlab # [  141.640541] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.460Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"526286d398ae6ccafa407542","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-526286d398ae6ccafa407542: done: 0.01443 sec","job_status":"done","queue_duration_s":0.77423,"scheduling_latency_s":0.77425,"redis_calls":13,"redis_duration_s":0.002678,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000819,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001859,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01443,"completed_at":"2026-06-09T13:41:33.460Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413vm-test-run-nixbot-gitlab> gitlab # [  141.737268] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.462Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"592a6a018713138f782165e4","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-592a6a018713138f782165e4: start","job_status":"start","queue_duration_s":0.789923,"scheduling_latency_s":0.789943}1414vm-test-run-nixbot-gitlab> gitlab # [  141.738421] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"592a6a018713138f782165e4","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-592a6a018713138f782165e4: done: 0.01467 sec","job_status":"done","queue_duration_s":0.789923,"scheduling_latency_s":0.789943,"redis_calls":13,"redis_duration_s":0.002839,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01467,"completed_at":"2026-06-09T13:41:33.476Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415vm-test-run-nixbot-gitlab> gitlab # [  141.751134] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75f45709ae8a2500ffea2d48","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75f45709ae8a2500ffea2d48: start","job_status":"start","queue_duration_s":0.805864,"scheduling_latency_s":0.805885}1416vm-test-run-nixbot-gitlab> gitlab # [  141.826262] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75f45709ae8a2500ffea2d48","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75f45709ae8a2500ffea2d48: done: 0.014212 sec","job_status":"done","queue_duration_s":0.805864,"scheduling_latency_s":0.805885,"redis_calls":13,"redis_duration_s":0.002498,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000765,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001733,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009693,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014212,"completed_at":"2026-06-09T13:41:33.492Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417vm-test-run-nixbot-gitlab> gitlab # [  141.831336] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c12e3c2e07bf502b8150386a","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c12e3c2e07bf502b8150386a: start","job_status":"start","queue_duration_s":0.821318,"scheduling_latency_s":0.821338}1418vm-test-run-nixbot-gitlab> gitlab # [  141.851120] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c12e3c2e07bf502b8150386a","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c12e3c2e07bf502b8150386a: done: 0.014259 sec","job_status":"done","queue_duration_s":0.821318,"scheduling_latency_s":0.821338,"redis_calls":13,"redis_duration_s":0.00255,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000781,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001769,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014259,"completed_at":"2026-06-09T13:41:33.507Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419vm-test-run-nixbot-gitlab> gitlab # [  141.974957] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.509Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"187ca96f02ccf1c899578241","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-187ca96f02ccf1c899578241: start","job_status":"start","queue_duration_s":0.836978,"scheduling_latency_s":0.836999}1420vm-test-run-nixbot-gitlab> gitlab # [  141.976053] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.523Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"187ca96f02ccf1c899578241","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-187ca96f02ccf1c899578241: done: 0.014279 sec","job_status":"done","queue_duration_s":0.836978,"scheduling_latency_s":0.836999,"redis_calls":13,"redis_duration_s":0.00272,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001769,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014279,"completed_at":"2026-06-09T13:41:33.523Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421vm-test-run-nixbot-gitlab> gitlab # [  142.052959] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e7bf00c61a0b0a3d1eb5a4d","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e7bf00c61a0b0a3d1eb5a4d: start","job_status":"start","queue_duration_s":0.85261,"scheduling_latency_s":0.85263}1422vm-test-run-nixbot-gitlab> gitlab # [  142.054337] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.538Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e7bf00c61a0b0a3d1eb5a4d","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e7bf00c61a0b0a3d1eb5a4d: done: 0.014171 sec","job_status":"done","queue_duration_s":0.85261,"scheduling_latency_s":0.85263,"redis_calls":13,"redis_duration_s":0.00261,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001743,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014171,"completed_at":"2026-06-09T13:41:33.538Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423vm-test-run-nixbot-gitlab> gitlab # [  142.128055] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.540Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd22d2a597c61de9de6f25f1","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd22d2a597c61de9de6f25f1: start","job_status":"start","queue_duration_s":0.868018,"scheduling_latency_s":0.868039}1424vm-test-run-nixbot-gitlab> gitlab # [  142.129407] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.554Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd22d2a597c61de9de6f25f1","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd22d2a597c61de9de6f25f1: done: 0.014557 sec","job_status":"done","queue_duration_s":0.868018,"scheduling_latency_s":0.868039,"redis_calls":13,"redis_duration_s":0.002933,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000862,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002071,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014557,"completed_at":"2026-06-09T13:41:33.554Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425vm-test-run-nixbot-gitlab> gitlab # [  142.149131] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.555Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4838cc389e4468702eac6f7e","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4838cc389e4468702eac6f7e: start","job_status":"start","queue_duration_s":0.883802,"scheduling_latency_s":0.883822}1426vm-test-run-nixbot-gitlab> gitlab # [  142.217472] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.570Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4838cc389e4468702eac6f7e","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4838cc389e4468702eac6f7e: done: 0.014072 sec","job_status":"done","queue_duration_s":0.883802,"scheduling_latency_s":0.883822,"redis_calls":13,"redis_duration_s":0.002662,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001756,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014072,"completed_at":"2026-06-09T13:41:33.569Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427vm-test-run-nixbot-gitlab> gitlab # [  142.287495] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.571Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e924468576296f482b4d84e7","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e924468576296f482b4d84e7: start","job_status":"start","queue_duration_s":0.899117,"scheduling_latency_s":0.899137}1428vm-test-run-nixbot-gitlab> gitlab # [  142.289295] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e924468576296f482b4d84e7","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e924468576296f482b4d84e7: done: 0.0141 sec","job_status":"done","queue_duration_s":0.899117,"scheduling_latency_s":0.899137,"redis_calls":13,"redis_duration_s":0.002496,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000766,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00173,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0141,"completed_at":"2026-06-09T13:41:33.585Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429vm-test-run-nixbot-gitlab> gitlab # [  142.309792] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f751db132c26ea6e31d6849","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f751db132c26ea6e31d6849: start","job_status":"start","queue_duration_s":0.914366,"scheduling_latency_s":0.914386}1430vm-test-run-nixbot-gitlab> gitlab # [  142.379617] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f751db132c26ea6e31d6849","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f751db132c26ea6e31d6849: done: 0.014083 sec","job_status":"done","queue_duration_s":0.914366,"scheduling_latency_s":0.914386,"redis_calls":13,"redis_duration_s":0.0025180000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000792,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001726,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014083,"completed_at":"2026-06-09T13:41:33.600Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431vm-test-run-nixbot-gitlab> gitlab # [  142.389180] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.601Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8cf957fe01221e43bc57cb1","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8cf957fe01221e43bc57cb1: start","job_status":"start","queue_duration_s":0.929742,"scheduling_latency_s":0.929763}1432vm-test-run-nixbot-gitlab> gitlab # [  142.461887] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8cf957fe01221e43bc57cb1","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8cf957fe01221e43bc57cb1: done: 0.014216 sec","job_status":"done","queue_duration_s":0.929742,"scheduling_latency_s":0.929763,"redis_calls":13,"redis_duration_s":0.002748,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000874,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014216,"completed_at":"2026-06-09T13:41:33.616Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433vm-test-run-nixbot-gitlab> gitlab # [  142.468126] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.617Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f4d7425bd873aebddbd3d4d","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f4d7425bd873aebddbd3d4d: start","job_status":"start","queue_duration_s":0.945226,"scheduling_latency_s":0.945246}1434vm-test-run-nixbot-gitlab> gitlab # [  142.536622] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.636Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f4d7425bd873aebddbd3d4d","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f4d7425bd873aebddbd3d4d: done: 0.018966 sec","job_status":"done","queue_duration_s":0.945226,"scheduling_latency_s":0.945246,"redis_calls":13,"redis_duration_s":0.0036940000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002772,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00937,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018966,"completed_at":"2026-06-09T13:41:33.636Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435vm-test-run-nixbot-gitlab> gitlab # [  142.548423] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.637Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfc1b69b137b921bc0c43587","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfc1b69b137b921bc0c43587: start","job_status":"start","queue_duration_s":0.965509,"scheduling_latency_s":0.965529}1436vm-test-run-nixbot-gitlab> gitlab # [  142.569170] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.654Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfc1b69b137b921bc0c43587","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfc1b69b137b921bc0c43587: done: 0.016975 sec","job_status":"done","queue_duration_s":0.965509,"scheduling_latency_s":0.965529,"redis_calls":13,"redis_duration_s":0.003069,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000896,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002173,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016975,"completed_at":"2026-06-09T13:41:33.654Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437vm-test-run-nixbot-gitlab> gitlab # [  142.658477] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b27262cb8479b3548fdc252","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b27262cb8479b3548fdc252: start","job_status":"start","queue_duration_s":0.984201,"scheduling_latency_s":0.984228}1438vm-test-run-nixbot-gitlab> gitlab # [  142.660313] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b27262cb8479b3548fdc252","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b27262cb8479b3548fdc252: done: 0.015543 sec","job_status":"done","queue_duration_s":0.984201,"scheduling_latency_s":0.984228,"redis_calls":13,"redis_duration_s":0.002794,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000895,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015543,"completed_at":"2026-06-09T13:41:33.671Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439vm-test-run-nixbot-gitlab> gitlab # [  142.710356] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8cb028ee71df1fd5c97cb6c","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8cb028ee71df1fd5c97cb6c: start","job_status":"start","queue_duration_s":1.00094,"scheduling_latency_s":1.000961}1440vm-test-run-nixbot-gitlab> gitlab # [  142.729776] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8cb028ee71df1fd5c97cb6c","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8cb028ee71df1fd5c97cb6c: done: 0.01428 sec","job_status":"done","queue_duration_s":1.00094,"scheduling_latency_s":1.000961,"redis_calls":13,"redis_duration_s":0.002654,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001853,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01428,"completed_at":"2026-06-09T13:41:33.687Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441vm-test-run-nixbot-gitlab> gitlab # [  142.821200] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f29383a25968937fc9fbba86","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f29383a25968937fc9fbba86: start","job_status":"start","queue_duration_s":1.016432,"scheduling_latency_s":1.016452}1442vm-test-run-nixbot-gitlab> gitlab # [  142.822785] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f29383a25968937fc9fbba86","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f29383a25968937fc9fbba86: done: 0.014375 sec","job_status":"done","queue_duration_s":1.016432,"scheduling_latency_s":1.016452,"redis_calls":13,"redis_duration_s":0.002722,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001857,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014375,"completed_at":"2026-06-09T13:41:33.702Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443vm-test-run-nixbot-gitlab> gitlab # [  142.929410] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.704Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"517e5b38ceaf203b05d9b378","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-517e5b38ceaf203b05d9b378: start","job_status":"start","queue_duration_s":1.032007,"scheduling_latency_s":1.032027}1444vm-test-run-nixbot-gitlab> gitlab # [  142.931193] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"517e5b38ceaf203b05d9b378","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-517e5b38ceaf203b05d9b378: done: 0.014488 sec","job_status":"done","queue_duration_s":1.032007,"scheduling_latency_s":1.032027,"redis_calls":13,"redis_duration_s":0.002728,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000815,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014488,"completed_at":"2026-06-09T13:41:33.718Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445vm-test-run-nixbot-gitlab> gitlab # [  142.948957] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61018c17670c4a9c3a1d0fbe","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61018c17670c4a9c3a1d0fbe: start","job_status":"start","queue_duration_s":1.047873,"scheduling_latency_s":1.047893}1446vm-test-run-nixbot-gitlab> gitlab # [  143.034159] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.734Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61018c17670c4a9c3a1d0fbe","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61018c17670c4a9c3a1d0fbe: done: 0.014904 sec","job_status":"done","queue_duration_s":1.047873,"scheduling_latency_s":1.047893,"redis_calls":13,"redis_duration_s":0.003195,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00119,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014904,"completed_at":"2026-06-09T13:41:33.734Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447vm-test-run-nixbot-gitlab> gitlab # [  143.035115] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.736Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46d9cef206ae1795d6a3018a","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46d9cef206ae1795d6a3018a: start","job_status":"start","queue_duration_s":1.064091,"scheduling_latency_s":1.064112}1448vm-test-run-nixbot-gitlab> gitlab # [  143.048223] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46d9cef206ae1795d6a3018a","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46d9cef206ae1795d6a3018a: done: 0.014414 sec","job_status":"done","queue_duration_s":1.064091,"scheduling_latency_s":1.064112,"redis_calls":13,"redis_duration_s":0.002742,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000814,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009694,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014414,"completed_at":"2026-06-09T13:41:33.750Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449vm-test-run-nixbot-gitlab> gitlab # [  143.109754] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffe98a149bd0c5757916a99e","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffe98a149bd0c5757916a99e: start","job_status":"start","queue_duration_s":1.079764,"scheduling_latency_s":1.079784}1450vm-test-run-nixbot-gitlab> gitlab # [  143.189197] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffe98a149bd0c5757916a99e","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffe98a149bd0c5757916a99e: done: 0.014444 sec","job_status":"done","queue_duration_s":1.079764,"scheduling_latency_s":1.079784,"redis_calls":13,"redis_duration_s":0.002773,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00089,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014444,"completed_at":"2026-06-09T13:41:33.766Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451vm-test-run-nixbot-gitlab> gitlab # [  143.191204] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:33.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd7f45f9fcb4bc6d0d652234","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd7f45f9fcb4bc6d0d652234: start","job_status":"start","queue_duration_s":1.095428,"scheduling_latency_s":1.095448}1452vm-test-run-nixbot-gitlab> gitlab # [  143.534508] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 3006785550 wd_nsec: 30067856071453vm-test-run-nixbot-gitlab> gitlab # [  143.294783] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd7f45f9fcb4bc6d0d652234","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd7f45f9fcb4bc6d0d652234: done: 2.353534 sec","job_status":"done","queue_duration_s":1.095428,"scheduling_latency_s":1.095448,"redis_calls":13,"redis_duration_s":0.003397,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001434,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":2.353534,"completed_at":"2026-06-09T13:41:36.121Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454vm-test-run-nixbot-gitlab> gitlab # [  143.356828] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b19e75a3f4b3c46054bfc11","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b19e75a3f4b3c46054bfc11: start","job_status":"start","queue_duration_s":3.511163,"scheduling_latency_s":3.511196}1455vm-test-run-nixbot-gitlab> gitlab # [  143.392797] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b19e75a3f4b3c46054bfc11","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b19e75a3f4b3c46054bfc11: done: 0.0362 sec","job_status":"done","queue_duration_s":3.511163,"scheduling_latency_s":3.511196,"redis_calls":13,"redis_duration_s":0.0032459999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001192,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002054,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011796,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0362,"completed_at":"2026-06-09T13:41:36.219Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456vm-test-run-nixbot-gitlab> gitlab # [  143.455385] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42f7e73fb58c3c7cccb6a2eb","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42f7e73fb58c3c7cccb6a2eb: start","job_status":"start","queue_duration_s":3.609673,"scheduling_latency_s":3.609707}1457vm-test-run-nixbot-gitlab> gitlab # [  143.474847] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42f7e73fb58c3c7cccb6a2eb","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42f7e73fb58c3c7cccb6a2eb: done: 0.019837 sec","job_status":"done","queue_duration_s":3.609673,"scheduling_latency_s":3.609707,"redis_calls":13,"redis_duration_s":0.005183,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001608,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003575,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019837,"completed_at":"2026-06-09T13:41:36.301Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458vm-test-run-nixbot-gitlab> gitlab # [  143.477547] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.303Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27be798a68542160f97c5582","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27be798a68542160f97c5582: start","job_status":"start","queue_duration_s":3.63086,"scheduling_latency_s":3.630881}1459vm-test-run-nixbot-gitlab> gitlab # [  143.491485] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27be798a68542160f97c5582","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27be798a68542160f97c5582: done: 0.015217 sec","job_status":"done","queue_duration_s":3.63086,"scheduling_latency_s":3.630881,"redis_calls":13,"redis_duration_s":0.003288,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001187,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015217,"completed_at":"2026-06-09T13:41:36.318Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460vm-test-run-nixbot-gitlab> gitlab # [  143.604304] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.319Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81f40f540064011d75322dc5","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81f40f540064011d75322dc5: start","job_status":"start","queue_duration_s":3.647371,"scheduling_latency_s":3.647391}1461vm-test-run-nixbot-gitlab> gitlab # [  143.605789] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81f40f540064011d75322dc5","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81f40f540064011d75322dc5: done: 0.014528 sec","job_status":"done","queue_duration_s":3.647371,"scheduling_latency_s":3.647391,"redis_calls":13,"redis_duration_s":0.002877,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001927,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014528,"completed_at":"2026-06-09T13:41:36.333Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462vm-test-run-nixbot-gitlab> gitlab # [  143.675328] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"938fa16d805dfd2091b3329d","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-938fa16d805dfd2091b3329d: start","job_status":"start","queue_duration_s":3.663288,"scheduling_latency_s":3.663308}1463vm-test-run-nixbot-gitlab> gitlab # [  143.676680] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"938fa16d805dfd2091b3329d","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-938fa16d805dfd2091b3329d: done: 0.014562 sec","job_status":"done","queue_duration_s":3.663288,"scheduling_latency_s":3.663308,"redis_calls":13,"redis_duration_s":0.002891,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000908,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014562,"completed_at":"2026-06-09T13:41:36.349Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464vm-test-run-nixbot-gitlab> gitlab # [  143.709726] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.351Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39b21bae49a0cbeae8bbd03e","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39b21bae49a0cbeae8bbd03e: start","job_status":"start","queue_duration_s":3.679363,"scheduling_latency_s":3.679383}1465vm-test-run-nixbot-gitlab> gitlab # [  143.729381] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39b21bae49a0cbeae8bbd03e","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39b21bae49a0cbeae8bbd03e: done: 0.014871 sec","job_status":"done","queue_duration_s":3.679363,"scheduling_latency_s":3.679383,"redis_calls":13,"redis_duration_s":0.003247,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001131,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002116,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014871,"completed_at":"2026-06-09T13:41:36.366Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466vm-test-run-nixbot-gitlab> gitlab # [  143.797889] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9dd5c15d69278dd6eefd0c0f","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9dd5c15d69278dd6eefd0c0f: start","job_status":"start","queue_duration_s":3.695548,"scheduling_latency_s":3.695569}1467vm-test-run-nixbot-gitlab> gitlab # [  143.867266] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.382Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9dd5c15d69278dd6eefd0c0f","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9dd5c15d69278dd6eefd0c0f: done: 0.014612 sec","job_status":"done","queue_duration_s":3.695548,"scheduling_latency_s":3.695569,"redis_calls":13,"redis_duration_s":0.002716,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009871,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014612,"completed_at":"2026-06-09T13:41:36.382Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468vm-test-run-nixbot-gitlab> gitlab # [  143.869163] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d32177e361813e5cf597ab1a","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d32177e361813e5cf597ab1a: start","job_status":"start","queue_duration_s":3.711398,"scheduling_latency_s":3.711418}1469vm-test-run-nixbot-gitlab> gitlab # [  143.942858] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.398Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d32177e361813e5cf597ab1a","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d32177e361813e5cf597ab1a: done: 0.014668 sec","job_status":"done","queue_duration_s":3.711398,"scheduling_latency_s":3.711418,"redis_calls":13,"redis_duration_s":0.002728,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000836,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009794,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014668,"completed_at":"2026-06-09T13:41:36.398Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470vm-test-run-nixbot-gitlab> gitlab # [  143.949042] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.399Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62da2d7d50d5b4071c78201c","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62da2d7d50d5b4071c78201c: start","job_status":"start","queue_duration_s":3.727354,"scheduling_latency_s":3.727375}1471vm-test-run-nixbot-gitlab> gitlab # [  143.969327] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.413Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62da2d7d50d5b4071c78201c","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62da2d7d50d5b4071c78201c: done: 0.014443 sec","job_status":"done","queue_duration_s":3.727354,"scheduling_latency_s":3.727375,"redis_calls":13,"redis_duration_s":0.0026880000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001804,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009602,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014443,"completed_at":"2026-06-09T13:41:36.413Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472vm-test-run-nixbot-gitlab> gitlab # [  144.040283] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"deefc3955b0ffe10b4ce4a8b","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-deefc3955b0ffe10b4ce4a8b: start","job_status":"start","queue_duration_s":3.743279,"scheduling_latency_s":3.743299}1473vm-test-run-nixbot-gitlab> gitlab # [  144.111103] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.430Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"deefc3955b0ffe10b4ce4a8b","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-deefc3955b0ffe10b4ce4a8b: done: 0.014682 sec","job_status":"done","queue_duration_s":3.743279,"scheduling_latency_s":3.743299,"redis_calls":13,"redis_duration_s":0.002746,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001846,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014682,"completed_at":"2026-06-09T13:41:36.430Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474vm-test-run-nixbot-gitlab> gitlab # [  144.113123] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.431Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8cf18fa4602622a91b3fcf1f","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8cf18fa4602622a91b3fcf1f: start","job_status":"start","queue_duration_s":3.759351,"scheduling_latency_s":3.759371}1475vm-test-run-nixbot-gitlab> gitlab # [  144.184526] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.445Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8cf18fa4602622a91b3fcf1f","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8cf18fa4602622a91b3fcf1f: done: 0.014512 sec","job_status":"done","queue_duration_s":3.759351,"scheduling_latency_s":3.759371,"redis_calls":13,"redis_duration_s":0.002731,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001824,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014512,"completed_at":"2026-06-09T13:41:36.445Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476vm-test-run-nixbot-gitlab> gitlab # [  144.190134] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.447Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb71353af0c9fd4b28af1c5b","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb71353af0c9fd4b28af1c5b: start","job_status":"start","queue_duration_s":3.775112,"scheduling_latency_s":3.775133}1477vm-test-run-nixbot-gitlab> gitlab # [  144.209983] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb71353af0c9fd4b28af1c5b","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb71353af0c9fd4b28af1c5b: done: 0.014397 sec","job_status":"done","queue_duration_s":3.775112,"scheduling_latency_s":3.775133,"redis_calls":13,"redis_duration_s":0.002728,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000813,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014397,"completed_at":"2026-06-09T13:41:36.461Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478vm-test-run-nixbot-gitlab> gitlab # [  144.279221] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.462Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"820f8dfd73e76af9da81186b","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-820f8dfd73e76af9da81186b: start","job_status":"start","queue_duration_s":3.790662,"scheduling_latency_s":3.790682}1479vm-test-run-nixbot-gitlab> gitlab # [  144.348382] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"820f8dfd73e76af9da81186b","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-820f8dfd73e76af9da81186b: done: 0.015962 sec","job_status":"done","queue_duration_s":3.790662,"scheduling_latency_s":3.790682,"redis_calls":13,"redis_duration_s":0.004056000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001324,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002732,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009823,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015962,"completed_at":"2026-06-09T13:41:36.478Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480vm-test-run-nixbot-gitlab> gitlab # [  144.350255] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.480Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25c3e5bbe368c7c97d4c1f7b","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25c3e5bbe368c7c97d4c1f7b: start","job_status":"start","queue_duration_s":3.80837,"scheduling_latency_s":3.80839}1481vm-test-run-nixbot-gitlab> gitlab # [  144.370512] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.497Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25c3e5bbe368c7c97d4c1f7b","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25c3e5bbe368c7c97d4c1f7b: done: 0.016857 sec","job_status":"done","queue_duration_s":3.80837,"scheduling_latency_s":3.80839,"redis_calls":13,"redis_duration_s":0.0046429999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001677,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016857,"completed_at":"2026-06-09T13:41:36.497Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482vm-test-run-nixbot-gitlab> gitlab # [  144.439134] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.499Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6adcd6a3b6ddc44b2d25c8fc","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6adcd6a3b6ddc44b2d25c8fc: start","job_status":"start","queue_duration_s":3.826914,"scheduling_latency_s":3.826934}1483vm-test-run-nixbot-gitlab> gitlab # [  144.515325] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6adcd6a3b6ddc44b2d25c8fc","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6adcd6a3b6ddc44b2d25c8fc: done: 0.015318 sec","job_status":"done","queue_duration_s":3.826914,"scheduling_latency_s":3.826934,"redis_calls":13,"redis_duration_s":0.002964,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015318,"completed_at":"2026-06-09T13:41:36.514Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484vm-test-run-nixbot-gitlab> gitlab # [  144.517168] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be29b403d32ebd7bc806c270","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be29b403d32ebd7bc806c270: start","job_status":"start","queue_duration_s":3.843629,"scheduling_latency_s":3.843649}1485vm-test-run-nixbot-gitlab> gitlab # [  144.529753] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be29b403d32ebd7bc806c270","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be29b403d32ebd7bc806c270: done: 0.015629 sec","job_status":"done","queue_duration_s":3.843629,"scheduling_latency_s":3.843649,"redis_calls":13,"redis_duration_s":0.0032790000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00101,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002269,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015629,"completed_at":"2026-06-09T13:41:36.531Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486vm-test-run-nixbot-gitlab> gitlab # [  144.609123] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"939bd2fddb023f0735dc99f1","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-939bd2fddb023f0735dc99f1: start","job_status":"start","queue_duration_s":3.860798,"scheduling_latency_s":3.860819}1487vm-test-run-nixbot-gitlab> gitlab # [  144.676390] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.548Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"939bd2fddb023f0735dc99f1","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-939bd2fddb023f0735dc99f1: done: 0.015528 sec","job_status":"done","queue_duration_s":3.860798,"scheduling_latency_s":3.860819,"redis_calls":13,"redis_duration_s":0.003042,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015528,"completed_at":"2026-06-09T13:41:36.548Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488vm-test-run-nixbot-gitlab> gitlab # [  144.678079] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e49ffd46c4fdff2742c8c42","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e49ffd46c4fdff2742c8c42: start","job_status":"start","queue_duration_s":3.87756,"scheduling_latency_s":3.877581}1489vm-test-run-nixbot-gitlab> gitlab # [  144.690889] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e49ffd46c4fdff2742c8c42","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e49ffd46c4fdff2742c8c42: done: 0.015673 sec","job_status":"done","queue_duration_s":3.87756,"scheduling_latency_s":3.877581,"redis_calls":13,"redis_duration_s":0.002883,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010398,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015673,"completed_at":"2026-06-09T13:41:36.565Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490vm-test-run-nixbot-gitlab> gitlab # [  144.751844] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98e409cb58d61c393e76be9f","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98e409cb58d61c393e76be9f: start","job_status":"start","queue_duration_s":3.894435,"scheduling_latency_s":3.894456}1491vm-test-run-nixbot-gitlab> gitlab # [  144.771875] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98e409cb58d61c393e76be9f","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98e409cb58d61c393e76be9f: done: 0.015397 sec","job_status":"done","queue_duration_s":3.894435,"scheduling_latency_s":3.894456,"redis_calls":13,"redis_duration_s":0.002957,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00085,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015397,"completed_at":"2026-06-09T13:41:36.581Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492vm-test-run-nixbot-gitlab> gitlab # [  144.838975] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7821f069484c9eaa5f24019b","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7821f069484c9eaa5f24019b: start","job_status":"start","queue_duration_s":3.911041,"scheduling_latency_s":3.911102}1493vm-test-run-nixbot-gitlab> gitlab # [  144.850163] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:41:36.598Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7821f069484c9eaa5f24019b","created_at":"2026-06-09T13:41:32.604Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-bbb3b84593c5474c","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cdaedfe65cc91c93c590d1068371f8ed","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:41:32.672Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7821f069484c9eaa5f24019b: done: 0.015687 sec","job_status":"done","queue_duration_s":3.911041,"scheduling_latency_s":3.911102,"redis_calls":13,"redis_duration_s":0.0030399999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002185,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010238,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015687,"completed_at":"2026-06-09T13:41:36.598Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494vm-test-run-nixbot-gitlab> gitlab # [  158.230534] setup-gitlab-start[2637]: W, [2026-06-09T13:41:51.057233 #2637]  WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1495vm-test-run-nixbot-gitlab> gitlab # [  169.651881] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:02.477Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"8a8be5e8fcda6dec33b7e97c","created_at":"2026-06-09T13:42:02.416Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ba1b48e3ad7d88aae5d5620ec5d813c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.474Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-8a8be5e8fcda6dec33b7e97c: start","job_status":"start","queue_duration_s":0.002545,"scheduling_latency_s":0.002601}1496vm-test-run-nixbot-gitlab> gitlab # [  169.704049] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:02.530Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1497vm-test-run-nixbot-gitlab> gitlab # [  169.726095] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:02.552Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"8a8be5e8fcda6dec33b7e97c","created_at":"2026-06-09T13:42:02.416Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ba1b48e3ad7d88aae5d5620ec5d813c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.474Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-8a8be5e8fcda6dec33b7e97c: done: 0.075544 sec","job_status":"done","queue_duration_s":0.002545,"scheduling_latency_s":0.002601,"redis_calls":7,"redis_duration_s":0.008357999999999999,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006866,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001492,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.075544,"completed_at":"2026-06-09T13:42:02.552Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498vm-test-run-nixbot-gitlab> gitlab # [  169.763241] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:02.561Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"142341cbb0b6d00e635ab1be","created_at":"2026-06-09T13:42:02.507Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"811dff903ac1f6106f4b825c5fa9d3a4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-06-09T13:42:02.511Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-142341cbb0b6d00e635ab1be: start","job_status":"start","queue_duration_s":0.050271,"scheduling_latency_s":0.050321}1499vm-test-run-nixbot-gitlab> gitlab # [  169.767112] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:02.593Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1500vm-test-run-nixbot-gitlab> gitlab # [  169.845382] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:02.671Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"142341cbb0b6d00e635ab1be","created_at":"2026-06-09T13:42:02.507Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"811dff903ac1f6106f4b825c5fa9d3a4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-06-09T13:42:02.511Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-142341cbb0b6d00e635ab1be: done: 0.11053 sec","job_status":"done","queue_duration_s":0.050271,"scheduling_latency_s":0.050321,"redis_calls":7,"redis_duration_s":0.062712,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.054916,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.007796,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016178,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.11053,"completed_at":"2026-06-09T13:42:02.671Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501vm-test-run-nixbot-gitlab> gitlab # [  169.882590] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:02.684Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"106823804de30d98504ae36f","created_at":"2026-06-09T13:42:02.527Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b711e417b9e5d3ee8369071ec10774d5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.537Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-106823804de30d98504ae36f: start","job_status":"start","queue_duration_s":0.146717,"scheduling_latency_s":0.146769}1502vm-test-run-nixbot-gitlab> gitlab # [  170.053111] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:02.879Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"106823804de30d98504ae36f","created_at":"2026-06-09T13:42:02.527Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b711e417b9e5d3ee8369071ec10774d5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.537Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-106823804de30d98504ae36f: done: 0.194972 sec","job_status":"done","queue_duration_s":0.146717,"scheduling_latency_s":0.146769,"redis_calls":14,"redis_duration_s":0.073419,"redis_read_bytes":16,"redis_write_bytes":4022,"redis_queues_calls":2,"redis_queues_duration_s":0.012229,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3011,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.057158,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.004032,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.194972,"completed_at":"2026-06-09T13:42:02.878Z","load_balancing_strategy":"primary","db_duration_s":0.040777,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503vm-test-run-nixbot-gitlab> gitlab # [  170.139863] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:02.966Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"a39f2acf027ff80ddcb52d08","created_at":"2026-06-09T13:42:02.550Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4111b3149440731e2a3f2aea7bac56d0","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.558Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-a39f2acf027ff80ddcb52d08: start","job_status":"start","queue_duration_s":0.408462,"scheduling_latency_s":0.408502}1504vm-test-run-nixbot-gitlab> gitlab # [  170.237969] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.063Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"a39f2acf027ff80ddcb52d08","created_at":"2026-06-09T13:42:02.550Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4111b3149440731e2a3f2aea7bac56d0","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.558Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-a39f2acf027ff80ddcb52d08: done: 0.097054 sec","job_status":"done","queue_duration_s":0.408462,"scheduling_latency_s":0.408502,"redis_calls":9,"redis_duration_s":0.021632,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.016819,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004813,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001816152,"exclusive_lock_hold_duration_s":0.007762719,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.097054,"completed_at":"2026-06-09T13:42:03.063Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005436,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505vm-test-run-nixbot-gitlab> gitlab # [  170.245401] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.072Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6080ab84e8af7bfd9afda0ab","created_at":"2026-06-09T13:42:02.582Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a0471e81354507ddfe95bef66c7415a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.589Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6080ab84e8af7bfd9afda0ab: start","job_status":"start","queue_duration_s":0.482479,"scheduling_latency_s":0.48252}1506vm-test-run-nixbot-gitlab> gitlab # [  170.284962] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.111Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6080ab84e8af7bfd9afda0ab","created_at":"2026-06-09T13:42:02.582Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a0471e81354507ddfe95bef66c7415a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.589Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6080ab84e8af7bfd9afda0ab: done: 0.039818 sec","job_status":"done","queue_duration_s":0.482479,"scheduling_latency_s":0.48252,"redis_calls":8,"redis_duration_s":0.009156,"redis_read_bytes":133,"redis_write_bytes":901,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000517,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005625,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003014,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039818,"completed_at":"2026-06-09T13:42:03.111Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507vm-test-run-nixbot-gitlab> gitlab # [  170.359828] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.126Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"0203ac7ddd4921f38dc2905d","created_at":"2026-06-09T13:42:02.665Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"886cbba0928c46b4eb6cfc80d6d4f825","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.668Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-0203ac7ddd4921f38dc2905d: start","job_status":"start","queue_duration_s":0.457815,"scheduling_latency_s":0.457837}1508vm-test-run-nixbot-gitlab> gitlab # [  170.361425] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.149Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"0203ac7ddd4921f38dc2905d","created_at":"2026-06-09T13:42:02.665Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"886cbba0928c46b4eb6cfc80d6d4f825","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.668Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-0203ac7ddd4921f38dc2905d: done: 0.023031 sec","job_status":"done","queue_duration_s":0.457815,"scheduling_latency_s":0.457837,"redis_calls":9,"redis_duration_s":0.006266,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003287,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002979,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009628,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000866031,"exclusive_lock_hold_duration_s":0.003824788,"duration_s":0.023031,"completed_at":"2026-06-09T13:42:03.149Z","load_balancing_strategy":"primary","db_duration_s":0.002394,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509vm-test-run-nixbot-gitlab> gitlab # [  170.448236] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.185Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"d23978a36db7e44b18e0a886","created_at":"2026-06-09T13:42:02.687Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c19224930c7ec123fadc052e3c6cd48d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-06-09T13:42:02.690Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-d23978a36db7e44b18e0a886: start","job_status":"start","queue_duration_s":0.494728,"scheduling_latency_s":0.49477}1510vm-test-run-nixbot-gitlab> gitlab # [  170.449802] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.241Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"d23978a36db7e44b18e0a886","created_at":"2026-06-09T13:42:02.687Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c19224930c7ec123fadc052e3c6cd48d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-06-09T13:42:02.690Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-d23978a36db7e44b18e0a886: done: 0.055867 sec","job_status":"done","queue_duration_s":0.494728,"scheduling_latency_s":0.49477,"redis_calls":7,"redis_duration_s":0.005679,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005073,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000606,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.055867,"completed_at":"2026-06-09T13:42:03.241Z","load_balancing_strategy":"primary","db_duration_s":0.004147,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511vm-test-run-nixbot-gitlab> gitlab # [  170.537035] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.244Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"2d26cacf098c5737ae965609","created_at":"2026-06-09T13:42:02.710Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a79da2269c3aeb2097fcf26768cd19df","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.763Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-2d26cacf098c5737ae965609: start","job_status":"start","queue_duration_s":0.481119,"scheduling_latency_s":0.481141}1512vm-test-run-nixbot-gitlab> gitlab # [  170.590743] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.417Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"2d26cacf098c5737ae965609","created_at":"2026-06-09T13:42:02.710Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a79da2269c3aeb2097fcf26768cd19df","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.763Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-2d26cacf098c5737ae965609: done: 0.173265 sec","job_status":"done","queue_duration_s":0.481119,"scheduling_latency_s":0.481141,"redis_calls":11,"redis_duration_s":0.005834,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001245,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002987,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001602,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":124,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":124,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":124,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":80,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.119049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000630248,"exclusive_lock_hold_duration_s":0.145753161,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.173265,"completed_at":"2026-06-09T13:42:03.417Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.046863,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513vm-test-run-nixbot-gitlab> gitlab # [  170.661891] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.488Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"80a337228201a11459cd616f","created_at":"2026-06-09T13:42:02.767Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0d2cbc684a6304906d469fbfb9046c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.772Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-80a337228201a11459cd616f: start","job_status":"start","queue_duration_s":0.715609,"scheduling_latency_s":0.715644}1514vm-test-run-nixbot-gitlab> gitlab # [  170.681173] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.507Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"80a337228201a11459cd616f","created_at":"2026-06-09T13:42:02.767Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0d2cbc684a6304906d469fbfb9046c2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.772Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-80a337228201a11459cd616f: done: 0.019614 sec","job_status":"done","queue_duration_s":0.715609,"scheduling_latency_s":0.715644,"redis_calls":12,"redis_duration_s":0.002934,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000449,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001528,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000957,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000427708,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.019614,"completed_at":"2026-06-09T13:42:03.507Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000575,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515vm-test-run-nixbot-gitlab> gitlab # [  170.684652] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.509Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"ca3c9f083d7bb1272d7f1c98","created_at":"2026-06-09T13:42:02.795Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e722d42326bf03ff22800d6f6373910","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.801Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-ca3c9f083d7bb1272d7f1c98: start","job_status":"start","queue_duration_s":0.707945,"scheduling_latency_s":0.707965}1516vm-test-run-nixbot-gitlab> gitlab # [  170.708048] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.516Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1517vm-test-run-nixbot-gitlab> gitlab # [  170.712953] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.520Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"ca3c9f083d7bb1272d7f1c98","created_at":"2026-06-09T13:42:02.795Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e722d42326bf03ff22800d6f6373910","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.801Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-ca3c9f083d7bb1272d7f1c98: done: 0.011727 sec","job_status":"done","queue_duration_s":0.707945,"scheduling_latency_s":0.707965,"redis_calls":7,"redis_duration_s":0.001559,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001141,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011727,"completed_at":"2026-06-09T13:42:03.520Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518vm-test-run-nixbot-gitlab> gitlab # [  170.783241] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.522Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"eefe1d18e263b151431343a7","created_at":"2026-06-09T13:42:02.795Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-2b583cf15b624de4","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b711e417b9e5d3ee8369071ec10774d5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.848Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-eefe1d18e263b151431343a7: start","job_status":"start","queue_duration_s":0.673781,"scheduling_latency_s":0.673801}1519vm-test-run-nixbot-gitlab> gitlab # [  170.794845] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.532Z","message":"No existing merge request to be cleaned up."}1520vm-test-run-nixbot-gitlab> gitlab # [  170.800284] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.538Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"eefe1d18e263b151431343a7","created_at":"2026-06-09T13:42:02.795Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-2b583cf15b624de4","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b711e417b9e5d3ee8369071ec10774d5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.848Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-eefe1d18e263b151431343a7: done: 0.01647 sec","job_status":"done","queue_duration_s":0.673781,"scheduling_latency_s":0.673801,"redis_calls":10,"redis_duration_s":0.00249,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000897,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001593,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010366,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01647,"completed_at":"2026-06-09T13:42:03.538Z","load_balancing_strategy":"primary","db_duration_s":0.00207,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521vm-test-run-nixbot-gitlab> gitlab # [  170.870266] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.540Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f74442414bf4a442c0fbe5ef","created_at":"2026-06-09T13:42:02.795Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-2b583cf15b624de4","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b711e417b9e5d3ee8369071ec10774d5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.848Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f74442414bf4a442c0fbe5ef: start","job_status":"start","queue_duration_s":0.691537,"scheduling_latency_s":0.691557}1522vm-test-run-nixbot-gitlab> gitlab # [  170.875777] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.549Z","message":"No existing merge request to be cleaned up."}1523vm-test-run-nixbot-gitlab> gitlab # [  170.878597] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.555Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f74442414bf4a442c0fbe5ef","created_at":"2026-06-09T13:42:02.795Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-2b583cf15b624de4","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b711e417b9e5d3ee8369071ec10774d5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.848Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f74442414bf4a442c0fbe5ef: done: 0.015019 sec","job_status":"done","queue_duration_s":0.691537,"scheduling_latency_s":0.691557,"redis_calls":10,"redis_duration_s":0.002164,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000825,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001339,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009812,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015019,"completed_at":"2026-06-09T13:42:03.555Z","load_balancing_strategy":"primary","db_duration_s":0.001455,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524vm-test-run-nixbot-gitlab> gitlab # [  170.969041] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.556Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7b27128f2fe3e7121267aae2","created_at":"2026-06-09T13:42:02.795Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-2b583cf15b624de4","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b711e417b9e5d3ee8369071ec10774d5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.848Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7b27128f2fe3e7121267aae2: start","job_status":"start","queue_duration_s":0.707862,"scheduling_latency_s":0.707882}1525vm-test-run-nixbot-gitlab> gitlab # [  170.970285] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.565Z","message":"No existing merge request to be cleaned up."}1526vm-test-run-nixbot-gitlab> gitlab # [  170.971242] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.571Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7b27128f2fe3e7121267aae2","created_at":"2026-06-09T13:42:02.795Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-2b583cf15b624de4","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b711e417b9e5d3ee8369071ec10774d5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.848Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7b27128f2fe3e7121267aae2: done: 0.014908 sec","job_status":"done","queue_duration_s":0.707862,"scheduling_latency_s":0.707882,"redis_calls":10,"redis_duration_s":0.002072,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001271,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014908,"completed_at":"2026-06-09T13:42:03.571Z","load_balancing_strategy":"primary","db_duration_s":0.001397,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527vm-test-run-nixbot-gitlab> gitlab # [  171.051967] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.572Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"edf1b7f4cbb42d0739876d8c","created_at":"2026-06-09T13:42:02.795Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-2b583cf15b624de4","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b711e417b9e5d3ee8369071ec10774d5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.848Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-edf1b7f4cbb42d0739876d8c: start","job_status":"start","queue_duration_s":0.723951,"scheduling_latency_s":0.723971}1528vm-test-run-nixbot-gitlab> gitlab # [  171.052957] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.581Z","message":"No existing merge request to be cleaned up."}1529vm-test-run-nixbot-gitlab> gitlab # [  171.054142] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.587Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"edf1b7f4cbb42d0739876d8c","created_at":"2026-06-09T13:42:02.795Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-2b583cf15b624de4","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b711e417b9e5d3ee8369071ec10774d5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.848Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-edf1b7f4cbb42d0739876d8c: done: 0.014539 sec","job_status":"done","queue_duration_s":0.723951,"scheduling_latency_s":0.723971,"redis_calls":10,"redis_duration_s":0.002006,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001223,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014539,"completed_at":"2026-06-09T13:42:03.586Z","load_balancing_strategy":"primary","db_duration_s":0.001358,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530vm-test-run-nixbot-gitlab> gitlab # [  171.140152] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.588Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ExpireBuildArtifactsWorker","jid":"4d93a23cb25bfc0b9a62f57a","created_at":"2026-06-09T13:42:02.863Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ffe8e985c568c4c4aa76b1730e9f63d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:7be9ea93da0bda6381b334cf2932692b41842a57ea0aeac11899369225b9bb7e","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.876Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"ExpireBuildArtifactsWorker JID-4d93a23cb25bfc0b9a62f57a: start","job_status":"start","queue_duration_s":0.712338,"scheduling_latency_s":0.712358}1531vm-test-run-nixbot-gitlab> gitlab # [  171.141466] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.603Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ExpireBuildArtifactsWorker","jid":"4d93a23cb25bfc0b9a62f57a","created_at":"2026-06-09T13:42:02.863Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ffe8e985c568c4c4aa76b1730e9f63d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:7be9ea93da0bda6381b334cf2932692b41842a57ea0aeac11899369225b9bb7e","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.876Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"ExpireBuildArtifactsWorker JID-4d93a23cb25bfc0b9a62f57a: done: 0.015301 sec","job_status":"done","queue_duration_s":0.712338,"scheduling_latency_s":0.712358,"redis_calls":10,"redis_duration_s":0.001977,"redis_read_bytes":9,"redis_write_bytes":1035,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000409,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001176,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000392,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009288,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000332724,"duration_s":0.015301,"completed_at":"2026-06-09T13:42:03.603Z","load_balancing_strategy":"primary","db_duration_s":0.000365,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532vm-test-run-nixbot-gitlab> gitlab # [  171.210167] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.605Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"ff90c2e0f2d83429517a8af7","created_at":"2026-06-09T13:42:02.990Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7bda439950de3a0ef2a91e3db23eceb5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.996Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-ff90c2e0f2d83429517a8af7: start","job_status":"start","queue_duration_s":0.608572,"scheduling_latency_s":0.608592}1533vm-test-run-nixbot-gitlab> gitlab # [  171.211757] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.635Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"ff90c2e0f2d83429517a8af7","created_at":"2026-06-09T13:42:02.990Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7bda439950de3a0ef2a91e3db23eceb5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:02.996Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-ff90c2e0f2d83429517a8af7: done: 0.030565 sec","job_status":"done","queue_duration_s":0.608572,"scheduling_latency_s":0.608592,"redis_calls":9,"redis_duration_s":0.002231,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001236,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000995,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00051906,"exclusive_lock_hold_duration_s":0.009388064,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.030565,"completed_at":"2026-06-09T13:42:03.635Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013015,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534vm-test-run-nixbot-gitlab> gitlab # [  171.290954] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.636Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"89235c621951803bcac6cf8d","created_at":"2026-06-09T13:42:03.026Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f588a91ffb0f70805fe4cd07e9e539a5","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.043Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-89235c621951803bcac6cf8d: start","job_status":"start","queue_duration_s":0.593091,"scheduling_latency_s":0.593111}1535vm-test-run-nixbot-gitlab> gitlab # [  171.292163] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.652Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"89235c621951803bcac6cf8d","created_at":"2026-06-09T13:42:03.026Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f588a91ffb0f70805fe4cd07e9e539a5","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.043Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-89235c621951803bcac6cf8d: done: 0.016201 sec","job_status":"done","queue_duration_s":0.593091,"scheduling_latency_s":0.593111,"redis_calls":12,"redis_duration_s":0.002471,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000447,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000387,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001209,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000428,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000325461,"duration_s":0.016201,"completed_at":"2026-06-09T13:42:03.652Z","load_balancing_strategy":"primary","db_duration_s":0.000339,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536vm-test-run-nixbot-gitlab> gitlab # [  171.371245] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:03.654Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"889b4af6a368ecf64ddcce72","created_at":"2026-06-09T13:42:03.054Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9fe4302915ee0a951e10a609c7e38e14","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.068Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-889b4af6a368ecf64ddcce72: start","job_status":"start","queue_duration_s":0.585594,"scheduling_latency_s":0.585614}1537vm-test-run-nixbot-gitlab> gitlab # [  171.487749] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:04.314Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"889b4af6a368ecf64ddcce72","created_at":"2026-06-09T13:42:03.054Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9fe4302915ee0a951e10a609c7e38e14","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.068Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-889b4af6a368ecf64ddcce72: done: 0.660115 sec","job_status":"done","queue_duration_s":0.585594,"scheduling_latency_s":0.585614,"redis_calls":9,"redis_duration_s":0.002329,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001357,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000422959,"exclusive_lock_hold_duration_s":0.646460374,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.660115,"completed_at":"2026-06-09T13:42:04.314Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.641051,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538vm-test-run-nixbot-gitlab> gitlab # [  171.556704] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:04.383Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"648c2ed9c00610230d100bb1","created_at":"2026-06-09T13:42:03.077Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"40e57d64bad6e19a84b6c30b826828ab","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.092Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-648c2ed9c00610230d100bb1: start","job_status":"start","queue_duration_s":1.291052,"scheduling_latency_s":1.291085}1539vm-test-run-nixbot-gitlab> gitlab # [  171.725202] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:04.550Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"648c2ed9c00610230d100bb1","created_at":"2026-06-09T13:42:03.077Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"40e57d64bad6e19a84b6c30b826828ab","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.092Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-648c2ed9c00610230d100bb1: done: 0.167846 sec","job_status":"done","queue_duration_s":1.291052,"scheduling_latency_s":1.291085,"redis_calls":12,"redis_duration_s":0.004649,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000582,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002146,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001921,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.095261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000553981,"exclusive_lock_hold_duration_s":0.121721895,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.167846,"completed_at":"2026-06-09T13:42:04.550Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027623,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1540vm-test-run-nixbot-gitlab> gitlab # [  171.825184] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:04.651Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"6fa1eaca67c49ca8530bdab4","created_at":"2026-06-09T13:42:03.101Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0e800003824eab2253b44a6f0283596","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.107Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-6fa1eaca67c49ca8530bdab4: start","job_status":"start","queue_duration_s":1.544297,"scheduling_latency_s":1.544361}1541vm-test-run-nixbot-gitlab> gitlab # [  171.874574] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:04.700Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"6fa1eaca67c49ca8530bdab4","created_at":"2026-06-09T13:42:03.101Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0e800003824eab2253b44a6f0283596","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.107Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-6fa1eaca67c49ca8530bdab4: done: 0.049499 sec","job_status":"done","queue_duration_s":1.544297,"scheduling_latency_s":1.544361,"redis_calls":10,"redis_duration_s":0.005717,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001302,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003217,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001198,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028775,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000793676,"duration_s":0.049499,"completed_at":"2026-06-09T13:42:04.700Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003926,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542vm-test-run-nixbot-gitlab> gitlab # [  171.943842] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:04.770Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"fa046a01f0efb21fbfd93229","created_at":"2026-06-09T13:42:03.112Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5ab344fd6e555ca7265b0b5f05f66b7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.117Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-fa046a01f0efb21fbfd93229: start","job_status":"start","queue_duration_s":1.653392,"scheduling_latency_s":1.653428}1543vm-test-run-nixbot-gitlab> gitlab # [  171.985884] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:04.812Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1544vm-test-run-nixbot-gitlab> gitlab # [  171.997786] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:04.824Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"fa046a01f0efb21fbfd93229","created_at":"2026-06-09T13:42:03.112Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5ab344fd6e555ca7265b0b5f05f66b7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.117Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-fa046a01f0efb21fbfd93229: done: 0.053592 sec","job_status":"done","queue_duration_s":1.653392,"scheduling_latency_s":1.653428,"redis_calls":7,"redis_duration_s":0.003683,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002611,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001072,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.053592,"completed_at":"2026-06-09T13:42:04.823Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545vm-test-run-nixbot-gitlab> gitlab # [  172.063824] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:04.890Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4f679a0c28d9c7936b11ce2b","created_at":"2026-06-09T13:42:03.124Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.126Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4f679a0c28d9c7936b11ce2b: start","job_status":"start","queue_duration_s":1.763888,"scheduling_latency_s":1.763949}1546vm-test-run-nixbot-gitlab> gitlab # [  172.238355] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:05.064Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4f679a0c28d9c7936b11ce2b","created_at":"2026-06-09T13:42:03.124Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.126Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4f679a0c28d9c7936b11ce2b: done: 0.174589 sec","job_status":"done","queue_duration_s":1.763888,"scheduling_latency_s":1.763949,"redis_calls":60,"redis_duration_s":0.03029,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.00132,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.027566,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001404,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.122205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.174589,"completed_at":"2026-06-09T13:42:05.064Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547vm-test-run-nixbot-gitlab> gitlab # [  172.338135] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:05.164Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"97c43d162c5d03eec17e8c27","created_at":"2026-06-09T13:42:03.137Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"229ede0411e48a62c71b35652ffc20d8","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.145Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-97c43d162c5d03eec17e8c27: start","job_status":"start","queue_duration_s":2.018632,"scheduling_latency_s":2.018695}1548vm-test-run-nixbot-gitlab> gitlab # [  172.413552] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:05.239Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"97c43d162c5d03eec17e8c27","created_at":"2026-06-09T13:42:03.137Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"229ede0411e48a62c71b35652ffc20d8","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.145Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-97c43d162c5d03eec17e8c27: done: 0.07547 sec","job_status":"done","queue_duration_s":2.018632,"scheduling_latency_s":2.018695,"redis_calls":12,"redis_duration_s":0.004732,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000727,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002309,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001696,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000931403,"exclusive_lock_hold_duration_s":0.00692127,"duration_s":0.07547,"completed_at":"2026-06-09T13:42:05.239Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003638,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549vm-test-run-nixbot-gitlab> gitlab # [  172.490531] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:05.316Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"12086ca6d322dc9f4723ed55","created_at":"2026-06-09T13:42:03.181Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"609a25d8b85f1fb8bc4aae62e3e23906","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.183Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-12086ca6d322dc9f4723ed55: start","job_status":"start","queue_duration_s":2.133022,"scheduling_latency_s":2.133083}1550vm-test-run-nixbot-gitlab> gitlab # [  172.521651] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:05.347Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"12086ca6d322dc9f4723ed55","created_at":"2026-06-09T13:42:03.181Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"609a25d8b85f1fb8bc4aae62e3e23906","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.183Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-12086ca6d322dc9f4723ed55: done: 0.031321 sec","job_status":"done","queue_duration_s":2.133022,"scheduling_latency_s":2.133083,"redis_calls":7,"redis_duration_s":0.004041,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002981,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00106,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031321,"completed_at":"2026-06-09T13:42:05.347Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551vm-test-run-nixbot-gitlab> gitlab # [  172.588769] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:05.415Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"9086b0caabbd338b6f2d6b7e","created_at":"2026-06-09T13:42:03.190Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83db021f7cd7b1b78f1001a3dc5a3279","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.193Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-9086b0caabbd338b6f2d6b7e: start","job_status":"start","queue_duration_s":2.221455,"scheduling_latency_s":2.221514}1552vm-test-run-nixbot-gitlab> gitlab # [  172.649688] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:05.475Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"9086b0caabbd338b6f2d6b7e","created_at":"2026-06-09T13:42:03.190Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83db021f7cd7b1b78f1001a3dc5a3279","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.193Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-9086b0caabbd338b6f2d6b7e: done: 0.061078 sec","job_status":"done","queue_duration_s":2.221455,"scheduling_latency_s":2.221514,"redis_calls":7,"redis_duration_s":0.004283,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003221,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001062,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.061078,"completed_at":"2026-06-09T13:42:05.475Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004913,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553vm-test-run-nixbot-gitlab> gitlab # [  172.716427] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:05.542Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"f84503732365a1a5a2ef4589","created_at":"2026-06-09T13:42:03.199Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a1e3b568e4962aff1a9b25211783d89","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-06-09T13:42:03.202Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-f84503732365a1a5a2ef4589: start","job_status":"start","queue_duration_s":2.339806,"scheduling_latency_s":2.339887}1554vm-test-run-nixbot-gitlab> gitlab # [  172.735330] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:05.561Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1555vm-test-run-nixbot-gitlab> gitlab # [  172.746179] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:05.572Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"f84503732365a1a5a2ef4589","created_at":"2026-06-09T13:42:03.199Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a1e3b568e4962aff1a9b25211783d89","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-06-09T13:42:03.202Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-f84503732365a1a5a2ef4589: done: 0.029501 sec","job_status":"done","queue_duration_s":2.339806,"scheduling_latency_s":2.339887,"redis_calls":7,"redis_duration_s":0.003485,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00244,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001045,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029501,"completed_at":"2026-06-09T13:42:05.572Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1556vm-test-run-nixbot-gitlab> gitlab # [  172.810605] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:05.637Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"fb474f3053647120954038e5","created_at":"2026-06-09T13:42:03.206Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43f69285839b68bb8fb546fad422f111","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.209Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-fb474f3053647120954038e5: start","job_status":"start","queue_duration_s":2.427621,"scheduling_latency_s":2.427681}1557vm-test-run-nixbot-gitlab> gitlab # [  172.852117] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:05.678Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"fb474f3053647120954038e5","created_at":"2026-06-09T13:42:03.206Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43f69285839b68bb8fb546fad422f111","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.209Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-fb474f3053647120954038e5: done: 0.041391 sec","job_status":"done","queue_duration_s":2.427621,"scheduling_latency_s":2.427681,"redis_calls":10,"redis_duration_s":0.005923,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003288,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002635,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.007224661,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.041391,"completed_at":"2026-06-09T13:42:05.678Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004088,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1558vm-test-run-nixbot-gitlab> gitlab # [  172.922788] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:05.749Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"d8ffc48774051dff8bcf430b","created_at":"2026-06-09T13:42:03.212Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e0cec9730e52dbc7055c5f617e6b05de","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.224Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-d8ffc48774051dff8bcf430b: start","job_status":"start","queue_duration_s":2.524252,"scheduling_latency_s":2.52432}1559vm-test-run-nixbot-gitlab> gitlab # [  173.431856] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:06.258Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"d8ffc48774051dff8bcf430b","created_at":"2026-06-09T13:42:03.212Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e0cec9730e52dbc7055c5f617e6b05de","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.224Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-d8ffc48774051dff8bcf430b: done: 0.509435 sec","job_status":"done","queue_duration_s":2.524252,"scheduling_latency_s":2.52432,"redis_calls":571,"redis_duration_s":0.194912,"redis_read_bytes":569,"redis_write_bytes":49487,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002472,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.19244,"redis_shared_state_read_bytes":565,"redis_shared_state_write_bytes":49017,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.357833,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.509435,"completed_at":"2026-06-09T13:42:06.258Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1560vm-test-run-nixbot-gitlab> gitlab # [  173.531778] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:06.260Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"d145cdcef2f1724f4a04c8aa","created_at":"2026-06-09T13:42:03.232Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61d4c40c5734ab796d8e7eb898c0d3f4","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.235Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-d145cdcef2f1724f4a04c8aa: start","job_status":"start","queue_duration_s":3.024669,"scheduling_latency_s":3.024696}1561vm-test-run-nixbot-gitlab> gitlab # [  173.553840] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:06.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"d145cdcef2f1724f4a04c8aa","created_at":"2026-06-09T13:42:03.232Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61d4c40c5734ab796d8e7eb898c0d3f4","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.235Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-d145cdcef2f1724f4a04c8aa: done: 0.018971 sec","job_status":"done","queue_duration_s":3.024669,"scheduling_latency_s":3.024696,"redis_calls":7,"redis_duration_s":0.0026439999999999996,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001878,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000766,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018971,"completed_at":"2026-06-09T13:42:06.279Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001016,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1562vm-test-run-nixbot-gitlab> gitlab # [  173.616914] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:06.281Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"a60bbe773439abba231bdbd3","created_at":"2026-06-09T13:42:03.239Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fa3040bded7d5d1af161fe810204ec0a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.242Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-a60bbe773439abba231bdbd3: start","job_status":"start","queue_duration_s":3.039083,"scheduling_latency_s":3.039123}1563vm-test-run-nixbot-gitlab> gitlab # [  173.618132] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:06.342Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"a60bbe773439abba231bdbd3","created_at":"2026-06-09T13:42:03.239Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fa3040bded7d5d1af161fe810204ec0a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.242Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-a60bbe773439abba231bdbd3: done: 0.061147 sec","job_status":"done","queue_duration_s":3.039083,"scheduling_latency_s":3.039123,"redis_calls":7,"redis_duration_s":0.002389,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00176,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000629,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.061147,"completed_at":"2026-06-09T13:42:06.342Z","load_balancing_strategy":"primary","db_duration_s":0.040108,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1564vm-test-run-nixbot-gitlab> gitlab # [  173.687150] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:06.344Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"22d0bca79aa15704519dfed7","created_at":"2026-06-09T13:42:03.251Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ac6203b47683d89f6ac01300b8fdd7c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.255Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-22d0bca79aa15704519dfed7: start","job_status":"start","queue_duration_s":3.089211,"scheduling_latency_s":3.089234}1565vm-test-run-nixbot-gitlab> gitlab # [  173.689061] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:06.353Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1566vm-test-run-nixbot-gitlab> gitlab # [  173.690125] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:06.358Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"22d0bca79aa15704519dfed7","created_at":"2026-06-09T13:42:03.251Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-18c1234ebc8849f2","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ac6203b47683d89f6ac01300b8fdd7c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:03.255Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-22d0bca79aa15704519dfed7: done: 0.01361 sec","job_status":"done","queue_duration_s":3.089211,"scheduling_latency_s":3.089234,"redis_calls":7,"redis_duration_s":0.003255,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002435,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00082,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01361,"completed_at":"2026-06-09T13:42:06.358Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567vm-test-run-nixbot-gitlab> gitlab # [  173.763592] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:06.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73e0f4b0ed7b516202f82c9a","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73e0f4b0ed7b516202f82c9a: start","job_status":"start","queue_duration_s":1.303361,"scheduling_latency_s":1.303407}1568vm-test-run-nixbot-gitlab> gitlab # [  173.764791] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:06.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73e0f4b0ed7b516202f82c9a","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73e0f4b0ed7b516202f82c9a: done: 0.029847 sec","job_status":"done","queue_duration_s":1.303361,"scheduling_latency_s":1.303407,"redis_calls":13,"redis_duration_s":0.003711,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001139,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002572,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029847,"completed_at":"2026-06-09T13:42:06.389Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569vm-test-run-nixbot-gitlab> gitlab # [  173.802957] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:06.391Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de93edb2006d9f7444c2b1f0","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de93edb2006d9f7444c2b1f0: start","job_status":"start","queue_duration_s":1.335215,"scheduling_latency_s":1.335252}1570vm-test-run-nixbot-gitlab> gitlab # [  173.822139] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:06.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de93edb2006d9f7444c2b1f0","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de93edb2006d9f7444c2b1f0: done: 0.015421 sec","job_status":"done","queue_duration_s":1.335215,"scheduling_latency_s":1.335252,"redis_calls":13,"redis_duration_s":0.002541,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000799,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001742,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015421,"completed_at":"2026-06-09T13:42:06.407Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571vm-test-run-nixbot-gitlab> gitlab # [  173.895147] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:06.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d9d1a5e6366980e3f1fc988","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d9d1a5e6366980e3f1fc988: start","job_status":"start","queue_duration_s":1.351761,"scheduling_latency_s":1.351781}1572vm-test-run-nixbot-gitlab> gitlab # [  173.962459] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:06.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d9d1a5e6366980e3f1fc988","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d9d1a5e6366980e3f1fc988: done: 0.014168 sec","job_status":"done","queue_duration_s":1.351761,"scheduling_latency_s":1.351781,"redis_calls":13,"redis_duration_s":0.002478,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000795,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001683,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014168,"completed_at":"2026-06-09T13:42:06.422Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573vm-test-run-nixbot-gitlab> gitlab # [  173.964141] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:06.423Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be7962f0aa08e967634534aa","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be7962f0aa08e967634534aa: start","job_status":"start","queue_duration_s":1.367104,"scheduling_latency_s":1.367124}1574vm-test-run-nixbot-gitlab> gitlab # [  173.979235] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:06.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be7962f0aa08e967634534aa","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be7962f0aa08e967634534aa: done: 0.01418 sec","job_status":"done","queue_duration_s":1.367104,"scheduling_latency_s":1.367124,"redis_calls":13,"redis_duration_s":0.0026249999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01418,"completed_at":"2026-06-09T13:42:06.437Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575vm-test-run-nixbot-gitlab> gitlab # [  174.050210] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:06.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3157c3f7a8680b305d7878ce","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3157c3f7a8680b305d7878ce: start","job_status":"start","queue_duration_s":1.382466,"scheduling_latency_s":1.382528}1576vm-test-run-nixbot-gitlab> gitlab # [  174.270389] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.096Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3157c3f7a8680b305d7878ce","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3157c3f7a8680b305d7878ce: done: 0.657685 sec","job_status":"done","queue_duration_s":1.382466,"scheduling_latency_s":1.382528,"redis_calls":13,"redis_duration_s":0.643463,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.512703,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.13076,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.657685,"completed_at":"2026-06-09T13:42:07.096Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577vm-test-run-nixbot-gitlab> gitlab # [  174.362851] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f723da2d965d961222bf5f6","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f723da2d965d961222bf5f6: start","job_status":"start","queue_duration_s":2.132655,"scheduling_latency_s":2.132719}1578vm-test-run-nixbot-gitlab> gitlab # [  174.399692] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f723da2d965d961222bf5f6","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f723da2d965d961222bf5f6: done: 0.036215 sec","job_status":"done","queue_duration_s":2.132655,"scheduling_latency_s":2.132719,"redis_calls":13,"redis_duration_s":0.004618,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001476,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003142,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036215,"completed_at":"2026-06-09T13:42:07.225Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1579vm-test-run-nixbot-gitlab> gitlab # [  174.463557] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.290Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"494794f90281e09f9cd60999","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-494794f90281e09f9cd60999: start","job_status":"start","queue_duration_s":2.233274,"scheduling_latency_s":2.233334}1580vm-test-run-nixbot-gitlab> gitlab # [  174.498649] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"494794f90281e09f9cd60999","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-494794f90281e09f9cd60999: done: 0.035619 sec","job_status":"done","queue_duration_s":2.233274,"scheduling_latency_s":2.233334,"redis_calls":13,"redis_duration_s":0.002953,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035619,"completed_at":"2026-06-09T13:42:07.325Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1581vm-test-run-nixbot-gitlab> gitlab # [  174.559925] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06a98458111aa008accdd3be","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06a98458111aa008accdd3be: start","job_status":"start","queue_duration_s":2.330021,"scheduling_latency_s":2.330055}1582vm-test-run-nixbot-gitlab> gitlab # [  174.595253] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06a98458111aa008accdd3be","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06a98458111aa008accdd3be: done: 0.035362 sec","job_status":"done","queue_duration_s":2.330021,"scheduling_latency_s":2.330055,"redis_calls":13,"redis_duration_s":0.0029590000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011256,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035362,"completed_at":"2026-06-09T13:42:07.421Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583vm-test-run-nixbot-gitlab> gitlab # [  174.656899] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f94f21eeb965d337099afa5","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f94f21eeb965d337099afa5: start","job_status":"start","queue_duration_s":2.426971,"scheduling_latency_s":2.427005}1584vm-test-run-nixbot-gitlab> gitlab # [  174.691794] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.518Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f94f21eeb965d337099afa5","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f94f21eeb965d337099afa5: done: 0.034995 sec","job_status":"done","queue_duration_s":2.426971,"scheduling_latency_s":2.427005,"redis_calls":13,"redis_duration_s":0.003112,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002205,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034995,"completed_at":"2026-06-09T13:42:07.518Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585vm-test-run-nixbot-gitlab> gitlab # [  174.753835] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.580Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38e212f86d673ce986ef6ec5","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38e212f86d673ce986ef6ec5: start","job_status":"start","queue_duration_s":2.523361,"scheduling_latency_s":2.523392}1586vm-test-run-nixbot-gitlab> gitlab # [  174.789175] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38e212f86d673ce986ef6ec5","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38e212f86d673ce986ef6ec5: done: 0.035547 sec","job_status":"done","queue_duration_s":2.523361,"scheduling_latency_s":2.523392,"redis_calls":13,"redis_duration_s":0.003261,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000892,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002369,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010694,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035547,"completed_at":"2026-06-09T13:42:07.615Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587vm-test-run-nixbot-gitlab> gitlab # [  174.850582] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.677Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fec5f5b889dfc7e4be30d19c","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fec5f5b889dfc7e4be30d19c: start","job_status":"start","queue_duration_s":2.620625,"scheduling_latency_s":2.620658}1588vm-test-run-nixbot-gitlab> gitlab # [  174.867596] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.694Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fec5f5b889dfc7e4be30d19c","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fec5f5b889dfc7e4be30d19c: done: 0.017182 sec","job_status":"done","queue_duration_s":2.620625,"scheduling_latency_s":2.620658,"redis_calls":13,"redis_duration_s":0.00276,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000896,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001864,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011184,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017182,"completed_at":"2026-06-09T13:42:07.694Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589vm-test-run-nixbot-gitlab> gitlab # [  174.869370] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26fec2555885c44cadb93f12","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26fec2555885c44cadb93f12: start","job_status":"start","queue_duration_s":2.639091,"scheduling_latency_s":2.639111}1590vm-test-run-nixbot-gitlab> gitlab # [  174.944952] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26fec2555885c44cadb93f12","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26fec2555885c44cadb93f12: done: 0.015993 sec","job_status":"done","queue_duration_s":2.639091,"scheduling_latency_s":2.639111,"redis_calls":13,"redis_duration_s":0.0030659999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000891,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002175,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015993,"completed_at":"2026-06-09T13:42:07.711Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591vm-test-run-nixbot-gitlab> gitlab # [  174.947105] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3d5ab691a7ff8126ce65867","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3d5ab691a7ff8126ce65867: start","job_status":"start","queue_duration_s":2.656403,"scheduling_latency_s":2.656424}1592vm-test-run-nixbot-gitlab> gitlab # [  174.960055] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3d5ab691a7ff8126ce65867","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3d5ab691a7ff8126ce65867: done: 0.015377 sec","job_status":"done","queue_duration_s":2.656403,"scheduling_latency_s":2.656424,"redis_calls":13,"redis_duration_s":0.003084,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002182,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015377,"completed_at":"2026-06-09T13:42:07.728Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593vm-test-run-nixbot-gitlab> gitlab # [  175.030972] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.729Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e06d8e9b18ac04e0970d36e","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e06d8e9b18ac04e0970d36e: start","job_status":"start","queue_duration_s":2.67307,"scheduling_latency_s":2.67309}1594vm-test-run-nixbot-gitlab> gitlab # [  175.100313] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.746Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e06d8e9b18ac04e0970d36e","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e06d8e9b18ac04e0970d36e: done: 0.01719 sec","job_status":"done","queue_duration_s":2.67307,"scheduling_latency_s":2.67309,"redis_calls":13,"redis_duration_s":0.002915,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000896,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01719,"completed_at":"2026-06-09T13:42:07.746Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1595vm-test-run-nixbot-gitlab> gitlab # [  175.102299] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec7463f24b24c0cc9b473b95","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec7463f24b24c0cc9b473b95: start","job_status":"start","queue_duration_s":2.691649,"scheduling_latency_s":2.691669}1596vm-test-run-nixbot-gitlab> gitlab # [  175.184263] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec7463f24b24c0cc9b473b95","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec7463f24b24c0cc9b473b95: done: 0.015568 sec","job_status":"done","queue_duration_s":2.691649,"scheduling_latency_s":2.691669,"redis_calls":13,"redis_duration_s":0.003109,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002182,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015568,"completed_at":"2026-06-09T13:42:07.763Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1597vm-test-run-nixbot-gitlab> gitlab # [  175.186106] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cbe0c927cb474df9eb2f306","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cbe0c927cb474df9eb2f306: start","job_status":"start","queue_duration_s":2.708556,"scheduling_latency_s":2.708577}1598vm-test-run-nixbot-gitlab> gitlab # [  175.260177] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cbe0c927cb474df9eb2f306","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cbe0c927cb474df9eb2f306: done: 0.015977 sec","job_status":"done","queue_duration_s":2.708556,"scheduling_latency_s":2.708577,"redis_calls":13,"redis_duration_s":0.002968,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010272,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015977,"completed_at":"2026-06-09T13:42:07.781Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1599vm-test-run-nixbot-gitlab> gitlab # [  175.264096] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"545b9ce6c4e645fa9eb5b3f2","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-545b9ce6c4e645fa9eb5b3f2: start","job_status":"start","queue_duration_s":2.725826,"scheduling_latency_s":2.725847}1600vm-test-run-nixbot-gitlab> gitlab # [  175.284877] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"545b9ce6c4e645fa9eb5b3f2","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-545b9ce6c4e645fa9eb5b3f2: done: 0.015339 sec","job_status":"done","queue_duration_s":2.725826,"scheduling_latency_s":2.725847,"redis_calls":13,"redis_duration_s":0.00297,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015339,"completed_at":"2026-06-09T13:42:07.797Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1601vm-test-run-nixbot-gitlab> gitlab # [  175.363381] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca33e98b13c5b42795cabf88","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca33e98b13c5b42795cabf88: start","job_status":"start","queue_duration_s":2.742921,"scheduling_latency_s":2.742942}1602vm-test-run-nixbot-gitlab> gitlab # [  175.366839] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca33e98b13c5b42795cabf88","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca33e98b13c5b42795cabf88: done: 0.015411 sec","job_status":"done","queue_duration_s":2.742921,"scheduling_latency_s":2.742942,"redis_calls":13,"redis_duration_s":0.003159,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002254,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015411,"completed_at":"2026-06-09T13:42:07.814Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603vm-test-run-nixbot-gitlab> gitlab # [  175.500861] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"601852db62dee6675e4b028d","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-601852db62dee6675e4b028d: start","job_status":"start","queue_duration_s":2.759647,"scheduling_latency_s":2.759667}1604vm-test-run-nixbot-gitlab> gitlab # [  175.501731] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"601852db62dee6675e4b028d","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-601852db62dee6675e4b028d: done: 0.015296 sec","job_status":"done","queue_duration_s":2.759647,"scheduling_latency_s":2.759667,"redis_calls":13,"redis_duration_s":0.003065,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002185,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015296,"completed_at":"2026-06-09T13:42:07.831Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1605vm-test-run-nixbot-gitlab> gitlab # [  175.512066] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.832Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e10a04bb573fcfa5968c51a5","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e10a04bb573fcfa5968c51a5: start","job_status":"start","queue_duration_s":2.77622,"scheduling_latency_s":2.77624}1606vm-test-run-nixbot-gitlab> gitlab # [  175.580388] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e10a04bb573fcfa5968c51a5","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e10a04bb573fcfa5968c51a5: done: 0.015061 sec","job_status":"done","queue_duration_s":2.77622,"scheduling_latency_s":2.77624,"redis_calls":13,"redis_duration_s":0.002997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00206,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015061,"completed_at":"2026-06-09T13:42:07.847Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1607vm-test-run-nixbot-gitlab> gitlab # [  175.649261] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.849Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f113261d24fafc6947575c54","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f113261d24fafc6947575c54: start","job_status":"start","queue_duration_s":2.792618,"scheduling_latency_s":2.792639}1608vm-test-run-nixbot-gitlab> gitlab # [  175.650878] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f113261d24fafc6947575c54","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f113261d24fafc6947575c54: done: 0.014976 sec","job_status":"done","queue_duration_s":2.792618,"scheduling_latency_s":2.792639,"redis_calls":13,"redis_duration_s":0.002918,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014976,"completed_at":"2026-06-09T13:42:07.864Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1609vm-test-run-nixbot-gitlab> gitlab # [  175.674111] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b880e269a59026e92467ad4a","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b880e269a59026e92467ad4a: start","job_status":"start","queue_duration_s":2.809134,"scheduling_latency_s":2.809163}1610vm-test-run-nixbot-gitlab> gitlab # [  175.742330] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b880e269a59026e92467ad4a","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b880e269a59026e92467ad4a: done: 0.015089 sec","job_status":"done","queue_duration_s":2.809134,"scheduling_latency_s":2.809163,"redis_calls":13,"redis_duration_s":0.0030030000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009632,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015089,"completed_at":"2026-06-09T13:42:07.880Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1611vm-test-run-nixbot-gitlab> gitlab # [  175.755059] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99db426c7efd29c4a7d349dd","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99db426c7efd29c4a7d349dd: start","job_status":"start","queue_duration_s":2.82556,"scheduling_latency_s":2.82558}1612vm-test-run-nixbot-gitlab> gitlab # [  175.774851] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99db426c7efd29c4a7d349dd","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99db426c7efd29c4a7d349dd: done: 0.015661 sec","job_status":"done","queue_duration_s":2.82556,"scheduling_latency_s":2.82558,"redis_calls":13,"redis_duration_s":0.0034059999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002472,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015661,"completed_at":"2026-06-09T13:42:07.897Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1613vm-test-run-nixbot-gitlab> gitlab # [  175.857145] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.899Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b98b874832ca0b013e5a677d","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b98b874832ca0b013e5a677d: start","job_status":"start","queue_duration_s":2.842537,"scheduling_latency_s":2.842557}1614vm-test-run-nixbot-gitlab> gitlab # [  175.858215] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.914Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b98b874832ca0b013e5a677d","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b98b874832ca0b013e5a677d: done: 0.01529 sec","job_status":"done","queue_duration_s":2.842537,"scheduling_latency_s":2.842557,"redis_calls":13,"redis_duration_s":0.002976,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000856,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00212,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01529,"completed_at":"2026-06-09T13:42:07.914Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1615vm-test-run-nixbot-gitlab> gitlab # [  175.919275] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c4d13bf2f47c8b4917c8967","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c4d13bf2f47c8b4917c8967: start","job_status":"start","queue_duration_s":2.859026,"scheduling_latency_s":2.859046}1616vm-test-run-nixbot-gitlab> gitlab # [  176.001358] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.930Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c4d13bf2f47c8b4917c8967","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c4d13bf2f47c8b4917c8967: done: 0.015268 sec","job_status":"done","queue_duration_s":2.859026,"scheduling_latency_s":2.859046,"redis_calls":13,"redis_duration_s":0.002751,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000895,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001856,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015268,"completed_at":"2026-06-09T13:42:07.930Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617vm-test-run-nixbot-gitlab> gitlab # [  176.003152] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.932Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35fad306003355ef1a5fd096","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35fad306003355ef1a5fd096: start","job_status":"start","queue_duration_s":2.87591,"scheduling_latency_s":2.875931}1618vm-test-run-nixbot-gitlab> gitlab # [  176.086460] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.947Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35fad306003355ef1a5fd096","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35fad306003355ef1a5fd096: done: 0.01538 sec","job_status":"done","queue_duration_s":2.87591,"scheduling_latency_s":2.875931,"redis_calls":13,"redis_duration_s":0.0028729999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000891,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01538,"completed_at":"2026-06-09T13:42:07.947Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1619vm-test-run-nixbot-gitlab> gitlab # [  176.088316] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e675ef9ae4644c75ff5c700","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e675ef9ae4644c75ff5c700: start","job_status":"start","queue_duration_s":2.892565,"scheduling_latency_s":2.892587}1620vm-test-run-nixbot-gitlab> gitlab # [  176.102126] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e675ef9ae4644c75ff5c700","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e675ef9ae4644c75ff5c700: done: 0.01518 sec","job_status":"done","queue_duration_s":2.892565,"scheduling_latency_s":2.892587,"redis_calls":13,"redis_duration_s":0.002822,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000836,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01518,"completed_at":"2026-06-09T13:42:07.964Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621vm-test-run-nixbot-gitlab> gitlab # [  176.203308] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1138d7d5c12f4fb2b7e13f6e","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1138d7d5c12f4fb2b7e13f6e: start","job_status":"start","queue_duration_s":2.909186,"scheduling_latency_s":2.909208}1622vm-test-run-nixbot-gitlab> gitlab # [  176.204939] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1138d7d5c12f4fb2b7e13f6e","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1138d7d5c12f4fb2b7e13f6e: done: 0.015094 sec","job_status":"done","queue_duration_s":2.909186,"scheduling_latency_s":2.909208,"redis_calls":13,"redis_duration_s":0.002751,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000847,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015094,"completed_at":"2026-06-09T13:42:07.980Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623vm-test-run-nixbot-gitlab> gitlab # [  176.275602] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd1fa18ffe04db140b3375dc","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd1fa18ffe04db140b3375dc: start","job_status":"start","queue_duration_s":2.925539,"scheduling_latency_s":2.925561}1624vm-test-run-nixbot-gitlab> gitlab # [  176.277430] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd1fa18ffe04db140b3375dc","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd1fa18ffe04db140b3375dc: done: 0.014948 sec","job_status":"done","queue_duration_s":2.925539,"scheduling_latency_s":2.925561,"redis_calls":13,"redis_duration_s":0.002775,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000873,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009843,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014948,"completed_at":"2026-06-09T13:42:07.997Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1625vm-test-run-nixbot-gitlab> gitlab # [  176.332045] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:07.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c599560763f49d9500a4e1e","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c599560763f49d9500a4e1e: start","job_status":"start","queue_duration_s":2.94173,"scheduling_latency_s":2.94175}1626vm-test-run-nixbot-gitlab> gitlab # [  176.412496] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c599560763f49d9500a4e1e","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c599560763f49d9500a4e1e: done: 0.014944 sec","job_status":"done","queue_duration_s":2.94173,"scheduling_latency_s":2.94175,"redis_calls":13,"redis_duration_s":0.002711,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001807,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010087,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014944,"completed_at":"2026-06-09T13:42:08.013Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1627vm-test-run-nixbot-gitlab> gitlab # [  176.414251] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"76211b8ed41efde9bd982183","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-76211b8ed41efde9bd982183: start","job_status":"start","queue_duration_s":2.957966,"scheduling_latency_s":2.957986}1628vm-test-run-nixbot-gitlab> gitlab # [  176.481272] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"76211b8ed41efde9bd982183","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-76211b8ed41efde9bd982183: done: 0.015693 sec","job_status":"done","queue_duration_s":2.957966,"scheduling_latency_s":2.957986,"redis_calls":13,"redis_duration_s":0.0031360000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002207,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015693,"completed_at":"2026-06-09T13:42:08.030Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1629vm-test-run-nixbot-gitlab> gitlab # [  176.552820] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b6b76decec01e054bca300d","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b6b76decec01e054bca300d: start","job_status":"start","queue_duration_s":2.974994,"scheduling_latency_s":2.975015}1630vm-test-run-nixbot-gitlab> gitlab # [  176.554205] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b6b76decec01e054bca300d","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b6b76decec01e054bca300d: done: 0.01571 sec","job_status":"done","queue_duration_s":2.974994,"scheduling_latency_s":2.975015,"redis_calls":13,"redis_duration_s":0.0030429999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01571,"completed_at":"2026-06-09T13:42:08.047Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1631vm-test-run-nixbot-gitlab> gitlab # [  176.570109] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.048Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"993d6dcf057db1798dd4de7b","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-993d6dcf057db1798dd4de7b: start","job_status":"start","queue_duration_s":2.992112,"scheduling_latency_s":2.992134}1632vm-test-run-nixbot-gitlab> gitlab # [  176.637401] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"993d6dcf057db1798dd4de7b","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-993d6dcf057db1798dd4de7b: done: 0.015564 sec","job_status":"done","queue_duration_s":2.992112,"scheduling_latency_s":2.992134,"redis_calls":13,"redis_duration_s":0.0031,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002168,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015564,"completed_at":"2026-06-09T13:42:08.064Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1633vm-test-run-nixbot-gitlab> gitlab # [  176.705273] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ab8be178ad6c61f0b5be407","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ab8be178ad6c61f0b5be407: start","job_status":"start","queue_duration_s":3.009031,"scheduling_latency_s":3.009052}1634vm-test-run-nixbot-gitlab> gitlab # [  176.706904] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.081Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ab8be178ad6c61f0b5be407","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ab8be178ad6c61f0b5be407: done: 0.015678 sec","job_status":"done","queue_duration_s":3.009031,"scheduling_latency_s":3.009052,"redis_calls":13,"redis_duration_s":0.003065,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015678,"completed_at":"2026-06-09T13:42:08.081Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1635vm-test-run-nixbot-gitlab> gitlab # [  176.776447] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2af851549fe59e3ee4975aab","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2af851549fe59e3ee4975aab: start","job_status":"start","queue_duration_s":3.026064,"scheduling_latency_s":3.026084}1636vm-test-run-nixbot-gitlab> gitlab # [  176.777772] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.098Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2af851549fe59e3ee4975aab","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2af851549fe59e3ee4975aab: done: 0.01559 sec","job_status":"done","queue_duration_s":3.026064,"scheduling_latency_s":3.026084,"redis_calls":13,"redis_duration_s":0.003104,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002175,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01559,"completed_at":"2026-06-09T13:42:08.098Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1637vm-test-run-nixbot-gitlab> gitlab # [  176.856044] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47f104c9b6e25ae5e7e73931","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47f104c9b6e25ae5e7e73931: start","job_status":"start","queue_duration_s":3.043086,"scheduling_latency_s":3.043107}1638vm-test-run-nixbot-gitlab> gitlab # [  176.857678] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.115Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47f104c9b6e25ae5e7e73931","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47f104c9b6e25ae5e7e73931: done: 0.015924 sec","job_status":"done","queue_duration_s":3.043086,"scheduling_latency_s":3.043107,"redis_calls":13,"redis_duration_s":0.0034730000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000894,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002579,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015924,"completed_at":"2026-06-09T13:42:08.115Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1639vm-test-run-nixbot-gitlab> gitlab # [  176.932335] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.117Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91f0247aa8fc4de27db5140f","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91f0247aa8fc4de27db5140f: start","job_status":"start","queue_duration_s":3.060317,"scheduling_latency_s":3.060339}1640vm-test-run-nixbot-gitlab> gitlab # [  176.933901] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.132Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91f0247aa8fc4de27db5140f","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91f0247aa8fc4de27db5140f: done: 0.015975 sec","job_status":"done","queue_duration_s":3.060317,"scheduling_latency_s":3.060339,"redis_calls":13,"redis_duration_s":0.0031850000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001073,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015975,"completed_at":"2026-06-09T13:42:08.132Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1641vm-test-run-nixbot-gitlab> gitlab # [  177.006075] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.134Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9956167deedfddc05d0cd3d5","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9956167deedfddc05d0cd3d5: start","job_status":"start","queue_duration_s":3.077647,"scheduling_latency_s":3.077668}1642vm-test-run-nixbot-gitlab> gitlab # [  177.007259] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.150Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9956167deedfddc05d0cd3d5","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9956167deedfddc05d0cd3d5: done: 0.01573 sec","job_status":"done","queue_duration_s":3.077647,"scheduling_latency_s":3.077668,"redis_calls":13,"redis_duration_s":0.0030429999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000979,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002064,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01573,"completed_at":"2026-06-09T13:42:08.150Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1643vm-test-run-nixbot-gitlab> gitlab # [  177.077177] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.151Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b6f9fa971649fc5b7cb35a5","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b6f9fa971649fc5b7cb35a5: start","job_status":"start","queue_duration_s":3.094738,"scheduling_latency_s":3.094758}1644vm-test-run-nixbot-gitlab> gitlab # [  177.078779] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b6f9fa971649fc5b7cb35a5","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b6f9fa971649fc5b7cb35a5: done: 0.015553 sec","job_status":"done","queue_duration_s":3.094738,"scheduling_latency_s":3.094758,"redis_calls":13,"redis_duration_s":0.0029649999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015553,"completed_at":"2026-06-09T13:42:08.166Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1645vm-test-run-nixbot-gitlab> gitlab # [  177.152195] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f2afe4ebb9366b1b5e15d4d","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f2afe4ebb9366b1b5e15d4d: start","job_status":"start","queue_duration_s":3.111583,"scheduling_latency_s":3.111605}1646vm-test-run-nixbot-gitlab> gitlab # [  177.153801] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f2afe4ebb9366b1b5e15d4d","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f2afe4ebb9366b1b5e15d4d: done: 0.014989 sec","job_status":"done","queue_duration_s":3.111583,"scheduling_latency_s":3.111605,"redis_calls":13,"redis_duration_s":0.0026969999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000848,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001849,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014989,"completed_at":"2026-06-09T13:42:08.183Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1647vm-test-run-nixbot-gitlab> gitlab # [  177.256059] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.184Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3577b22f8f9476c7255061a4","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3577b22f8f9476c7255061a4: start","job_status":"start","queue_duration_s":3.127907,"scheduling_latency_s":3.127927}1648vm-test-run-nixbot-gitlab> gitlab # [  177.257418] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3577b22f8f9476c7255061a4","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3577b22f8f9476c7255061a4: done: 0.01902 sec","job_status":"done","queue_duration_s":3.127907,"scheduling_latency_s":3.127927,"redis_calls":13,"redis_duration_s":0.006362,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004278,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010204,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01902,"completed_at":"2026-06-09T13:42:08.203Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1649vm-test-run-nixbot-gitlab> gitlab # [  177.289848] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.205Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8341fd8f0f7efba4dd6c76c","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8341fd8f0f7efba4dd6c76c: start","job_status":"start","queue_duration_s":3.148278,"scheduling_latency_s":3.1483}1650vm-test-run-nixbot-gitlab> gitlab # [  177.309190] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8341fd8f0f7efba4dd6c76c","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8341fd8f0f7efba4dd6c76c: done: 0.015847 sec","job_status":"done","queue_duration_s":3.148278,"scheduling_latency_s":3.1483,"redis_calls":13,"redis_duration_s":0.003407,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001062,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002345,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015847,"completed_at":"2026-06-09T13:42:08.220Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1651vm-test-run-nixbot-gitlab> gitlab # [  177.376953] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.222Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"150189c71238a4abccdb8cb8","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-150189c71238a4abccdb8cb8: start","job_status":"start","queue_duration_s":3.165455,"scheduling_latency_s":3.165476}1652vm-test-run-nixbot-gitlab> gitlab # [  177.388772] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"150189c71238a4abccdb8cb8","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-150189c71238a4abccdb8cb8: done: 0.015495 sec","job_status":"done","queue_duration_s":3.165455,"scheduling_latency_s":3.165476,"redis_calls":13,"redis_duration_s":0.003213,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000994,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002219,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015495,"completed_at":"2026-06-09T13:42:08.237Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1653vm-test-run-nixbot-gitlab> gitlab # [  177.503232] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d2f3aeee1db7fab3a1e8962","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d2f3aeee1db7fab3a1e8962: start","job_status":"start","queue_duration_s":3.182263,"scheduling_latency_s":3.182285}1654vm-test-run-nixbot-gitlab> gitlab # [  177.504881] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.254Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d2f3aeee1db7fab3a1e8962","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d2f3aeee1db7fab3a1e8962: done: 0.015631 sec","job_status":"done","queue_duration_s":3.182263,"scheduling_latency_s":3.182285,"redis_calls":13,"redis_duration_s":0.003284,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002349,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015631,"completed_at":"2026-06-09T13:42:08.254Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1655vm-test-run-nixbot-gitlab> gitlab # [  177.575142] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.256Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"869521a16ea268c1f41b240f","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-869521a16ea268c1f41b240f: start","job_status":"start","queue_duration_s":3.199288,"scheduling_latency_s":3.199308}1656vm-test-run-nixbot-gitlab> gitlab # [  177.576285] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"869521a16ea268c1f41b240f","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-869521a16ea268c1f41b240f: done: 0.01558 sec","job_status":"done","queue_duration_s":3.199288,"scheduling_latency_s":3.199308,"redis_calls":13,"redis_duration_s":0.00281,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00086,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00195,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01558,"completed_at":"2026-06-09T13:42:08.271Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1657vm-test-run-nixbot-gitlab> gitlab # [  177.661076] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad6d0a8a437f5605cba8f4e9","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad6d0a8a437f5605cba8f4e9: start","job_status":"start","queue_duration_s":3.216176,"scheduling_latency_s":3.216197}1658vm-test-run-nixbot-gitlab> gitlab # [  177.662202] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad6d0a8a437f5605cba8f4e9","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad6d0a8a437f5605cba8f4e9: done: 0.015541 sec","job_status":"done","queue_duration_s":3.216176,"scheduling_latency_s":3.216197,"redis_calls":13,"redis_duration_s":0.002739,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000853,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015541,"completed_at":"2026-06-09T13:42:08.288Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1659vm-test-run-nixbot-gitlab> gitlab # [  177.687345] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c8c140be1652413b67b7dcd","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c8c140be1652413b67b7dcd: start","job_status":"start","queue_duration_s":3.232955,"scheduling_latency_s":3.232981}1660vm-test-run-nixbot-gitlab> gitlab # [  177.706747] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c8c140be1652413b67b7dcd","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c8c140be1652413b67b7dcd: done: 0.015832 sec","job_status":"done","queue_duration_s":3.232955,"scheduling_latency_s":3.232981,"redis_calls":13,"redis_duration_s":0.002745,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015832,"completed_at":"2026-06-09T13:42:08.305Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1661vm-test-run-nixbot-gitlab> gitlab # [  177.768226] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2f7edca7e2fe71afc19bc2a","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2f7edca7e2fe71afc19bc2a: start","job_status":"start","queue_duration_s":3.250115,"scheduling_latency_s":3.250136}1662vm-test-run-nixbot-gitlab> gitlab # [  177.842233] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2f7edca7e2fe71afc19bc2a","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2f7edca7e2fe71afc19bc2a: done: 0.015597 sec","job_status":"done","queue_duration_s":3.250115,"scheduling_latency_s":3.250136,"redis_calls":13,"redis_duration_s":0.002709,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000824,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015597,"completed_at":"2026-06-09T13:42:08.322Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1663vm-test-run-nixbot-gitlab> gitlab # [  177.847094] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:08.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e25512f4f4c3f8691fbf90a","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e25512f4f4c3f8691fbf90a: start","job_status":"start","queue_duration_s":3.26706,"scheduling_latency_s":3.267081}1664vm-test-run-nixbot-gitlab> gitlab # [  178.057250] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:10.883Z","message":"Adding dead Ci::UnlockPipelinesInQueueWorker job 9e25512f4f4c3f8691fbf90a"}1665vm-test-run-nixbot-gitlab> gitlab # [  178.069181] sidekiq-cluster[2069]: {"severity":"WARN","time":"2026-06-09T13:42:10.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e25512f4f4c3f8691fbf90a","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"lyp1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e25512f4f4c3f8691fbf90a: fail: 2.570942 sec","job_status":"fail","queue_duration_s":3.26706,"scheduling_latency_s":3.267081,"redis_calls":6,"redis_duration_s":2.407562,"redis_read_bytes":3,"redis_write_bytes":373,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":2.311808,"redis_queues_metadata_read_bytes":2,"redis_queues_metadata_write_bytes":159,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.095754,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.131927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":2.570942,"completed_at":"2026-06-09T13:42:10.894Z","exception.class":"Redis::TimeoutError","exception.message":"Waited 1.0 seconds","exception.backtrace":["/nix/store/3vargawps0qrl9q12mdv0wc861sz4cwv-ruby3.3-redis-client-0.26.4/lib/ruby/gems/3.3.0/gems/redis-client-0.26.4/lib/redis_client/ruby_connection/buffered_io.rb:214:in `block in fill_buffer'","\u003cinternal:kernel\u003e:187:in `loop'","/nix/store/3vargawps0qrl9q12mdv0wc861sz4cwv-ruby3.3-redis-client-0.26.4/lib/ruby/gems/3.3.0/gems/redis-client-0.26.4/lib/redis_client/ruby_connection/buffered_io.rb:197:in `fill_buffer'","/nix/store/3vargawps0qrl9q12mdv0wc861sz4cwv-ruby3.3-redis-client-0.26.4/lib/ruby/gems/3.3.0/gems/redis-client-0.26.4/lib/redis_client/ruby_connection/buffered_io.rb:187:in `ensure_remaining'","/nix/store/3vargawps0qrl9q12mdv0wc861sz4cwv-ruby3.3-redis-client-0.26.4/lib/ruby/gems/3.3.0/gems/redis-client-0.26.4/lib/redis_client/ruby_connection/buffered_io.rb:152:in `getbyte'","/nix/store/3vargawps0qrl9q12mdv0wc861sz4cwv-ruby3.3-redis-client-0.26.4/lib/ruby/gems/3.3.0/gems/redis-client-0.26.4/lib/redis_client/ruby_connection/resp3.rb:113:in `parse'","/nix/store/3vargawps0qrl9q12mdv0wc861sz4cwv-ruby3.3-redis-client-0.26.4/lib/ruby/gems/3.3.0/gems/redis-client-0.26.4/lib/redis_client/ruby_connection/resp3.rb:50:in `load'","/nix/store/3vargawps0qrl9q12mdv0wc861sz4cwv-ruby3.3-redis-client-0.26.4/lib/ruby/gems/3.3.0/gems/redis-client-0.26.4/lib/redis_client/ruby_connection.rb:97:in `read'","/nix/store/3vargawps0qrl9q12mdv0wc861sz4cwv-ruby3.3-redis-client-0.26.4/lib/ruby/gems/3.3.0/gems/redis-client-0.26.4/lib/redis_client/connection_mixin.rb:37:in `call'","/nix/store/3vargawps0qrl9q12mdv0wc861sz4cwv-ruby3.3-redis-client-0.26.4/lib/ruby/gems/3.3.0/gems/redis-client-0.26.4/lib/redis_client.rb:354:in `block (2 levels) in call_v'","/nix/store/3vargawps0qrl9q12mdv0wc861sz4cwv-ruby3.3-redis-client-0.26.4/lib/ruby/gems/3.3.0/gems/redis-client-0.26.4/lib/redis_client/middlewares.rb:16:in `call'","lib/gitlab/instrumentation/redis_client_middleware.rb:14:in `block in call'","lib/gitlab/instrumentation/redis_helper.rb:17:in `instrument_call'","lib/gitlab/instrumentation/redis_client_middleware.rb:13:in `call'","/nix/store/3vargawps0qrl9q12mdv0wc861sz4cwv-ruby3.3-redis-client-0.26.4/lib/ruby/gems/3.3.0/gems/redis-client-0.26.4/lib/redis_client.rb:353:in `block in call_v'","/nix/store/3vargawps0qrl9q12mdv0wc861sz4cwv-ruby3.3-redis-client-0.26.4/lib/ruby/gems/3.3.0/gems/redis-client-0.26.4/lib/redis_client.rb:761:in `ensure_connected'","lib/gitlab/patch/redis_client.rb:12:in `ensure_connected'","/nix/store/r8ais8nv9y7hzn25rg3b1hfa3hdr6gf1-ruby3.3-redis-5.4.1/lib/ruby/gems/3.3.0/gems/redis-5.4.1/lib/redis/client.rb:91:in `ensure_connected'","/nix/store/3vargawps0qrl9q12mdv0wc861sz4cwv-ruby3.3-redis-client-0.26.4/lib/ruby/gems/3.3.0/gems/redis-client-0.26.4/lib/redis_client.rb:352:in `call_v'","/nix/store/r8ais8nv9y7hzn25rg3b1hfa3hdr6gf1-ruby3.3-redis-5.4.1/lib/ruby/gems/3.3.0/gems/redis-5.4.1/lib/redis/client.rb:97:in `call_v'","/nix/store/r8ais8nv9y7hzn25rg3b1hfa3hdr6gf1-ruby3.3-redis-5.4.1/lib/ruby/gems/3.3.0/gems/redis-5.4.1/lib/redis.rb:154:in `block in send_command'","/nix/store/r8ais8nv9y7hzn25rg3b1hfa3hdr6gf1-ruby3.3-redis-5.4.1/lib/ruby/gems/3.3.0/gems/redis-5.4.1/lib/redis.rb:153:in `synchronize'","/nix/store/r8ais8nv9y7hzn25rg3b1hfa3hdr6gf1-ruby3.3-redis-5.4.1/lib/ruby/gems/3.3.0/gems/redis-5.4.1/lib/redis.rb:153:in `send_command'","/nix/store/r8ais8nv9y7hzn25rg3b1hfa3hdr6gf1-ruby3.3-redis-5.4.1/lib/ruby/gems/3.3.0/gems/redis-5.4.1/lib/redis/commands/strings.rb:191:in `get'","lib/gitlab/sidekiq_middleware/concurrency_limit/limit_manager.rb:25:in `block in current_limit'","lib/gitlab/redis/wrapper.rb:27:in `block in with'","/nix/store/0nnh6cv5x94v1v4cq5x6qs5b70y09vyb-ruby3.3-connection_pool-2.5.5/lib/ruby/gems/3.3.0/gems/connection_pool-2.5.5/lib/connection_pool.rb:114:in `block (2 levels) in with'","/nix/store/0nnh6cv5x94v1v4cq5x6qs5b70y09vyb-ruby3.3-connection_pool-2.5.5/lib/ruby/gems/3.3.0/gems/connection_pool-2.5.5/lib/connection_pool.rb:113:in `handle_interrupt'","/nix/store/0nnh6cv5x94v1v4cq5x6qs5b70y09vyb-ruby3.3-connection_pool-2.5.5/lib/ruby/gems/3.3.0/gems/connection_pool-2.5.5/lib/connection_pool.rb:113:in `block in with'","/nix/store/0nnh6cv5x94v1v4cq5x6qs5b70y09vyb-ruby3.3-connection_pool-2.5.5/lib/ruby/gems/3.3.0/gems/connection_pool-2.5.5/lib/connection_pool.rb:110:in `handle_interrupt'","/nix/store/0nnh6cv5x94v1v4cq5x6qs5b70y09vyb-ruby3.3-connection_pool-2.5.5/lib/ruby/gems/3.3.0/gems/connection_pool-2.5.5/lib/connection_pool.rb:110:in `with'","lib/gitlab/redis/wrapper.rb:27:in `with'","lib/gitlab/sidekiq_middleware/concurrency_limit/limit_manager.rb:54:in `with_redis'","lib/gitlab/sidekiq_middleware/concurrency_limit/limit_manager.rb:24:in `current_limit'","lib/gitlab/sidekiq_middleware/concurrency_limit/concurrency_limit_service.rb:15:in `current_limit'","lib/gitlab/sidekiq_middleware/concurrency_limit/concurrency_limit_service.rb:71:in `over_the_limit?'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:68:in `should_defer_perform?'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:37:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/85h4805ad7n5qn7wq2m6icypga7rnk80-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"exception.cause_class":"RedisClient::ReadTimeoutError","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1666vm-test-run-nixbot-gitlab> gitlab # [  178.486764] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:11.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e4c203683f50b2475bdcc18","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"m45x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e4c203683f50b2475bdcc18: start","job_status":"start","queue_duration_s":6.25676,"scheduling_latency_s":6.256793}1667vm-test-run-nixbot-gitlab> gitlab # [  178.505759] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:11.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e4c203683f50b2475bdcc18","created_at":"2026-06-09T13:42:04.931Z","trace_propagation_headers":{"sentry-trace":"27b6b149086e48cf8ee68a7138033c26-928219040f6c42aa","baggage":"sentry-trace_id=27b6b149086e48cf8ee68a7138033c26,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d620cacaa5d681181ca47f00d8dc19a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:05.056Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"m45x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e4c203683f50b2475bdcc18: done: 0.019093 sec","job_status":"done","queue_duration_s":6.25676,"scheduling_latency_s":6.256793,"redis_calls":13,"redis_duration_s":0.005020999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001608,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003413,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010547,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019093,"completed_at":"2026-06-09T13:42:11.332Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1668vm-test-run-nixbot-gitlab> gitlab # [  180.532513] runuser[2636]: pam_unix(runuser:session): session closed for user gitlab1669vm-test-run-nixbot-gitlab> gitlab # [  180.539294] setup-gitlab-start[2854]: ++ jq -r .token1670vm-test-run-nixbot-gitlab> gitlab # [  180.543167] setup-gitlab-start[2855]: +++ date -d '+7 days' +%F1671vm-test-run-nixbot-gitlab> gitlab # [  180.547425] setup-gitlab-start[2853]: ++ curl -fs -X POST -H 'Authorization: Bearer 0cc86333dbbbee008c8049607e8be6b017adb93599c2ed75636dd6d4482a61ac' -H 'Content-Type: application/json' -d '{"name":"nixbot","scopes":["api"],"expires_at":"2026-06-16"}' http://gitlab/api/v4/users/1/personal_access_tokens1672vm-test-run-nixbot-gitlab> gitlab # [  181.065974] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:13.891Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"6613dd19587f94e9423d3541","created_at":"2026-06-09T13:42:13.865Z","trace_propagation_headers":{"sentry-trace":"71c69d2b929d48e08f6f036738d48794-1944a7015de04850","baggage":"sentry-trace_id=71c69d2b929d48e08f6f036738d48794,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9X449B7DC6MY912SQMC3B","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:adeab03b45835b5084848be1a066e32d143d330be47e6c3dfee28754e6ec7cc7","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:13.888Z","job_size_bytes":451,"pid":2069,"sidekiq_tid":"m45x","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-6613dd19587f94e9423d3541: start","job_status":"start","queue_duration_s":0.002855,"scheduling_latency_s":0.002891}1673vm-test-run-nixbot-gitlab> gitlab # [  181.129571] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:13 +0000] "POST /api/v4/users/1/personal_access_tokens HTTP/1.1" 201 267 "" "curl/8.20.0" 5681674vm-test-run-nixbot-gitlab> gitlab # [  181.133504] setup-gitlab-start[2596]: + TOKEN=glpat-XaApOhwNYu2SCpHgX6iG_G86MQp1OjEH.01.0w1g1777c1675vm-test-run-nixbot-gitlab> gitlab # [  181.135585] setup-gitlab-start[2596]: + test -n glpat-XaApOhwNYu2SCpHgX6iG_G86MQp1OjEH.01.0w1g1777c1676vm-test-run-nixbot-gitlab> gitlab # [  181.138700] setup-gitlab-start[2596]: + test glpat-XaApOhwNYu2SCpHgX6iG_G86MQp1OjEH.01.0w1g1777c '!=' null1677vm-test-run-nixbot-gitlab> gitlab # [  181.140349] setup-gitlab-start[2596]: + mkdir -p /var/lib/secrets1678vm-test-run-nixbot-gitlab> gitlab # [  181.142168] setup-gitlab-start[2596]: + echo glpat-XaApOhwNYu2SCpHgX6iG_G86MQp1OjEH.01.0w1g1777c1679vm-test-run-nixbot-gitlab> gitlab # [  181.143993] setup-gitlab-start[2596]: + chmod 644 /var/lib/secrets/gitlab-token1680vm-test-run-nixbot-gitlab> gitlab # [  181.149546] setup-gitlab-start[2596]: + curl -fs -X POST -H 'PRIVATE-TOKEN: glpat-XaApOhwNYu2SCpHgX6iG_G86MQp1OjEH.01.0w1g1777c' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1681vm-test-run-nixbot-gitlab> gitlab # [  181.179877] sidekiq-cluster[2069]: {"severity":"WARN","time":"2026-06-09T13:42:14.006Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"6613dd19587f94e9423d3541","created_at":"2026-06-09T13:42:13.865Z","trace_propagation_headers":{"sentry-trace":"71c69d2b929d48e08f6f036738d48794-1944a7015de04850","baggage":"sentry-trace_id=71c69d2b929d48e08f6f036738d48794,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9X449B7DC6MY912SQMC3B","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:adeab03b45835b5084848be1a066e32d143d330be47e6c3dfee28754e6ec7cc7","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:13.888Z","job_size_bytes":451,"pid":2069,"sidekiq_tid":"m45x","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-6613dd19587f94e9423d3541: fail: 0.11417 sec","job_status":"fail","queue_duration_s":0.002855,"scheduling_latency_s":0.002891,"redis_calls":11,"redis_duration_s":0.004419,"redis_read_bytes":137,"redis_write_bytes":1317,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001079,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002709,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000631,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080922,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000356749,"duration_s":0.11417,"completed_at":"2026-06-09T13:42:14.005Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/profile.rb:99:in `access_token_created_email'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/abbaw4w9gll6p923md75p3h3rrmhrdqn-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/bqz31s23z0jk4464lbybyz83ikl0gmyd-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/wp2rnxa243q2gn2f8h04d48hnvfr0387-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/85h4805ad7n5qn7wq2m6icypga7rnk80-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.022182,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1682vm-test-run-nixbot-gitlab> gitlab # [  181.753089] gitaly[1382]: time="2026-06-09T13:42:14.484Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X4QF79JT8D1W65HG4EWD error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-09T13:42:24.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:14.483" pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1683vm-test-run-nixbot-gitlab> gitlab # [  181.754131] gitaly[1382]: time="2026-06-09T13:42:14.484Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X4QF79JT8D1W65HG4EWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-09T13:42:24.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:14.483" grpc.time_ms=0.336 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1684vm-test-run-nixbot-gitlab> gitlab # [  181.774104] gitaly[1382]: time="2026-06-09T13:42:14.601Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X4QF79JT8D1W65HG4EWD error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-09T13:42:24.120" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:14.600" pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1685vm-test-run-nixbot-gitlab> gitlab # [  181.775077] gitaly[1382]: time="2026-06-09T13:42:14.601Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X4QF79JT8D1W65HG4EWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-09T13:42:24.120" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:14.600" grpc.time_ms=0.299 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1686vm-test-run-nixbot-gitlab> gitlab # [  181.799507] gitaly[1382]: time="2026-06-09T13:42:14.626Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X4QF79JT8D1W65HG4EWD diskcache=7b8f4775-274e-4c72-9cfd-7b622305a7a7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-06-09T13:42:24.125" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:14.605" pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1687vm-test-run-nixbot-gitlab> gitlab # [  181.800366] gitaly[1382]: time="2026-06-09T13:42:14.626Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=323 command.oublock=32 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X4QF79JT8D1W65HG4EWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-06-09T13:42:24.125" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:14.605" grpc.time_ms=20.759 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1688vm-test-run-nixbot-gitlab> gitlab # [  181.816065] gitaly[1382]: time="2026-06-09T13:42:14.635Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X4QF79JT8D1W65HG4EWD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-09T13:42:24.154" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:14.634" pid=1382 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1689vm-test-run-nixbot-gitlab> gitlab # [  181.898341] gitaly[1382]: time="2026-06-09T13:42:14.635Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X4QF79JT8D1W65HG4EWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-09T13:42:24.154" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:14.634" grpc.time_ms=0.496 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1690vm-test-run-nixbot-gitlab> gitlab # [  181.899419] gitaly[1382]: time="2026-06-09T13:42:14.643Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X4QF79JT8D1W65HG4EWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-09T13:42:24.157" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:14.638" grpc.time_ms=5.644 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1691vm-test-run-nixbot-gitlab> gitlab # [  181.900114] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:14.657Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"d70951c7e50486d47fd225cd","created_at":"2026-06-09T13:42:14.649Z","trace_propagation_headers":{"sentry-trace":"d57013fbc8fb4317bf70f7ab397ea389-be88cb552cda450f","baggage":"sentry-trace_id=d57013fbc8fb4317bf70f7ab397ea389,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9X4QF79JT8D1W65HG4EWD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:14.656Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-d70951c7e50486d47fd225cd: start","job_status":"start","queue_duration_s":0.001528,"scheduling_latency_s":0.001576}1692vm-test-run-nixbot-gitlab> gitlab # [  181.901067] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:14.701Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"d70951c7e50486d47fd225cd","created_at":"2026-06-09T13:42:14.649Z","trace_propagation_headers":{"sentry-trace":"d57013fbc8fb4317bf70f7ab397ea389-be88cb552cda450f","baggage":"sentry-trace_id=d57013fbc8fb4317bf70f7ab397ea389,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9X4QF79JT8D1W65HG4EWD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:14.656Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-d70951c7e50486d47fd225cd: done: 0.043714 sec","job_status":"done","queue_duration_s":0.001528,"scheduling_latency_s":0.001576,"redis_calls":10,"redis_duration_s":0.002913,"redis_read_bytes":8,"redis_write_bytes":1165,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001944,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":7,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.024378797,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.043714,"completed_at":"2026-06-09T13:42:14.701Z","load_balancing_strategy":"primary","db_duration_s":0.007045,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1693vm-test-run-nixbot-gitlab> gitlab # [  182.005311] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:14.702Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"bc88c61d54485ba96da7cc9c","created_at":"2026-06-09T13:42:14.664Z","trace_propagation_headers":{"sentry-trace":"d57013fbc8fb4317bf70f7ab397ea389-be88cb552cda450f","baggage":"sentry-trace_id=d57013fbc8fb4317bf70f7ab397ea389,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9X4QF79JT8D1W65HG4EWD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:14.669Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-bc88c61d54485ba96da7cc9c: start","job_status":"start","queue_duration_s":0.033876,"scheduling_latency_s":0.033898}1694vm-test-run-nixbot-gitlab> gitlab # [  182.006940] gitaly[1382]: time="2026-06-09T13:42:14.672Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X4QF79JT8D1W65HG4EWD error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-09T13:42:24.192" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:14.672" pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1695vm-test-run-nixbot-gitlab> gitlab # [  182.007692] gitaly[1382]: time="2026-06-09T13:42:14.672Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X4QF79JT8D1W65HG4EWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-09T13:42:24.192" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:14.672" grpc.time_ms=0.219 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1696vm-test-run-nixbot-gitlab> gitlab # [  182.022547] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:14.789Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"bc88c61d54485ba96da7cc9c","created_at":"2026-06-09T13:42:14.664Z","trace_propagation_headers":{"sentry-trace":"d57013fbc8fb4317bf70f7ab397ea389-be88cb552cda450f","baggage":"sentry-trace_id=d57013fbc8fb4317bf70f7ab397ea389,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9X4QF79JT8D1W65HG4EWD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:14.669Z","job_size_bytes":2,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-bc88c61d54485ba96da7cc9c: done: 0.086329 sec","job_status":"done","queue_duration_s":0.033876,"scheduling_latency_s":0.033898,"redis_calls":14,"redis_duration_s":0.003837,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000688,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002046,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001103,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057426,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.065897202,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.086329,"completed_at":"2026-06-09T13:42:14.789Z","load_balancing_strategy":"primary","db_duration_s":0.014601,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1697vm-test-run-nixbot-gitlab> gitlab # [  182.114696] gitaly[1382]: time="2026-06-09T13:42:14.701Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X4QF79JT8D1W65HG4EWD diskcache=12e02bcc-d7c0-42f2-b016-9d5a9a6e61c3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-06-09T13:42:24.198" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:14.678" pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1698vm-test-run-nixbot-gitlab> gitlab # [  182.116079] gitaly[1382]: time="2026-06-09T13:42:14.701Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=325 command.oublock=32 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X4QF79JT8D1W65HG4EWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-06-09T13:42:24.198" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:14.678" grpc.time_ms=22.788 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1699vm-test-run-nixbot-gitlab> gitlab # [  182.190226] gitaly[1382]: time="2026-06-09T13:42:14.706Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X4QF79JT8D1W65HG4EWD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-09T13:42:24.226" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:14.706" pid=1382 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1700vm-test-run-nixbot-gitlab> gitlab # [  182.192132] gitaly[1382]: time="2026-06-09T13:42:14.706Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X4QF79JT8D1W65HG4EWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-09T13:42:24.226" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:14.706" grpc.time_ms=0.356 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1701vm-test-run-nixbot-gitlab> gitlab # [  182.193362] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:14.977Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"8e7638a435385d006b66fc62","created_at":"2026-06-09T13:42:14.887Z","trace_propagation_headers":{"sentry-trace":"d57013fbc8fb4317bf70f7ab397ea389-be88cb552cda450f","baggage":"sentry-trace_id=d57013fbc8fb4317bf70f7ab397ea389,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9X4QF79JT8D1W65HG4EWD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:14.893Z","job_size_bytes":5,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-8e7638a435385d006b66fc62: start","job_status":"start","queue_duration_s":0.084207,"scheduling_latency_s":0.084235}1702vm-test-run-nixbot-gitlab> gitlab # [  182.197086] gitaly[1382]: time="2026-06-09T13:42:14.715Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X4QF79JT8D1W65HG4EWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-09T13:42:24.229" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:14.709" grpc.time_ms=5.419 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1703vm-test-run-nixbot-gitlab> gitlab # [  182.273237] gitaly[1382]: time="2026-06-09T13:42:14.746Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X4QF79JT8D1W65HG4EWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-09T13:42:24.265" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:14.746" grpc.time_ms=0.135 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1704vm-test-run-nixbot-gitlab> gitlab # [  182.274454] gitaly[1382]: time="2026-06-09T13:42:14.758Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X4QF79JT8D1W65HG4EWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-06-09T13:42:24.277" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:14.758" grpc.time_ms=0.2 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1705vm-test-run-nixbot-gitlab> gitlab # [  182.276456] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:15.078Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"8e7638a435385d006b66fc62","created_at":"2026-06-09T13:42:14.887Z","trace_propagation_headers":{"sentry-trace":"d57013fbc8fb4317bf70f7ab397ea389-be88cb552cda450f","baggage":"sentry-trace_id=d57013fbc8fb4317bf70f7ab397ea389,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9X4QF79JT8D1W65HG4EWD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:14.893Z","job_size_bytes":5,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-8e7638a435385d006b66fc62: done: 0.100534 sec","job_status":"done","queue_duration_s":0.084207,"scheduling_latency_s":0.084235,"redis_calls":12,"redis_duration_s":0.0029720000000000002,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00068,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00177,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000522,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.073985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000375746,"duration_s":0.100534,"completed_at":"2026-06-09T13:42:15.078Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016887,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1706vm-test-run-nixbot-gitlab> gitlab # [  182.349391] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:15.079Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"70fa4f1a11970d7a5b7b368f","created_at":"2026-06-09T13:42:14.911Z","trace_propagation_headers":{"sentry-trace":"d57013fbc8fb4317bf70f7ab397ea389-be88cb552cda450f","baggage":"sentry-trace_id=d57013fbc8fb4317bf70f7ab397ea389,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9X4QF79JT8D1W65HG4EWD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:14.915Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-70fa4f1a11970d7a5b7b368f: start","job_status":"start","queue_duration_s":0.164464,"scheduling_latency_s":0.164486}1707vm-test-run-nixbot-gitlab> gitlab # [  182.350747] gitaly[1382]: time="2026-06-09T13:42:14.941Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X4QF79JT8D1W65HG4EWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-09T13:42:24.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:14.932" grpc.time_ms=7.141 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1708vm-test-run-nixbot-gitlab> gitlab # [  182.424861] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:15.217Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"70fa4f1a11970d7a5b7b368f","created_at":"2026-06-09T13:42:14.911Z","trace_propagation_headers":{"sentry-trace":"d57013fbc8fb4317bf70f7ab397ea389-be88cb552cda450f","baggage":"sentry-trace_id=d57013fbc8fb4317bf70f7ab397ea389,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9X4QF79JT8D1W65HG4EWD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:14.915Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-70fa4f1a11970d7a5b7b368f: done: 0.138203 sec","job_status":"done","queue_duration_s":0.164464,"scheduling_latency_s":0.164486,"redis_calls":11,"redis_duration_s":0.003017,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.0007,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001575,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000742,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.11,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.11,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092913,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000344458,"duration_s":0.138203,"completed_at":"2026-06-09T13:42:15.217Z","load_balancing_strategy":"primary","db_duration_s":0.047835,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1709vm-test-run-nixbot-gitlab> gitlab # [  182.496313] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:15.219Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"b86fe6064c8d663e168d8df6","created_at":"2026-06-09T13:42:14.917Z","trace_propagation_headers":{"sentry-trace":"d57013fbc8fb4317bf70f7ab397ea389-be88cb552cda450f","baggage":"sentry-trace_id=d57013fbc8fb4317bf70f7ab397ea389,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9X4QF79JT8D1W65HG4EWD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:14.920Z","job_size_bytes":89,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-b86fe6064c8d663e168d8df6: start","job_status":"start","queue_duration_s":0.29854,"scheduling_latency_s":0.298561}1710vm-test-run-nixbot-gitlab> gitlab # [  182.497158] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:15.262Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"b86fe6064c8d663e168d8df6","created_at":"2026-06-09T13:42:14.917Z","trace_propagation_headers":{"sentry-trace":"d57013fbc8fb4317bf70f7ab397ea389-be88cb552cda450f","baggage":"sentry-trace_id=d57013fbc8fb4317bf70f7ab397ea389,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9X4QF79JT8D1W65HG4EWD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:14.920Z","job_size_bytes":89,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-b86fe6064c8d663e168d8df6: done: 0.043483 sec","job_status":"done","queue_duration_s":0.29854,"scheduling_latency_s":0.298561,"redis_calls":11,"redis_duration_s":0.0023799999999999997,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000611,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001326,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000443,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000336914,"duration_s":0.043483,"completed_at":"2026-06-09T13:42:15.262Z","load_balancing_strategy":"primary","db_duration_s":0.014438,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1711vm-test-run-nixbot-gitlab> gitlab # [  182.600206] setup-gitlab-start[2596]: + mkdir -p /tmp/test-flake1712vm-test-run-nixbot-gitlab> gitlab # [  182.601535] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:15 +0000] "POST /api/v4/projects HTTP/1.1" 201 4795 "" "curl/8.20.0" 12981713vm-test-run-nixbot-gitlab> gitlab # [  182.606365] setup-gitlab-start[2596]: + cd /tmp/test-flake1714vm-test-run-nixbot-gitlab> gitlab # [  182.607728] setup-gitlab-start[2596]: + git init -b master1715vm-test-run-nixbot-gitlab> gitlab # [  182.622339] setup-gitlab-start[2896]: Initialized empty Git repository in /tmp/test-flake/.git/1716vm-test-run-nixbot-gitlab> gitlab # [  182.623401] setup-gitlab-start[2596]: + git config user.name test1717vm-test-run-nixbot-gitlab> gitlab # [  182.624556] setup-gitlab-start[2596]: + git config user.email test@example.com1718vm-test-run-nixbot-gitlab> gitlab # [  182.628654] setup-gitlab-start[2596]: + cat1719vm-test-run-nixbot-gitlab> gitlab # [  182.630282] setup-gitlab-start[2596]: + git add flake.nix1720vm-test-run-nixbot-gitlab> gitlab # [  182.633571] setup-gitlab-start[2596]: + git commit -m 'initial commit'1721vm-test-run-nixbot-gitlab> gitlab # [  182.647697] setup-gitlab-start[2901]: [master (root-commit) 06c7ffa] initial commit1722vm-test-run-nixbot-gitlab> gitlab # [  182.648733] setup-gitlab-start[2901]:  1 file changed, 10 insertions(+)1723vm-test-run-nixbot-gitlab> gitlab # [  182.649826] setup-gitlab-start[2901]:  create mode 100644 flake.nix1724vm-test-run-nixbot-gitlab> gitlab # [  182.652131] setup-gitlab-start[2596]: + git remote add origin http://oauth2:glpat-XaApOhwNYu2SCpHgX6iG_G86MQp1OjEH.01.0w1g1777c@gitlab/root/test-flake.git1725vm-test-run-nixbot-gitlab> gitlab # [  182.658305] setup-gitlab-start[2596]: + git push -u origin master1726vm-test-run-nixbot-gitlab> gitlab # [  182.745217] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:15 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 671727vm-test-run-nixbot-gitlab> gitlab # [  182.845445] gitaly[1382]: time="2026-06-09T13:42:15.672Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KTP9X68P66N1BH1FT0M6J59W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-09T13:42:15.658" grpc.time_ms=13.268 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1728vm-test-run-nixbot-gitlab> gitlab # [  182.849049] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:15 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.54.0" 1011729vm-test-run-nixbot-gitlab> gitlab # [  183.101443] gitaly[1382]: time="2026-06-09T13:42:15.928Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-09T13:42:25.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:15.918" grpc.time_ms=9.209 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1730vm-test-run-nixbot-gitlab> gitlab # [  183.184217] gitaly[1382]: time="2026-06-09T13:42:16.011Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-06-09T13:42:45.100" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-06-09T13:42:16.000" grpc.time_ms=9.877 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1731vm-test-run-nixbot-gitlab> gitlab # [  183.206772] gitaly[1382]: time="2026-06-09T13:42:16.033Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH duration_ms=172ns method=POST pid=1382 status=200 url="http://unix/api/v4/internal/allowed"1732vm-test-run-nixbot-gitlab> gitlab # [  183.245940] gitaly[1382]: time="2026-06-09T13:42:16.072Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH duration_ms=38ns method=POST pid=1382 status=200 url="http://unix/api/v4/internal/pre_receive"1733vm-test-run-nixbot-gitlab> gitlab # [  183.251392] gitaly[1382]: time="2026-06-09T13:42:16.078Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5322 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:15.859" grpc.time_ms=213.162 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1734vm-test-run-nixbot-gitlab> gitlab # [  183.297969] gitaly[1382]: time="2026-06-09T13:42:16.124Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4792 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:16.124" grpc.time_ms=0.5 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1735vm-test-run-nixbot-gitlab> gitlab # [  183.335803] gitaly[1382]: time="2026-06-09T13:42:16.162Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4791 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:16.162" grpc.time_ms=0.371 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1736vm-test-run-nixbot-gitlab> gitlab # [  183.370310] gitaly[1382]: time="2026-06-09T13:42:16.197Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4793 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:16.196" grpc.time_ms=0.312 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1737vm-test-run-nixbot-gitlab> gitlab # [  183.440208] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:16.266Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 06c7ffad34a79029e8eadb77646e80d813ce4fc8 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"1514c98e25c8f122cfaf12fa","created_at":"2026-06-09T13:42:16.259Z","trace_propagation_headers":{"sentry-trace":"1137540a40484c3087bdac2fffa07e6b-f1cce5903d3b4b84","baggage":"sentry-trace_id=1137540a40484c3087bdac2fffa07e6b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9X6D6H5WAX82TCHV9QDKH","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:16.264Z","job_size_bytes":185,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-1514c98e25c8f122cfaf12fa: start","job_status":"start","queue_duration_s":0.001613,"scheduling_latency_s":0.001649}1738vm-test-run-nixbot-gitlab> gitlab # [  183.468145] gitaly[1382]: time="2026-06-09T13:42:16.293Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=4 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-09T13:42:26.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:16.282" grpc.time_ms=11.825 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1739vm-test-run-nixbot-gitlab> gitlab # [  183.490065] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:16.312Z","message":"changes: \"0000000000000000000000000000000000000000 06c7ffad34a79029e8eadb77646e80d813ce4fc8 refs/heads/master\\n\""}1740vm-test-run-nixbot-gitlab> gitlab # [  183.494430] gitaly[1382]: time="2026-06-09T13:42:16.321Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1566 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=5 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-06-09T13:42:26.018" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:16.299" grpc.time_ms=20.139 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1741vm-test-run-nixbot-gitlab> gitlab # [  183.520502] gitaly[1382]: time="2026-06-09T13:42:16.332Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH duration_ms=97ns method=POST pid=1382 status=200 url="http://unix/api/v4/internal/post_receive"1742vm-test-run-nixbot-gitlab> gitlab # [  183.525694] gitaly[1382]: time="2026-06-09T13:42:16.332Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4816 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:16.233" grpc.time_ms=98.776 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1743vm-test-run-nixbot-gitlab> gitlab # [  183.542561] gitaly[1382]: time="2026-06-09T13:42:16.366Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-09T13:42:26.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:16.353" grpc.time_ms=12.056 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1744vm-test-run-nixbot-gitlab> gitlab # [  183.563372] gitaly[1382]: time="2026-06-09T13:42:16.369Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH diskcache=3fcfe975-e00f-4484-b4e3-0820db981900 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-09T13:42:15.794" pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1745vm-test-run-nixbot-gitlab> gitlab # [  183.564919] gitaly[1382]: time="2026-06-09T13:42:16.369Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=189 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13330 command.oublock=32 command.real_time_ms=545 command.spawn_token_fork_ms=2 command.system_time_ms=142 command.user_time_ms=47 component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-09T13:42:15.794" grpc.time_ms=574.51 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1746vm-test-run-nixbot-gitlab> gitlab # [  183.567499] setup-gitlab-start[2905]: To http://gitlab/root/test-flake.git1747vm-test-run-nixbot-gitlab> gitlab # [  183.568720] setup-gitlab-start[2905]:  * [new branch]      master -> master1748vm-test-run-nixbot-gitlab> gitlab # [  183.569902] gitlab-workhorse[1284]: time="2026-06-09T13:42:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521749vm-test-run-nixbot-gitlab> gitlab # [  183.570793] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:16 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 6511750vm-test-run-nixbot-gitlab> gitlab # [  183.571824] gitaly[1382]: time="2026-06-09T13:42:16.379Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-09T13:42:26.022" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:16.372" grpc.time_ms=6.532 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1751vm-test-run-nixbot-gitlab> gitlab # [  183.631399] setup-gitlab-start[2905]: branch 'master' set up to track 'origin/master'.1752vm-test-run-nixbot-gitlab> gitlab # [  183.635934] systemd[1]: Finished setup-gitlab.service.1753vm-test-run-nixbot-gitlab> gitlab # [  183.638438] gitaly[1382]: time="2026-06-09T13:42:16.465Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=54 command.spawn_token_fork_ms=47 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-06-09T13:42:26.057" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=226 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:16.408" grpc.time_ms=57.3 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1754vm-test-run-nixbot-gitlab> gitlab # [  183.639788] systemd[1]: Starting nixbot CI service...1755vm-test-run-nixbot-gitlab> gitlab # [  183.697420] gitaly[1382]: time="2026-06-09T13:42:16.524Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3942 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:16.524" grpc.time_ms=0.38 pid=1382 span.kind=server system=grpc1756vm-test-run-nixbot-gitlab> gitlab # [  183.733467] gitaly[1382]: time="2026-06-09T13:42:16.560Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3944 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:16.559" grpc.time_ms=0.771 pid=1382 span.kind=server system=grpc1757vm-test-run-nixbot-gitlab> gitlab # [  183.760090] gitaly[1382]: time="2026-06-09T13:42:16.587Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH diskcache=22c300df-ba78-4a5c-9c53-88116a6149df grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-09T13:42:26.150" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:16.501" pid=1382 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1758vm-test-run-nixbot-gitlab> gitlab # [  183.761263] gitaly[1382]: time="2026-06-09T13:42:16.587Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=59 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4795 command.oublock=8 command.real_time_ms=79 command.spawn_token_fork_ms=2 command.system_time_ms=41 command.user_time_ms=18 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-09T13:42:26.150" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:16.501" grpc.time_ms=85.958 pid=1382 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1759vm-test-run-nixbot-gitlab> gitlab # [  183.776512] gitaly[1382]: time="2026-06-09T13:42:16.603Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-09T13:42:26.252" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:16.603" grpc.time_ms=0.172 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1760vm-test-run-nixbot-gitlab> gitlab # [  183.789400] gitaly[1382]: time="2026-06-09T13:42:16.616Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=933 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-06-09T13:42:26.257" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:16.608" grpc.time_ms=8.024 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1761vm-test-run-nixbot-gitlab> gitlab # [  183.844877] gitaly[1382]: time="2026-06-09T13:42:16.671Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=338 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-06-09T13:42:46.067" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:16.667" grpc.time_ms=3.975 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1762vm-test-run-nixbot-gitlab> gitlab # [  183.871690] gitaly[1382]: time="2026-06-09T13:42:16.691Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-06-09T13:42:26.010" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:16.690" grpc.time_ms=0.197 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1763vm-test-run-nixbot-gitlab> gitlab # [  183.893176] gitaly[1382]: time="2026-06-09T13:42:16.720Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=342 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=18 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-06-09T13:42:26.012" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-06-09T13:42:16.692" grpc.time_ms=27.347 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1764vm-test-run-nixbot-gitlab> gitlab # [  183.932469] gitaly[1382]: time="2026-06-09T13:42:16.759Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-09T13:42:26.074" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:16.754" grpc.time_ms=4.928 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1765vm-test-run-nixbot-gitlab> gitlab # [  183.942454] gitaly[1382]: time="2026-06-09T13:42:16.769Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-09T13:42:26.083" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:16.764" grpc.time_ms=5.324 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766vm-test-run-nixbot-gitlab> gitlab # [  183.960236] gitaly[1382]: time="2026-06-09T13:42:16.787Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=961 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-06-09T13:42:46.177" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:16.778" grpc.time_ms=8.809 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1767vm-test-run-nixbot-gitlab> gitlab # [  184.225223] gitaly[1382]: time="2026-06-09T13:42:17.052Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-06-09T13:42:27.000" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:17.050" grpc.time_ms=1.154 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1768vm-test-run-nixbot-gitlab> gitlab # [  184.250679] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:17.077Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 06c7ffad34a79029e8eadb77646e80d813ce4fc8 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"1514c98e25c8f122cfaf12fa","created_at":"2026-06-09T13:42:16.259Z","trace_propagation_headers":{"sentry-trace":"1137540a40484c3087bdac2fffa07e6b-f1cce5903d3b4b84","baggage":"sentry-trace_id=1137540a40484c3087bdac2fffa07e6b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9X6D6H5WAX82TCHV9QDKH","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:16.264Z","job_size_bytes":185,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-1514c98e25c8f122cfaf12fa: done: 0.811158 sec","job_status":"done","queue_duration_s":0.001613,"scheduling_latency_s":0.001649,"gitaly_calls":13,"gitaly_duration_s":0.305543,"redis_calls":195,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.048438,"redis_read_bytes":1461,"redis_write_bytes":18934,"redis_cache_calls":14,"redis_cache_duration_s":0.003431,"redis_cache_read_bytes":16,"redis_cache_write_bytes":884,"redis_feature_flag_calls":28,"redis_feature_flag_duration_s":0.009546,"redis_feature_flag_read_bytes":1044,"redis_feature_flag_write_bytes":3487,"redis_queues_calls":8,"redis_queues_duration_s":0.001266,"redis_queues_read_bytes":8,"redis_queues_write_bytes":4932,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003333,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1259,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.01903,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.011832,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.201,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.216,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.402875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001142604,"exclusive_lock_hold_duration_s":0.046270685,"duration_s":0.811158,"completed_at":"2026-06-09T13:42:17.077Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.050203,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1769vm-test-run-nixbot-gitlab> gitlab # [  184.261233] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:17.078Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"1d156bbe79795bfa797e1f2b","created_at":"2026-06-09T13:42:16.382Z","trace_propagation_headers":{"sentry-trace":"1137540a40484c3087bdac2fffa07e6b-8ced9722172c4571","baggage":"sentry-trace_id=1137540a40484c3087bdac2fffa07e6b,sentry-release=Unknown"},"correlation_id":"01KTP9X6D6H5WAX82TCHV9QDKH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:16.388Z","job_size_bytes":46,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-1d156bbe79795bfa797e1f2b: start","job_status":"start","queue_duration_s":0.690224,"scheduling_latency_s":0.690245}1770vm-test-run-nixbot-gitlab> gitlab # [  184.329295] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:17.152Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"1d156bbe79795bfa797e1f2b","created_at":"2026-06-09T13:42:16.382Z","trace_propagation_headers":{"sentry-trace":"1137540a40484c3087bdac2fffa07e6b-8ced9722172c4571","baggage":"sentry-trace_id=1137540a40484c3087bdac2fffa07e6b,sentry-release=Unknown"},"correlation_id":"01KTP9X6D6H5WAX82TCHV9QDKH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:16.388Z","job_size_bytes":46,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-1d156bbe79795bfa797e1f2b: done: 0.073789 sec","job_status":"done","queue_duration_s":0.690224,"scheduling_latency_s":0.690245,"gitaly_calls":2,"gitaly_duration_s":0.017014,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.006517,"redis_read_bytes":68,"redis_write_bytes":4889,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001242,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000497,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001569,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002554,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":754,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000655,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000362057,"duration_s":0.073789,"completed_at":"2026-06-09T13:42:17.152Z","load_balancing_strategy":"primary","db_duration_s":0.008001,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1771vm-test-run-nixbot-gitlab> gitlab # [  184.423836] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:17.153Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"e74eaa73559510fa2d4f1e01","created_at":"2026-06-09T13:42:16.400Z","trace_propagation_headers":{"sentry-trace":"1137540a40484c3087bdac2fffa07e6b-8ced9722172c4571","baggage":"sentry-trace_id=1137540a40484c3087bdac2fffa07e6b,sentry-release=Unknown"},"correlation_id":"01KTP9X6D6H5WAX82TCHV9QDKH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:16.403Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-e74eaa73559510fa2d4f1e01: start","job_status":"start","queue_duration_s":0.749917,"scheduling_latency_s":0.749937}1772vm-test-run-nixbot-gitlab> gitlab # [  184.424912] gitaly[1382]: time="2026-06-09T13:42:17.117Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-06-09T19:42:17.112" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:17.113" grpc.time_ms=4.328 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1773vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for unit setup-gitlab.service, in 185.47 seconds)1774vm-test-run-nixbot-gitlab> gitlab: waiting for unit nixbot.service1775vm-test-run-nixbot-gitlab> gitlab # [  184.426341] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:17.221Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"e74eaa73559510fa2d4f1e01","created_at":"2026-06-09T13:42:16.400Z","trace_propagation_headers":{"sentry-trace":"1137540a40484c3087bdac2fffa07e6b-8ced9722172c4571","baggage":"sentry-trace_id=1137540a40484c3087bdac2fffa07e6b,sentry-release=Unknown"},"correlation_id":"01KTP9X6D6H5WAX82TCHV9QDKH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:16.403Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-e74eaa73559510fa2d4f1e01: done: 0.067552 sec","job_status":"done","queue_duration_s":0.749917,"scheduling_latency_s":0.749937,"gitaly_calls":1,"gitaly_duration_s":0.022003,"redis_calls":15,"redis_duration_s":0.0033539999999999998,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000394,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001336,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000585,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001039,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.047111574,"duration_s":0.067552,"completed_at":"2026-06-09T13:42:17.221Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010195,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1776vm-test-run-nixbot-gitlab> gitlab # [  184.500329] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:17.222Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"ebcdbf74253b396280762001","created_at":"2026-06-09T13:42:16.598Z","trace_propagation_headers":{"sentry-trace":"1137540a40484c3087bdac2fffa07e6b-8ced9722172c4571","baggage":"sentry-trace_id=1137540a40484c3087bdac2fffa07e6b,sentry-release=Unknown"},"correlation_id":"01KTP9X6D6H5WAX82TCHV9QDKH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:16.600Z","job_size_bytes":23,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ebcdbf74253b396280762001: start","job_status":"start","queue_duration_s":0.62203,"scheduling_latency_s":0.62206}1777vm-test-run-nixbot-gitlab> gitlab # [  184.501719] gitaly[1382]: time="2026-06-09T13:42:17.132Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-06-09T13:42:47.023" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:17.123" grpc.time_ms=8.486 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1778vm-test-run-nixbot-gitlab> gitlab # [  184.580230] gitaly[1382]: time="2026-06-09T13:42:17.193Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH diskcache=a592b731-f74a-44fe-86f9-e41a2a007307 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-06-09T19:42:17.172" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:17.173" pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1779vm-test-run-nixbot-gitlab> gitlab # [  184.581306] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:17.261Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"ebcdbf74253b396280762001","created_at":"2026-06-09T13:42:16.598Z","trace_propagation_headers":{"sentry-trace":"1137540a40484c3087bdac2fffa07e6b-8ced9722172c4571","baggage":"sentry-trace_id=1137540a40484c3087bdac2fffa07e6b,sentry-release=Unknown"},"correlation_id":"01KTP9X6D6H5WAX82TCHV9QDKH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:16.600Z","job_size_bytes":23,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ebcdbf74253b396280762001: done: 0.038755 sec","job_status":"done","queue_duration_s":0.62203,"scheduling_latency_s":0.62206,"gitaly_calls":1,"gitaly_duration_s":0.008625,"redis_calls":16,"redis_duration_s":0.00368,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000284,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001052,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001687,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000657,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038755,"completed_at":"2026-06-09T13:42:17.261Z","load_balancing_strategy":"primary","db_duration_s":0.002004,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1780vm-test-run-nixbot-gitlab> gitlab # [  184.646212] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:17.263Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"1689f352448378c308c07808","created_at":"2026-06-09T13:42:17.023Z","trace_propagation_headers":{"sentry-trace":"1137540a40484c3087bdac2fffa07e6b-8ced9722172c4571","baggage":"sentry-trace_id=1137540a40484c3087bdac2fffa07e6b,sentry-release=Unknown"},"correlation_id":"01KTP9X6D6H5WAX82TCHV9QDKH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5021ef58498911ba568911822bba0031fe4612fb6885fc31b947cd16da2e93cf","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:17.027Z","job_size_bytes":467,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-1689f352448378c308c07808: start","job_status":"start","queue_duration_s":0.235364,"scheduling_latency_s":0.23539}1781vm-test-run-nixbot-gitlab> gitlab # [  184.647427] gitaly[1382]: time="2026-06-09T13:42:17.193Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1284 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-06-09T19:42:17.172" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:17.173" grpc.time_ms=19.726 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1782vm-test-run-nixbot-gitlab> gitlab # [  184.652218] gitaly[1382]: time="2026-06-09T13:42:17.253Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-06-09T13:42:47.146" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:17.246" grpc.time_ms=6.465 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1783vm-test-run-nixbot-gitlab> gitlab # [  184.721286] gitaly[1382]: time="2026-06-09T13:42:17.297Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:42:47.196" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:17.296" grpc.time_ms=0.58 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1784vm-test-run-nixbot-gitlab> gitlab # [  184.722784] gitaly[1382]: time="2026-06-09T13:42:17.305Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-06-09T13:42:27.248" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:17.299" grpc.time_ms=5.976 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1785vm-test-run-nixbot-gitlab> gitlab # [  184.723886] gitaly[1382]: time="2026-06-09T13:42:17.384Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-09T13:42:47.282" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:17.382" grpc.time_ms=1.285 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1786vm-test-run-nixbot-gitlab> gitlab # [  184.730054] gitaly[1382]: time="2026-06-09T13:42:17.390Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=77 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-06-09T13:42:47.287" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:17.388" grpc.time_ms=2.236 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1787vm-test-run-nixbot-gitlab> gitlab # [  184.756337] gitaly[1382]: time="2026-06-09T13:42:17.571Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-09T13:42:27.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:17.565" grpc.time_ms=6.159 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1788vm-test-run-nixbot-gitlab> gitlab # [  185.177181] nixbot[2998]: {"ts": "2026-06-09T13:42:18.003Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1789vm-test-run-nixbot-gitlab> gitlab # [  185.219943] nixbot[2998]: {"ts": "2026-06-09T13:42:18.046Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1790vm-test-run-nixbot-gitlab> gitlab # [  185.247551] nixbot[2998]: {"ts": "2026-06-09T13:42:18.074Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1791vm-test-run-nixbot-gitlab> gitlab # [  185.256902] nixbot[2998]: {"ts": "2026-06-09T13:42:18.080Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1792vm-test-run-nixbot-gitlab> gitlab # [  185.261836] nixbot[2998]: {"ts": "2026-06-09T13:42:18.088Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1793vm-test-run-nixbot-gitlab> gitlab # [  185.271308] nixbot[2998]: {"ts": "2026-06-09T13:42:18.097Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1794vm-test-run-nixbot-gitlab> gitlab # [  185.274974] nixbot[2998]: {"ts": "2026-06-09T13:42:18.101Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1795vm-test-run-nixbot-gitlab> gitlab # [  185.280511] nixbot[2998]: {"ts": "2026-06-09T13:42:18.107Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1796vm-test-run-nixbot-gitlab> gitlab # [  185.290141] nixbot[2998]: {"ts": "2026-06-09T13:42:18.117Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1797vm-test-run-nixbot-gitlab> gitlab # [  185.293825] nixbot[2998]: {"ts": "2026-06-09T13:42:18.120Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1798vm-test-run-nixbot-gitlab> gitlab # [  185.301521] nixbot[2998]: {"ts": "2026-06-09T13:42:18.128Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1799vm-test-run-nixbot-gitlab> gitlab # [  185.308528] gitaly[1382]: time="2026-06-09T13:42:18.134Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=5 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-06-09T13:42:48.016" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:18.117" grpc.time_ms=16.977 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1800vm-test-run-nixbot-gitlab> gitlab # [  185.310384] nixbot[2998]: {"ts": "2026-06-09T13:42:18.135Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1801vm-test-run-nixbot-gitlab> gitlab # [  185.312546] nixbot[2998]: {"ts": "2026-06-09T13:42:18.139Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1802vm-test-run-nixbot-gitlab> gitlab # [  185.314742] nixbot[2998]: {"ts": "2026-06-09T13:42:18.141Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1803vm-test-run-nixbot-gitlab> gitlab # [  185.319136] nixbot[2998]: {"ts": "2026-06-09T13:42:18.146Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1804vm-test-run-nixbot-gitlab> gitlab # [  185.321527] nixbot[2998]: {"ts": "2026-06-09T13:42:18.148Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1805vm-test-run-nixbot-gitlab> gitlab # [  185.323200] gitaly[1382]: time="2026-06-09T13:42:18.149Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9X6D6H5WAX82TCHV9QDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-06-09T13:42:48.038" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:18.138" grpc.time_ms=10.426 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1806vm-test-run-nixbot-gitlab> gitlab # [  185.324446] nixbot[2998]: {"ts": "2026-06-09T13:42:18.151Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1807vm-test-run-nixbot-gitlab> gitlab # [  185.353946] sidekiq-cluster[2069]: {"severity":"WARN","time":"2026-06-09T13:42:18.180Z","class":"CreatePipelineWorker","correlation_id":"01KTP9X6D6H5WAX82TCHV9QDKH","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"06c7ffad34a79029e8eadb77646e80d813ce4fc8","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"06c7ffad34a79029e8eadb77646e80d813ce4fc8","ref":"refs/heads/master"},"retry":0}1808vm-test-run-nixbot-gitlab> gitlab # [  185.359655] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:18.186Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"1689f352448378c308c07808","created_at":"2026-06-09T13:42:17.023Z","trace_propagation_headers":{"sentry-trace":"1137540a40484c3087bdac2fffa07e6b-8ced9722172c4571","baggage":"sentry-trace_id=1137540a40484c3087bdac2fffa07e6b,sentry-release=Unknown"},"correlation_id":"01KTP9X6D6H5WAX82TCHV9QDKH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5021ef58498911ba568911822bba0031fe4612fb6885fc31b947cd16da2e93cf","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:17.027Z","job_size_bytes":467,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-1689f352448378c308c07808: done: 0.923465 sec","job_status":"done","queue_duration_s":0.235364,"scheduling_latency_s":0.23539,"gitaly_calls":7,"gitaly_duration_s":0.166733,"redis_calls":53,"redis_duration_s":0.011982,"redis_read_bytes":171,"redis_write_bytes":4427,"redis_cache_calls":4,"redis_cache_duration_s":0.00089,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.006637,"redis_feature_flag_read_bytes":18,"redis_feature_flag_write_bytes":2433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001322,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002263,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00087,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":43,"db_write_count":1,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":43,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.081,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":38,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.076,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.734969,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034334,"duration_s":0.923465,"completed_at":"2026-06-09T13:42:18.186Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.106986,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1809vm-test-run-nixbot-gitlab> gitlab # [  185.433119] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:18.187Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"77110018bc10f98aaf58d60c","created_at":"2026-06-09T13:42:17.139Z","trace_propagation_headers":{"sentry-trace":"1137540a40484c3087bdac2fffa07e6b-11f10bb2e17049c1","baggage":"sentry-trace_id=1137540a40484c3087bdac2fffa07e6b,sentry-release=Unknown"},"correlation_id":"01KTP9X6D6H5WAX82TCHV9QDKH","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:17.142Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-77110018bc10f98aaf58d60c: start","job_status":"start","queue_duration_s":1.044982,"scheduling_latency_s":1.045003}1810vm-test-run-nixbot-gitlab> gitlab # [  185.434258] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:18.222Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"77110018bc10f98aaf58d60c","created_at":"2026-06-09T13:42:17.139Z","trace_propagation_headers":{"sentry-trace":"1137540a40484c3087bdac2fffa07e6b-11f10bb2e17049c1","baggage":"sentry-trace_id=1137540a40484c3087bdac2fffa07e6b,sentry-release=Unknown"},"correlation_id":"01KTP9X6D6H5WAX82TCHV9QDKH","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:17.142Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-77110018bc10f98aaf58d60c: done: 0.034265 sec","job_status":"done","queue_duration_s":1.044982,"scheduling_latency_s":1.045003,"redis_calls":19,"redis_duration_s":0.00422,"redis_read_bytes":21,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000884,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000584,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002042,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00071,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006146871,"duration_s":0.034265,"completed_at":"2026-06-09T13:42:18.222Z","load_balancing_strategy":"primary","db_duration_s":0.00482,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1811vm-test-run-nixbot-gitlab> gitlab # [  185.514509] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:18.223Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"e545d52cd80b6524ba873779","created_at":"2026-06-09T13:42:18.211Z","trace_propagation_headers":{"sentry-trace":"1137540a40484c3087bdac2fffa07e6b-4cb961b763ca4e9c","baggage":"sentry-trace_id=1137540a40484c3087bdac2fffa07e6b,sentry-release=Unknown"},"correlation_id":"01KTP9X6D6H5WAX82TCHV9QDKH","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:18.215Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-e545d52cd80b6524ba873779: start","job_status":"start","queue_duration_s":0.007666,"scheduling_latency_s":0.007686}1812vm-test-run-nixbot-gitlab> gitlab # [  185.515818] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:18.286Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"e545d52cd80b6524ba873779","created_at":"2026-06-09T13:42:18.211Z","trace_propagation_headers":{"sentry-trace":"1137540a40484c3087bdac2fffa07e6b-4cb961b763ca4e9c","baggage":"sentry-trace_id=1137540a40484c3087bdac2fffa07e6b,sentry-release=Unknown"},"correlation_id":"01KTP9X6D6H5WAX82TCHV9QDKH","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:18.215Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-e545d52cd80b6524ba873779: done: 0.063002 sec","job_status":"done","queue_duration_s":0.007666,"scheduling_latency_s":0.007686,"redis_calls":11,"redis_duration_s":0.0036539999999999997,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000412,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00189,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001352,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000345016,"duration_s":0.063002,"completed_at":"2026-06-09T13:42:18.286Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015504,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1813vm-test-run-nixbot-gitlab> gitlab # [  185.858844] nixbot[2998]: INFO:     Started server process [2998]1814vm-test-run-nixbot-gitlab> gitlab # [  185.862173] nixbot[2998]: INFO:     Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1815vm-test-run-nixbot-gitlab> gitlab # [  185.865425] nixbot[2998]: INFO:     ::ffff:127.0.0.1:33962 - "GET /health HTTP/1.1" 200 OK1816vm-test-run-nixbot-gitlab> gitlab # [  185.872852] systemd[1]: Started nixbot CI service.1817vm-test-run-nixbot-gitlab> gitlab # [  185.876958] systemd[1]: Reached target Multi-User System.1818vm-test-run-nixbot-gitlab> gitlab # [  185.880387] systemd[1]: Startup finished in 1.307s (kernel) + 3.861s (initrd) + 3min 710ms (userspace) = 3min 5.880s.1819vm-test-run-nixbot-gitlab> gitlab # [  186.291821] gitaly[1382]: time="2026-06-09T13:42:19.117Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9X9ABZ9Z2F2KFSVYSHE8F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-06-09T13:42:49.097" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:19.097" grpc.time_ms=20.125 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1820vm-test-run-nixbot-gitlab> gitlab # [  186.652191] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:19 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 7781821vm-test-run-nixbot-gitlab> gitlab # [  186.654408] nixbot[2998]: {"ts": "2026-06-09T13:42:19.479Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1822vm-test-run-nixbot-gitlab> gitlab # [  186.661787] nixbot[2998]: {"ts": "2026-06-09T13:42:19.488Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1823vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for unit nixbot.service, in 2.06 seconds)1824vm-test-run-nixbot-gitlab> gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1825vm-test-run-nixbot-gitlab> gitlab # [  186.722201] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 501826vm-test-run-nixbot-gitlab> gitlab # [  186.730572] nixbot[2998]: {"ts": "2026-06-09T13:42:19.549Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1827vm-test-run-nixbot-gitlab> gitlab # [  186.733080] nixbot[2998]: {"ts": "2026-06-09T13:42:19.550Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1828vm-test-run-nixbot-gitlab> gitlab # [  186.760507] nixbot[2998]: INFO:     ::ffff:127.0.0.1:33968 - "GET /health HTTP/1.1" 200 OK1829vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1830vm-test-run-nixbot-gitlab> subtest: project discovered and webhook registered1831vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1832vm-test-run-nixbot-gitlab> gitlab # [  186.812527] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 868 "" "python-httpx/0.28.1" 861833vm-test-run-nixbot-gitlab> gitlab # [  186.820943] nixbot[2998]: {"ts": "2026-06-09T13:42:19.647Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1834vm-test-run-nixbot-gitlab> gitlab # [  186.884369] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "curl/8.20.0" 941835vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.13 seconds)1836vm-test-run-nixbot-gitlab> [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-06-09T13:42:19.627Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]1837vm-test-run-nixbot-gitlab> (finished: subtest: project discovered and webhook registered, in 0.13 seconds)1838vm-test-run-nixbot-gitlab> subtest: push delivers the webhook1839vm-test-run-nixbot-gitlab> gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1840vm-test-run-nixbot-gitlab> gitlab # [  186.955855] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:19 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 271841vm-test-run-nixbot-gitlab> gitlab # [  186.968872] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:19 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 1411842vm-test-run-nixbot-gitlab> gitlab # [  186.970462] nixbot[2998]: {"ts": "2026-06-09T13:42:19.796Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1843vm-test-run-nixbot-gitlab> gitlab # [  187.032246] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "python-httpx/0.28.1" 521844vm-test-run-nixbot-gitlab> gitlab # [  187.034828] nixbot[2998]: {"ts": "2026-06-09T13:42:19.860Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1845vm-test-run-nixbot-gitlab> gitlab # [  187.055982] gitaly[1382]: time="2026-06-09T13:42:19.882Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XACF74P6DRFMHH66DXFQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-09T13:42:19.854" grpc.time_ms=27.951 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1846vm-test-run-nixbot-gitlab> gitlab # [  187.083711] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:19 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 868 "" "python-httpx/0.28.1" 471847vm-test-run-nixbot-gitlab> gitlab # [  187.085118] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:19 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.54.0" 1201848vm-test-run-nixbot-gitlab> gitlab # [  187.091126] nixbot[2998]: {"ts": "2026-06-09T13:42:19.917Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1849vm-test-run-nixbot-gitlab> gitlab # Enumerating objects: 5, done.1850vm-test-run-nixbot-gitlab> gitlab # Counting objects:  20% (1/5)Counting objects:  40% (2/5)Counting objects:  60% (3/5)Counting objects:  80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1851vm-test-run-nixbot-gitlab> gitlab # Delta compression using up to 4 threads1852vm-test-run-nixbot-gitlab> gitlab # Compressing objects:  50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1853vm-test-run-nixbot-gitlab> gitlab # Writing objects:  33% (1/3)Writing objects:  66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 136.00 KiB/s, done.1854vm-test-run-nixbot-gitlab> gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1855vm-test-run-nixbot-gitlab> gitlab # [  187.136811] gitaly[1382]: time="2026-06-09T13:42:19.963Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XAGJH3FPPNHSS0YQY4JR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-06-09T13:42:49.056" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:19.956" grpc.time_ms=6.842 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1856vm-test-run-nixbot-gitlab> gitlab # [  187.163583] gitaly[1382]: time="2026-06-09T13:42:19.990Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XAGJH3FPPNHSS0YQY4JR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:42:49.088" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:19.988" grpc.time_ms=1.607 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1857vm-test-run-nixbot-gitlab> gitlab # [  187.183928] gitaly[1382]: time="2026-06-09T13:42:20.002Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XAGJH3FPPNHSS0YQY4JR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-06-09T13:42:29.002" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:19.993" grpc.time_ms=9.199 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1858vm-test-run-nixbot-gitlab> gitlab # [  187.229194] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:20 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 731 "" "python-httpx/0.28.1" 1331859vm-test-run-nixbot-gitlab> gitlab # [  187.232100] nixbot[2998]: {"ts": "2026-06-09T13:42:20.058Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1860vm-test-run-nixbot-gitlab> gitlab # [  187.283566] gitaly[1382]: time="2026-06-09T13:42:20.110Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-06-09T13:42:30.009" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=253 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:20.100" grpc.time_ms=9.422 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1861vm-test-run-nixbot-gitlab> gitlab # [  187.305475] nixbot[2998]: {"ts": "2026-06-09T13:42:20.120Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1862vm-test-run-nixbot-gitlab> gitlab # [  187.309991] nixbot[2998]: {"ts": "2026-06-09T13:42:20.126Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1863vm-test-run-nixbot-gitlab> gitlab # [  187.314309] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:20 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 591864vm-test-run-nixbot-gitlab> gitlab # [  187.321689] gitaly[1382]: time="2026-06-09T13:42:20.148Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=332 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-06-09T13:42:50.040" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-06-09T13:42:20.141" grpc.time_ms=7.493 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1865vm-test-run-nixbot-gitlab> gitlab # [  187.344515] gitaly[1382]: time="2026-06-09T13:42:20.165Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M duration_ms=112ns method=POST pid=1382 status=200 url="http://unix/api/v4/internal/allowed"1866vm-test-run-nixbot-gitlab> gitlab # [  187.371088] gitaly[1382]: time="2026-06-09T13:42:20.197Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M duration_ms=31ns method=POST pid=1382 status=200 url="http://unix/api/v4/internal/pre_receive"1867vm-test-run-nixbot-gitlab> gitlab # [  187.375931] gitaly[1382]: time="2026-06-09T13:42:20.197Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5322 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:20.052" grpc.time_ms=144.995 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1868vm-test-run-nixbot-gitlab> gitlab # [  187.412892] gitaly[1382]: time="2026-06-09T13:42:20.239Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XAR1S8ZNEHCG5XHR0ZWS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-09T13:42:20.231" grpc.time_ms=7.755 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc1869vm-test-run-nixbot-gitlab> gitlab # [  187.416118] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 801870vm-test-run-nixbot-gitlab> gitlab # [  187.427743] gitaly[1382]: time="2026-06-09T13:42:20.254Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4792 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:20.252" grpc.time_ms=0.36 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1871vm-test-run-nixbot-gitlab> gitlab # [  187.489706] gitaly[1382]: time="2026-06-09T13:42:20.316Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4791 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:20.316" grpc.time_ms=0.435 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1872vm-test-run-nixbot-gitlab> gitlab # [  187.530829] gitaly[1382]: time="2026-06-09T13:42:20.357Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XATN0E29T5S5TDCHS60H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-09T13:42:20.344" pid=1382 remote_ip="2001:db8:1::1" request_sha=083c43590fffa527704b32b8836424e8ed055017 response_bytes=149 span.kind=server system=grpc1873vm-test-run-nixbot-gitlab> gitlab # [  187.533152] gitaly[1382]: time="2026-06-09T13:42:20.357Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XATN0E29T5S5TDCHS60H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-09T13:42:20.344" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc1874vm-test-run-nixbot-gitlab> gitlab # [  187.535866] gitlab-workhorse[1284]: time="2026-06-09T13:42:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1491875vm-test-run-nixbot-gitlab> gitlab # [  187.536670] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 149 "" "git/2.54.0" 1141876vm-test-run-nixbot-gitlab> gitlab # [  187.538851] gitaly[1382]: time="2026-06-09T13:42:20.358Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XATN0E29T5S5TDCHS60H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-09T13:42:20.344" grpc.time_ms=13.913 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc1877vm-test-run-nixbot-gitlab> gitlab # [  187.541656] gitaly[1382]: time="2026-06-09T13:42:20.367Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4793 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:20.366" grpc.time_ms=1.416 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1878vm-test-run-nixbot-gitlab> gitlab # [  187.683516] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:20.509Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","06c7ffad34a79029e8eadb77646e80d813ce4fc8 b4642d6abb5e0d622e301707a53f12f3a4185116 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"8aee71fcbbf914a20e55baab","created_at":"2026-06-09T13:42:20.485Z","trace_propagation_headers":{"sentry-trace":"c64111c9a91249beb0723c86f7aaf6a9-b2bd01442b134dcf","baggage":"sentry-trace_id=c64111c9a91249beb0723c86f7aaf6a9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9XAGZM16XTT0MAC3TGV0M","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:20.495Z","job_size_bytes":185,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-8aee71fcbbf914a20e55baab: start","job_status":"start","queue_duration_s":0.013779,"scheduling_latency_s":0.013814}1879vm-test-run-nixbot-gitlab> gitlab # [  187.718738] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:20.545Z","message":"changes: \"06c7ffad34a79029e8eadb77646e80d813ce4fc8 b4642d6abb5e0d622e301707a53f12f3a4185116 refs/heads/master\\n\""}1880vm-test-run-nixbot-gitlab> gitlab # [  187.727985] gitaly[1382]: time="2026-06-09T13:42:20.550Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M duration_ms=151ns method=POST pid=1382 status=200 url="http://unix/api/v4/internal/post_receive"1881vm-test-run-nixbot-gitlab> gitlab # [  187.728990] gitaly[1382]: time="2026-06-09T13:42:20.551Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4816 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:20.397" grpc.time_ms=154.062 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1882vm-test-run-nixbot-gitlab> gitlab # [  187.756682] gitaly[1382]: time="2026-06-09T13:42:20.582Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-09T13:42:30.015" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:20.575" grpc.time_ms=7.255 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1883vm-test-run-nixbot-gitlab> gitlab # [  187.757805] gitaly[1382]: time="2026-06-09T13:42:20.582Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M diskcache=6f102fd0-06de-439b-9790-2cf7fbe8a642 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-09T13:42:19.989" pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1884vm-test-run-nixbot-gitlab> gitlab # [  187.758929] gitlab-workhorse[1284]: time="2026-06-09T13:42:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521885vm-test-run-nixbot-gitlab> gitlab # [  187.759987] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:20 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 6481886vm-test-run-nixbot-gitlab> gitlab # [  187.761192] gitaly[1382]: time="2026-06-09T13:42:20.583Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=189 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13110 command.oublock=32 command.real_time_ms=569 command.spawn_token_fork_ms=1 command.system_time_ms=149 command.user_time_ms=40 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-09T13:42:19.989" grpc.time_ms=593.924 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1887vm-test-run-nixbot-gitlab> gitlab # [  187.771717] gitaly[1382]: time="2026-06-09T13:42:20.598Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XB0VCEN24WYYAVKVD79Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-09T13:42:20.563" pid=1382 remote_ip="2001:db8:1::1" request_sha=b3266f694038ca763345ac0ce0b9d32afd496cca response_bytes=592 span.kind=server system=grpc1888vm-test-run-nixbot-gitlab> gitlab # [  187.774210] gitaly[1382]: time="2026-06-09T13:42:20.598Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1206 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XB0VCEN24WYYAVKVD79Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-09T13:42:20.563" negotiation.command=fetch negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc1889vm-test-run-nixbot-gitlab> gitlab # [  187.787139] gitlab-workhorse[1284]: time="2026-06-09T13:42:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=5921890vm-test-run-nixbot-gitlab> gitlab # [  187.790218] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 592 "" "git/2.54.0" 1561891vm-test-run-nixbot-gitlab> gitlab # [  187.793246] gitaly[1382]: time="2026-06-09T13:42:20.599Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1206 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XB0VCEN24WYYAVKVD79Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=9 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-09T13:42:20.563" grpc.time_ms=35.41 negotiation.command=fetch negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc1892vm-test-run-nixbot-gitlab> gitlab # [  187.860445] gitaly[1382]: time="2026-06-09T13:42:20.600Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-09T13:42:30.029" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:20.589" grpc.time_ms=10.747 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1893vm-test-run-nixbot-gitlab> gitlab # [  187.900434] gitaly[1382]: time="2026-06-09T13:42:20.727Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=111 command.spawn_token_fork_ms=109 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-06-09T13:42:30.054" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:20.614" grpc.time_ms=112.585 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1894vm-test-run-nixbot-gitlab> gitlab # [  187.913063] gitaly[1382]: time="2026-06-09T13:42:20.740Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=655 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-06-09T13:42:50.632" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:20.732" grpc.time_ms=7.357 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1895vm-test-run-nixbot-gitlab> gitlab # [  187.926105] gitaly[1382]: time="2026-06-09T13:42:20.752Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=346 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-06-09T13:42:30.188" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-06-09T13:42:20.748" grpc.time_ms=4.121 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1896vm-test-run-nixbot-gitlab> gitlab # [  187.943157] gitaly[1382]: time="2026-06-09T13:42:20.770Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-09T13:42:30.202" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:20.762" grpc.time_ms=7.556 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1897vm-test-run-nixbot-gitlab> gitlab # To http://gitlab/root/test-flake.git1898vm-test-run-nixbot-gitlab> gitlab #    06c7ffa..b4642d6  master -> master1899vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.12 seconds)1900vm-test-run-nixbot-gitlab> gitlab: must succeed: git -C /tmp/test-flake rev-parse master1901vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1902vm-test-run-nixbot-gitlab> gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b4642d6abb5e0d622e301707a53f12f3a4185116'1903vm-test-run-nixbot-gitlab> gitlab # [  188.044818] nixbot[2998]: INFO:     ::ffff:127.0.0.1:33970 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b4642d6abb5e0d622e301707a53f12f3a4185116 HTTP/1.1" 200 OK1904vm-test-run-nixbot-gitlab> gitlab # [  188.047403] gitaly[1382]: time="2026-06-09T13:42:20.871Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XBANNDMM75FJK91GCZ7F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=200 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-09T13:42:20.862" grpc.time_ms=9.161 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc1905vm-test-run-nixbot-gitlab> gitlab # [  188.050223] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 1151906vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b4642d6abb5e0d622e301707a53f12f3a4185116', in 0.05 seconds)1907vm-test-run-nixbot-gitlab> []1908vm-test-run-nixbot-gitlab> gitlab # [  188.127708] gitaly[1382]: time="2026-06-09T13:42:20.954Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XBEFYRK83VSB6BG023P2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-09T13:42:20.944" pid=1382 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc1909vm-test-run-nixbot-gitlab> gitlab # [  188.129776] gitaly[1382]: time="2026-06-09T13:42:20.954Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XBEFYRK83VSB6BG023P2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-09T13:42:20.944" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc1910vm-test-run-nixbot-gitlab> gitlab # [  188.131163] gitlab-workhorse[1284]: time="2026-06-09T13:42:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671911vm-test-run-nixbot-gitlab> gitlab # [  188.132510] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 551912vm-test-run-nixbot-gitlab> gitlab # [  188.134731] gitaly[1382]: time="2026-06-09T13:42:20.955Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XBEFYRK83VSB6BG023P2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-09T13:42:20.944" grpc.time_ms=10.354 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc1913vm-test-run-nixbot-gitlab> gitlab # [  188.209292] gitaly[1382]: time="2026-06-09T13:42:21.036Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-06-09T13:42:31.004" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:21.034" grpc.time_ms=1.255 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1914vm-test-run-nixbot-gitlab> gitlab # [  188.214142] gitaly[1382]: time="2026-06-09T13:42:21.041Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XBHW6Y7HFQFV41F9DR1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:42:51.039" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:21.040" grpc.time_ms=0.64 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1915vm-test-run-nixbot-gitlab> gitlab # [  188.244842] gitaly[1382]: time="2026-06-09T13:42:21.071Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XBHW6Y7HFQFV41F9DR1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-06-09T13:42:51.064" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:21.064" grpc.time_ms=6.981 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1916vm-test-run-nixbot-gitlab> gitlab # [  188.259085] gitaly[1382]: time="2026-06-09T13:42:21.086Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XBHW6Y7HFQFV41F9DR1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-09T13:42:31.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:21.080" grpc.time_ms=5.437 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1917vm-test-run-nixbot-gitlab> gitlab # [  188.303299] gitaly[1382]: time="2026-06-09T13:42:21.129Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XBHW6Y7HFQFV41F9DR1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-06-09T13:42:31.059" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:21.129" grpc.time_ms=0.189 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1918vm-test-run-nixbot-gitlab> gitlab # [  188.311683] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:21.138Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","06c7ffad34a79029e8eadb77646e80d813ce4fc8 b4642d6abb5e0d622e301707a53f12f3a4185116 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"8aee71fcbbf914a20e55baab","created_at":"2026-06-09T13:42:20.485Z","trace_propagation_headers":{"sentry-trace":"c64111c9a91249beb0723c86f7aaf6a9-b2bd01442b134dcf","baggage":"sentry-trace_id=c64111c9a91249beb0723c86f7aaf6a9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9XAGZM16XTT0MAC3TGV0M","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-06-09T13:42:20.495Z","job_size_bytes":185,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-8aee71fcbbf914a20e55baab: done: 0.629214 sec","job_status":"done","queue_duration_s":0.013779,"scheduling_latency_s":0.013814,"gitaly_calls":7,"gitaly_duration_s":0.178438,"redis_calls":124,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.052610000000000004,"redis_read_bytes":1124,"redis_write_bytes":14278,"redis_cache_calls":9,"redis_cache_duration_s":0.002161,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_feature_flag_calls":14,"redis_feature_flag_duration_s":0.011886,"redis_feature_flag_read_bytes":776,"redis_feature_flag_write_bytes":1535,"redis_queues_calls":8,"redis_queues_duration_s":0.001259,"redis_queues_read_bytes":8,"redis_queues_write_bytes":6766,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.017031,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1182,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.00774,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.012533,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":32,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":32,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.106,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.014,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.014,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.106,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.230494,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00349849,"exclusive_lock_hold_duration_s":0.0250814,"duration_s":0.629214,"completed_at":"2026-06-09T13:42:21.138Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.117945,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1919vm-test-run-nixbot-gitlab> gitlab # [  188.392906] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:21.140Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"02ff9a51f5abe907280ccf20","created_at":"2026-06-09T13:42:20.602Z","trace_propagation_headers":{"sentry-trace":"c64111c9a91249beb0723c86f7aaf6a9-9a224c5d0ab34175","baggage":"sentry-trace_id=c64111c9a91249beb0723c86f7aaf6a9,sentry-release=Unknown"},"correlation_id":"01KTP9XAGZM16XTT0MAC3TGV0M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:20.604Z","job_size_bytes":46,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-02ff9a51f5abe907280ccf20: start","job_status":"start","queue_duration_s":0.535968,"scheduling_latency_s":0.535994}1920vm-test-run-nixbot-gitlab> gitlab # [  188.394150] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:21.160Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"02ff9a51f5abe907280ccf20","created_at":"2026-06-09T13:42:20.602Z","trace_propagation_headers":{"sentry-trace":"c64111c9a91249beb0723c86f7aaf6a9-9a224c5d0ab34175","baggage":"sentry-trace_id=c64111c9a91249beb0723c86f7aaf6a9,sentry-release=Unknown"},"correlation_id":"01KTP9XAGZM16XTT0MAC3TGV0M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:20.604Z","job_size_bytes":46,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-02ff9a51f5abe907280ccf20: done: 0.019769 sec","job_status":"done","queue_duration_s":0.535968,"scheduling_latency_s":0.535994,"redis_calls":9,"redis_duration_s":0.003008,"redis_read_bytes":23,"redis_write_bytes":782,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00174,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000318,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":304,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019769,"completed_at":"2026-06-09T13:42:21.160Z","load_balancing_strategy":"primary","db_duration_s":0.002146,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1921vm-test-run-nixbot-gitlab> gitlab # [  188.486406] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:21.161Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"faf6e398705835e6eecdcd82","created_at":"2026-06-09T13:42:20.608Z","trace_propagation_headers":{"sentry-trace":"c64111c9a91249beb0723c86f7aaf6a9-9a224c5d0ab34175","baggage":"sentry-trace_id=c64111c9a91249beb0723c86f7aaf6a9,sentry-release=Unknown"},"correlation_id":"01KTP9XAGZM16XTT0MAC3TGV0M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:20.610Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-faf6e398705835e6eecdcd82: start","job_status":"start","queue_duration_s":0.551569,"scheduling_latency_s":0.551591}1922vm-test-run-nixbot-gitlab> gitlab # [  188.487991] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:21.296Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"faf6e398705835e6eecdcd82","created_at":"2026-06-09T13:42:20.608Z","trace_propagation_headers":{"sentry-trace":"c64111c9a91249beb0723c86f7aaf6a9-9a224c5d0ab34175","baggage":"sentry-trace_id=c64111c9a91249beb0723c86f7aaf6a9,sentry-release=Unknown"},"correlation_id":"01KTP9XAGZM16XTT0MAC3TGV0M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:20.610Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-faf6e398705835e6eecdcd82: done: 0.134372 sec","job_status":"done","queue_duration_s":0.551569,"scheduling_latency_s":0.551591,"gitaly_calls":1,"gitaly_duration_s":0.105928,"redis_calls":12,"redis_duration_s":0.0028380000000000002,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001138,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000613,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001087,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.117461018,"duration_s":0.134372,"completed_at":"2026-06-09T13:42:21.295Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004667,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1923vm-test-run-nixbot-gitlab> gitlab # [  188.560166] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:21.297Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"74e13df538aef9e9fabb53b6","created_at":"2026-06-09T13:42:20.802Z","trace_propagation_headers":{"sentry-trace":"c64111c9a91249beb0723c86f7aaf6a9-9a224c5d0ab34175","baggage":"sentry-trace_id=c64111c9a91249beb0723c86f7aaf6a9,sentry-release=Unknown"},"correlation_id":"01KTP9XAGZM16XTT0MAC3TGV0M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:793dd469ac3ae1c2a0bf6c36fafac85f09d6e4aec0adb03b9d7a3d298896d768","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:20.804Z","job_size_bytes":467,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-74e13df538aef9e9fabb53b6: start","job_status":"start","queue_duration_s":0.493386,"scheduling_latency_s":0.493407}1924vm-test-run-nixbot-gitlab> gitlab # [  188.561540] gitaly[1382]: time="2026-06-09T13:42:21.281Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M diskcache=ce3e2c6b-5b5f-4152-8240-351cec896470 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-06-09T19:42:21.177" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:21.178" pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1925vm-test-run-nixbot-gitlab> gitlab # [  188.562512] gitaly[1382]: time="2026-06-09T13:42:21.281Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=5 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1642 command.oublock=0 command.real_time_ms=184 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-06-09T19:42:21.177" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:21.178" grpc.time_ms=103.714 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1926vm-test-run-nixbot-gitlab> gitlab # [  188.634092] gitaly[1382]: time="2026-06-09T13:42:21.319Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:42:51.218" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:21.318" grpc.time_ms=0.705 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1927vm-test-run-nixbot-gitlab> gitlab # [  188.635272] gitaly[1382]: time="2026-06-09T13:42:21.326Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-06-09T13:42:31.291" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:21.321" grpc.time_ms=5.016 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1928vm-test-run-nixbot-gitlab> gitlab # [  188.636119] gitaly[1382]: time="2026-06-09T13:42:21.351Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-09T13:42:51.250" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:21.350" grpc.time_ms=0.681 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1929vm-test-run-nixbot-gitlab> gitlab # [  188.643109] gitaly[1382]: time="2026-06-09T13:42:21.357Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=326 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-06-09T13:42:51.254" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:21.354" grpc.time_ms=3.205 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1930vm-test-run-nixbot-gitlab> gitlab # [  188.714850] gitaly[1382]: time="2026-06-09T13:42:21.394Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-09T13:42:31.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:21.388" grpc.time_ms=6.129 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1931vm-test-run-nixbot-gitlab> gitlab # [  188.770098] gitaly[1382]: time="2026-06-09T13:42:21.597Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XBHW6Y7HFQFV41F9DR1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-06-09T13:42:31.001" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:21.591" grpc.time_ms=5.405 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1932vm-test-run-nixbot-gitlab> gitlab # [  188.820991] gitaly[1382]: time="2026-06-09T13:42:21.647Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9XBHW6Y7HFQFV41F9DR1H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4159 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:21.647" grpc.time_ms=0.353 pid=1382 span.kind=server system=grpc1933vm-test-run-nixbot-gitlab> gitlab # [  188.854702] gitaly[1382]: time="2026-06-09T13:42:21.681Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9XBHW6Y7HFQFV41F9DR1H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4161 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:21.681" grpc.time_ms=0.42 pid=1382 span.kind=server system=grpc1934vm-test-run-nixbot-gitlab> gitlab # [  188.877260] gitaly[1382]: time="2026-06-09T13:42:21.704Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XBHW6Y7HFQFV41F9DR1H diskcache=42dd409c-a1a6-4cb7-b676-4e46026ecc73 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-09T13:42:31.028" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:21.618" pid=1382 ref=refs/keep-around/06c7ffad34a79029e8eadb77646e80d813ce4fc8 remote_ip="2001:db8:1::1" revision=06c7ffad34a79029e8eadb77646e80d813ce4fc8 span.kind=server system=grpc username=root1935vm-test-run-nixbot-gitlab> gitlab # [  188.895462] gitaly[1382]: time="2026-06-09T13:42:21.722Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=59 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5350 command.oublock=8 command.real_time_ms=79 command.spawn_token_fork_ms=0 command.system_time_ms=39 command.user_time_ms=20 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XBHW6Y7HFQFV41F9DR1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-09T13:42:31.028" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:21.618" grpc.time_ms=85.566 pid=1382 ref=refs/keep-around/06c7ffad34a79029e8eadb77646e80d813ce4fc8 remote_ip="2001:db8:1::1" revision=06c7ffad34a79029e8eadb77646e80d813ce4fc8 span.kind=server system=grpc username=root1936vm-test-run-nixbot-gitlab> gitlab # [  188.900619] gitaly[1382]: time="2026-06-09T13:42:21.727Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XBHW6Y7HFQFV41F9DR1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:42:51.726" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:21.727" grpc.time_ms=0.39 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1937vm-test-run-nixbot-gitlab> gitlab # [  188.998157] gitaly[1382]: time="2026-06-09T13:42:21.825Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=960 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-06-09T13:42:51.715" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:21.815" grpc.time_ms=9.067 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1938vm-test-run-nixbot-gitlab> gitlab # [  189.040212] gitaly[1382]: time="2026-06-09T13:42:21.867Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XAGZM16XTT0MAC3TGV0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-06-09T13:42:51.753" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:21.853" grpc.time_ms=13.439 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1939vm-test-run-nixbot-gitlab> gitlab # [  189.058041] sidekiq-cluster[2069]: {"severity":"WARN","time":"2026-06-09T13:42:21.884Z","class":"CreatePipelineWorker","correlation_id":"01KTP9XAGZM16XTT0MAC3TGV0M","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"06c7ffad34a79029e8eadb77646e80d813ce4fc8","after":"b4642d6abb5e0d622e301707a53f12f3a4185116","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"b4642d6abb5e0d622e301707a53f12f3a4185116","ref":"refs/heads/master"},"retry":0}1940vm-test-run-nixbot-gitlab> gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b4642d6abb5e0d622e301707a53f12f3a4185116'1941vm-test-run-nixbot-gitlab> gitlab # [  189.066206] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:21.892Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"74e13df538aef9e9fabb53b6","created_at":"2026-06-09T13:42:20.802Z","trace_propagation_headers":{"sentry-trace":"c64111c9a91249beb0723c86f7aaf6a9-9a224c5d0ab34175","baggage":"sentry-trace_id=c64111c9a91249beb0723c86f7aaf6a9,sentry-release=Unknown"},"correlation_id":"01KTP9XAGZM16XTT0MAC3TGV0M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:793dd469ac3ae1c2a0bf6c36fafac85f09d6e4aec0adb03b9d7a3d298896d768","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:20.804Z","job_size_bytes":467,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-74e13df538aef9e9fabb53b6: done: 0.595078 sec","job_status":"done","queue_duration_s":0.493386,"scheduling_latency_s":0.493407,"gitaly_calls":7,"gitaly_duration_s":0.080272,"redis_calls":33,"redis_duration_s":0.0056099999999999995,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.00063,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001284,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002498,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001198,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":30,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":26,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.474855,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.595078,"completed_at":"2026-06-09T13:42:21.892Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02654,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1942vm-test-run-nixbot-gitlab> gitlab # [  189.076921] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:21.899Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"b6b4a261-fdfb-457e-ae59-aa0672c05e4a\"}"],"class":"WebHookWorker","jid":"1cebf23e5bee1274f8479a57","created_at":"2026-06-09T13:42:21.004Z","trace_propagation_headers":{"sentry-trace":"c64111c9a91249beb0723c86f7aaf6a9-9a224c5d0ab34175","baggage":"sentry-trace_id=c64111c9a91249beb0723c86f7aaf6a9,sentry-release=Unknown"},"correlation_id":"01KTP9XAGZM16XTT0MAC3TGV0M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9428df86888e0ecc528b0ac1e29fc39f2ab43f39aaa3391a748594dcbc3c6cfa","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:21.024Z","job_size_bytes":1749,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-1cebf23e5bee1274f8479a57: start","job_status":"start","queue_duration_s":0.875348,"scheduling_latency_s":0.875386}1943vm-test-run-nixbot-gitlab> gitlab # [  189.144295] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:21 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/06c7ffad34a79029e8eadb77646e80d813ce4fc8 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 9811944vm-test-run-nixbot-gitlab> gitlab # [  189.145405] nixbot[2998]: {"ts": "2026-06-09T13:42:21.971Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/06c7ffad34a79029e8eadb77646e80d813ce4fc8 \"HTTP/1.1 201 Created\""}1945vm-test-run-nixbot-gitlab> gitlab # [  189.150960] nixbot[2998]: {"ts": "2026-06-09T13:42:21.977Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-06c7ffad34a7-196c46bb", "argv0": "bwrap"}1946vm-test-run-nixbot-gitlab> gitlab # [  189.189787] nixbot[2998]: INFO:     ::ffff:127.0.0.1:33976 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1947vm-test-run-nixbot-gitlab> gitlab # [  189.203060] nixbot[2998]: INFO:     ::ffff:127.0.0.1:33980 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b4642d6abb5e0d622e301707a53f12f3a4185116 HTTP/1.1" 200 OK1948vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b4642d6abb5e0d622e301707a53f12f3a4185116', in 0.14 seconds)1949vm-test-run-nixbot-gitlab> []1950vm-test-run-nixbot-gitlab> gitlab # [  189.208379] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:22.035Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"b6b4a261-fdfb-457e-ae59-aa0672c05e4a\"}"],"class":"WebHookWorker","jid":"1cebf23e5bee1274f8479a57","created_at":"2026-06-09T13:42:21.004Z","trace_propagation_headers":{"sentry-trace":"c64111c9a91249beb0723c86f7aaf6a9-9a224c5d0ab34175","baggage":"sentry-trace_id=c64111c9a91249beb0723c86f7aaf6a9,sentry-release=Unknown"},"correlation_id":"01KTP9XAGZM16XTT0MAC3TGV0M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9428df86888e0ecc528b0ac1e29fc39f2ab43f39aaa3391a748594dcbc3c6cfa","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:21.024Z","job_size_bytes":1749,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-1cebf23e5bee1274f8479a57: done: 0.135331 sec","job_status":"done","queue_duration_s":0.875348,"scheduling_latency_s":0.875386,"redis_calls":19,"redis_duration_s":0.008245,"redis_read_bytes":31,"redis_write_bytes":5281,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002142,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000411,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3643,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003456,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002236,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.04471406199999706,"cpu_s":0.066578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000344458,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","duration_s":0.135331,"completed_at":"2026-06-09T13:42:22.035Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00316,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1951vm-test-run-nixbot-gitlab> gitlab # [  189.255855] systemd[1]: Started Nix Daemon.1952vm-test-run-nixbot-gitlab> gitlab # [  189.276194] gitaly[1382]: time="2026-06-09T13:42:22.095Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XCJNY8AEF9DHJ73XRSPR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-09T13:42:22.089" grpc.time_ms=5.693 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc1953vm-test-run-nixbot-gitlab> gitlab # [  189.304842] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:22 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 941954vm-test-run-nixbot-gitlab> gitlab # [  189.306531] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:22.132Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"8b981589948d731e01ff2ed2","created_at":"2026-06-09T13:42:21.732Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-78291a27ef6b46fe","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:21.771Z","job_size_bytes":65,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-8b981589948d731e01ff2ed2: start","job_status":"start","queue_duration_s":0.361208,"scheduling_latency_s":0.361244}1955vm-test-run-nixbot-gitlab> gitlab # [  189.355504] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:22.182Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"8b981589948d731e01ff2ed2","created_at":"2026-06-09T13:42:21.732Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-78291a27ef6b46fe","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:21.771Z","job_size_bytes":65,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-8b981589948d731e01ff2ed2: done: 0.04936 sec","job_status":"done","queue_duration_s":0.361208,"scheduling_latency_s":0.361244,"redis_calls":18,"redis_duration_s":0.005562,"redis_read_bytes":271,"redis_write_bytes":2103,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002519,"redis_feature_flag_read_bytes":264,"redis_feature_flag_write_bytes":1285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0019,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001143,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000390552,"duration_s":0.04936,"completed_at":"2026-06-09T13:42:22.182Z","load_balancing_strategy":"primary","db_duration_s":0.008532,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1956vm-test-run-nixbot-gitlab> gitlab # [  189.369982] nix-daemon[3309]: accepted connection from pid 3308, user nixbot1957vm-test-run-nixbot-gitlab> gitlab # [  189.371508] gitaly[1382]: time="2026-06-09T13:42:22.198Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XCNPC2H23ZGJWBPTE4F8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-09T13:42:22.188" pid=1382 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc1958vm-test-run-nixbot-gitlab> gitlab # [  189.377844] gitaly[1382]: time="2026-06-09T13:42:22.198Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XCNPC2H23ZGJWBPTE4F8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-09T13:42:22.188" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc1959vm-test-run-nixbot-gitlab> gitlab # [  189.462796] nix-daemon[3309]: accepted connection from pid 3307, user nixbot1960vm-test-run-nixbot-gitlab> gitlab # [  189.463885] gitlab-workhorse[1284]: time="2026-06-09T13:42:22Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671961vm-test-run-nixbot-gitlab> gitlab # [  189.464892] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:22 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 651962vm-test-run-nixbot-gitlab> gitlab # [  189.466095] gitaly[1382]: time="2026-06-09T13:42:22.199Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XCNPC2H23ZGJWBPTE4F8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-09T13:42:22.188" grpc.time_ms=10.503 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc1963vm-test-run-nixbot-gitlab> gitlab # [  189.466930] nixbot[2998]: {"ts": "2026-06-09T13:42:22.234Z", "level": "info", "logger": "nixbot.canceller", "msg": "cancelling build", "build_id": 1, "reason": "superseded"}1964vm-test-run-nixbot-gitlab> gitlab # [  189.469335] postgres[3075]: [3075] ERROR:  canceling statement due to user request1965vm-test-run-nixbot-gitlab> gitlab # [  189.471712] postgres[3075]: [3075] CONTEXT:  PL/pgSQL function notify_build_status() line 2 at statement block1966vm-test-run-nixbot-gitlab> gitlab # [  189.472746] postgres[3075]: [3075] STATEMENT:  UPDATE builds SET eval_warnings = $2::jsonb WHERE id = $11967vm-test-run-nixbot-gitlab> gitlab # [  189.477337] nix-daemon[3318]: unexpected Nix daemon error: error: interrupted by the user1968vm-test-run-nixbot-gitlab> gitlab # [  189.505745] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:22.332Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"99d0ce339e76311367263c24","created_at":"2026-06-09T13:42:21.772Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-78291a27ef6b46fe","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:21.781Z","job_size_bytes":65,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-99d0ce339e76311367263c24: start","job_status":"start","queue_duration_s":0.551329,"scheduling_latency_s":0.551372}1969vm-test-run-nixbot-gitlab> gitlab # [  189.533650] gitaly[1382]: time="2026-06-09T13:42:22.360Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XCV8KG27EAP2297B76V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:42:52.356" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:22.357" grpc.time_ms=3.155 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1970vm-test-run-nixbot-gitlab> gitlab # [  189.553960] gitaly[1382]: time="2026-06-09T13:42:22.364Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XCRY3W5RRS5V9MPCYMQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:42:52.263" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:22.363" grpc.time_ms=0.529 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1971vm-test-run-nixbot-gitlab> gitlab # [  189.574532] gitaly[1382]: time="2026-06-09T13:42:22.395Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XCRY3W5RRS5V9MPCYMQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-06-09T13:42:52.281" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:22.382" grpc.time_ms=12.275 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1972vm-test-run-nixbot-gitlab> gitlab # [  189.597049] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:22.397Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"99d0ce339e76311367263c24","created_at":"2026-06-09T13:42:21.772Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-78291a27ef6b46fe","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:21.781Z","job_size_bytes":65,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-99d0ce339e76311367263c24: done: 0.06516 sec","job_status":"done","queue_duration_s":0.551329,"scheduling_latency_s":0.551372,"redis_calls":15,"redis_duration_s":0.008051,"redis_read_bytes":142,"redis_write_bytes":1431,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000661,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":431,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004099,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003291,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000939784,"duration_s":0.06516,"completed_at":"2026-06-09T13:42:22.397Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010722,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1973vm-test-run-nixbot-gitlab> gitlab # [  189.634951] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:22.398Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"168f9d400ce519d5a5b8add6","created_at":"2026-06-09T13:42:21.951Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-78291a27ef6b46fe","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:21.957Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-168f9d400ce519d5a5b8add6: start","job_status":"start","queue_duration_s":0.441594,"scheduling_latency_s":0.441616}1974vm-test-run-nixbot-gitlab> gitlab # [  189.638275] gitaly[1382]: time="2026-06-09T13:42:22.414Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XCV8KG27EAP2297B76V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-09T13:42:32.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:22.405" grpc.time_ms=8.534 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1975vm-test-run-nixbot-gitlab> gitlab # [  189.647229] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:22 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/06c7ffad34a79029e8eadb77646e80d813ce4fc8 HTTP/1.1" 201 651 "" "python-httpx/0.28.1" 1461976vm-test-run-nixbot-gitlab> gitlab # [  189.650549] nixbot[2998]: {"ts": "2026-06-09T13:42:22.463Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/06c7ffad34a79029e8eadb77646e80d813ce4fc8 \"HTTP/1.1 201 Created\""}1977vm-test-run-nixbot-gitlab> gitlab # [  189.653383] gitaly[1382]: time="2026-06-09T13:42:22.417Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XCRY3W5RRS5V9MPCYMQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-09T13:42:32.130" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:22.410" grpc.time_ms=6.759 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1978vm-test-run-nixbot-gitlab> gitlab # [  189.738228] gitaly[1382]: time="2026-06-09T13:42:22.457Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XCRY3W5RRS5V9MPCYMQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-06-09T13:42:32.175" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:22.456" grpc.time_ms=0.458 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1979vm-test-run-nixbot-gitlab> gitlab # [  189.738927] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:22.532Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"5f452b995f5f860530cc8f65","created_at":"2026-06-09T13:42:22.530Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6a7b5af19d2e4d58","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"168f9d400ce519d5a5b8add6","job_size_bytes":3,"pid":2069,"job_status":"deduplicated","message":"PipelineProcessWorker JID-5f452b995f5f860530cc8f65: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}1980vm-test-run-nixbot-gitlab> gitlab # [  189.740090] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:22.534Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"168f9d400ce519d5a5b8add6","created_at":"2026-06-09T13:42:21.951Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-78291a27ef6b46fe","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:21.957Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2069,"job_status":"rescheduled","message":"PipelineProcessWorker JID-168f9d400ce519d5a5b8add6: rescheduled"}1981vm-test-run-nixbot-gitlab> gitlab # [  189.740597] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:22.543Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"168f9d400ce519d5a5b8add6","created_at":"2026-06-09T13:42:21.951Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-78291a27ef6b46fe","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:21.957Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-168f9d400ce519d5a5b8add6: done: 0.144295 sec","job_status":"done","queue_duration_s":0.441594,"scheduling_latency_s":0.441616,"gitaly_calls":3,"gitaly_duration_s":0.01045,"redis_calls":54,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.011932,"redis_read_bytes":292,"redis_write_bytes":8550,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001501,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":16,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.001272,"redis_cache_read_bytes":32,"redis_cache_write_bytes":1470,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.001816,"redis_feature_flag_read_bytes":134,"redis_feature_flag_write_bytes":992,"redis_queues_calls":4,"redis_queues_duration_s":0.000674,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2220,"redis_queues_metadata_calls":12,"redis_queues_metadata_duration_s":0.003347,"redis_queues_metadata_read_bytes":89,"redis_queues_metadata_write_bytes":1500,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.00049,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000265,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":34,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":34,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":22,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.098687,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.105236559,"duration_s":0.144295,"completed_at":"2026-06-09T13:42:22.543Z","load_balancing_strategy":"primary","db_duration_s":0.026746,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1982vm-test-run-nixbot-gitlab> gitlab # [  189.827349] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:22.544Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","1cebf23e5bee1274f8479a57"],"class":"WebHooks::LogExecutionWorker","jid":"9d283ee2eb867a9cc0c36784","created_at":"2026-06-09T13:42:22.018Z","trace_propagation_headers":{"sentry-trace":"c64111c9a91249beb0723c86f7aaf6a9-3e8d807f37e44db9","baggage":"sentry-trace_id=c64111c9a91249beb0723c86f7aaf6a9,sentry-release=Unknown"},"correlation_id":"01KTP9XAGZM16XTT0MAC3TGV0M","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:79b782bca7430f0985828be18133b73c40d46bc3c7f7494482a723a06b1cf914","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.024Z","job_size_bytes":2507,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-9d283ee2eb867a9cc0c36784: start","job_status":"start","queue_duration_s":0.519778,"scheduling_latency_s":0.5198}1983vm-test-run-nixbot-gitlab> gitlab # [  189.847075] gitaly[1382]: time="2026-06-09T13:42:22.479Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XBHW6Y7HFQFV41F9DR1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-09T13:42:52.377" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:22.478" grpc.time_ms=0.649 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1984vm-test-run-nixbot-gitlab> gitlab # [  189.916680] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:22.642Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","1cebf23e5bee1274f8479a57"],"class":"WebHooks::LogExecutionWorker","jid":"9d283ee2eb867a9cc0c36784","created_at":"2026-06-09T13:42:22.018Z","trace_propagation_headers":{"sentry-trace":"c64111c9a91249beb0723c86f7aaf6a9-3e8d807f37e44db9","baggage":"sentry-trace_id=c64111c9a91249beb0723c86f7aaf6a9,sentry-release=Unknown"},"correlation_id":"01KTP9XAGZM16XTT0MAC3TGV0M","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:79b782bca7430f0985828be18133b73c40d46bc3c7f7494482a723a06b1cf914","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.024Z","job_size_bytes":2507,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-9d283ee2eb867a9cc0c36784: done: 0.097442 sec","job_status":"done","queue_duration_s":0.519778,"scheduling_latency_s":0.5198,"redis_calls":10,"redis_duration_s":0.002935,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000512,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001704,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000719,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.021,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.021,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000732774,"duration_s":0.097442,"completed_at":"2026-06-09T13:42:22.642Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005403,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1985vm-test-run-nixbot-gitlab> gitlab # [  190.000677] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:22.644Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"87f59ea7d004d570f84b3310","created_at":"2026-06-09T13:42:22.464Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6a7b5af19d2e4d58","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.468Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-87f59ea7d004d570f84b3310: start","job_status":"start","queue_duration_s":0.17613,"scheduling_latency_s":0.176155}1986vm-test-run-nixbot-gitlab> gitlab # [  190.002150] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:22.676Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"87f59ea7d004d570f84b3310","created_at":"2026-06-09T13:42:22.464Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6a7b5af19d2e4d58","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.468Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-87f59ea7d004d570f84b3310: done: 0.032034 sec","job_status":"done","queue_duration_s":0.17613,"scheduling_latency_s":0.176155,"redis_calls":10,"redis_duration_s":0.002333,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000516,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001335,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000482,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000372114,"duration_s":0.032034,"completed_at":"2026-06-09T13:42:22.676Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00357,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1987vm-test-run-nixbot-gitlab> gitlab # [  190.029229] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:22.677Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"86cbcc2f771519a13ebf354a","created_at":"2026-06-09T13:42:22.535Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6a7b5af19d2e4d58","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.536Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-86cbcc2f771519a13ebf354a: start","job_status":"start","queue_duration_s":0.140998,"scheduling_latency_s":0.141018}1988vm-test-run-nixbot-gitlab> gitlab # [  190.109196] nixbot[2998]: {"ts": "2026-06-09T13:42:22.594Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/06c7ffad34a79029e8eadb77646e80d813ce4fc8 \"HTTP/1.1 201 Created\""}1989vm-test-run-nixbot-gitlab> gitlab # [  190.110466] nixbot[2998]: {"ts": "2026-06-09T13:42:22.892Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/b4642d6abb5e0d622e301707a53f12f3a4185116 \"HTTP/1.1 201 Created\""}1990vm-test-run-nixbot-gitlab> gitlab # [  190.111253] nixbot[2998]: {"ts": "2026-06-09T13:42:22.898Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-b4642d6abb5e-33a88d3e", "argv0": "bwrap"}1991vm-test-run-nixbot-gitlab> gitlab # [  190.112160] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:22 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/06c7ffad34a79029e8eadb77646e80d813ce4fc8 HTTP/1.1" 201 665 "" "python-httpx/0.28.1" 1171992vm-test-run-nixbot-gitlab> gitlab # [  190.112949] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:22 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b4642d6abb5e0d622e301707a53f12f3a4185116 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 6521993vm-test-run-nixbot-gitlab> gitlab # [  190.114134] gitaly[1382]: time="2026-06-09T13:42:22.507Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XBHW6Y7HFQFV41F9DR1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:42:52.406" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:22.506" grpc.time_ms=0.979 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1994vm-test-run-nixbot-gitlab> gitlab # [  190.115041] gitaly[1382]: time="2026-06-09T13:42:22.514Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XD0BEW1K2800GHSSS17G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:42:52.013" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:22.513" grpc.time_ms=0.914 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1995vm-test-run-nixbot-gitlab> gitlab # [  190.115832] gitaly[1382]: time="2026-06-09T13:42:22.527Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XBHW6Y7HFQFV41F9DR1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:42:52.424" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:22.526" grpc.time_ms=1.456 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1996vm-test-run-nixbot-gitlab> gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b4642d6abb5e0d622e301707a53f12f3a4185116'1997vm-test-run-nixbot-gitlab> gitlab # [  190.185196] gitaly[1382]: time="2026-06-09T13:42:22.549Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XD0BEW1K2800GHSSS17G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-09T13:42:32.142" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:22.542" grpc.time_ms=7.068 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1998vm-test-run-nixbot-gitlab> gitlab # [  190.186707] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:22.957Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"86cbcc2f771519a13ebf354a","created_at":"2026-06-09T13:42:22.535Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6a7b5af19d2e4d58","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.536Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2069,"job_status":"rescheduled","message":"PipelineProcessWorker JID-86cbcc2f771519a13ebf354a: rescheduled"}1999vm-test-run-nixbot-gitlab> gitlab # [  190.187600] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:22.963Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"86cbcc2f771519a13ebf354a","created_at":"2026-06-09T13:42:22.535Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6a7b5af19d2e4d58","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.536Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-86cbcc2f771519a13ebf354a: done: 0.285728 sec","job_status":"done","queue_duration_s":0.140998,"scheduling_latency_s":0.141018,"gitaly_calls":4,"gitaly_duration_s":0.094385,"redis_calls":101,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.022914,"redis_read_bytes":187,"redis_write_bytes":23557,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001085,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":17,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.001415,"redis_cache_read_bytes":33,"redis_cache_write_bytes":1526,"redis_feature_flag_calls":22,"redis_feature_flag_duration_s":0.007935,"redis_feature_flag_read_bytes":22,"redis_feature_flag_write_bytes":3871,"redis_queues_calls":22,"redis_queues_duration_s":0.003433,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12389,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.004797,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000262,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000675,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002227,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":850,"db_count":47,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.011,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.013,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.140061,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.262163487,"duration_s":0.285728,"completed_at":"2026-06-09T13:42:22.963Z","load_balancing_strategy":"primary","db_duration_s":0.038743,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2000vm-test-run-nixbot-gitlab> gitlab # [  190.261206] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:22.964Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"367e546b0054dcf5119044b1","created_at":"2026-06-09T13:42:22.685Z","trace_propagation_headers":{"sentry-trace":"7cbb4b777a6a4edf99f08bad6208d089-afb3d62f20a04ba5","baggage":"sentry-trace_id=7cbb4b777a6a4edf99f08bad6208d089,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9XCRY3W5RRS5V9MPCYMQ8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.689Z","job_size_bytes":65,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-367e546b0054dcf5119044b1: start","job_status":"start","queue_duration_s":0.275651,"scheduling_latency_s":0.275672}2001vm-test-run-nixbot-gitlab> gitlab # [  190.339997] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:22.983Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"367e546b0054dcf5119044b1","created_at":"2026-06-09T13:42:22.685Z","trace_propagation_headers":{"sentry-trace":"7cbb4b777a6a4edf99f08bad6208d089-afb3d62f20a04ba5","baggage":"sentry-trace_id=7cbb4b777a6a4edf99f08bad6208d089,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9XCRY3W5RRS5V9MPCYMQ8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.689Z","job_size_bytes":65,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-367e546b0054dcf5119044b1: done: 0.018692 sec","job_status":"done","queue_duration_s":0.275651,"scheduling_latency_s":0.275672,"redis_calls":7,"redis_duration_s":0.0015229999999999998,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001084,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000439,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018692,"completed_at":"2026-06-09T13:42:22.983Z","load_balancing_strategy":"primary","db_duration_s":0.00191,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2002vm-test-run-nixbot-gitlab> gitlab # [  190.412288] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:22.984Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"2d3bda986d048836fd98a2ee","created_at":"2026-06-09T13:42:22.690Z","trace_propagation_headers":{"sentry-trace":"7cbb4b777a6a4edf99f08bad6208d089-afb3d62f20a04ba5","baggage":"sentry-trace_id=7cbb4b777a6a4edf99f08bad6208d089,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9XCRY3W5RRS5V9MPCYMQ8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.692Z","job_size_bytes":65,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-2d3bda986d048836fd98a2ee: start","job_status":"start","queue_duration_s":0.29173,"scheduling_latency_s":0.29175}2003vm-test-run-nixbot-gitlab> gitlab # [  190.414279] gitaly[1382]: time="2026-06-09T13:42:22.614Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=144 command.spawn_token_fork_ms=142 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XCRY3W5RRS5V9MPCYMQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-06-09T13:42:32.186" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:22.467" grpc.time_ms=146.222 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2004vm-test-run-nixbot-gitlab> gitlab # [  190.415213] gitaly[1382]: time="2026-06-09T13:42:22.644Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9XCRY3W5RRS5V9MPCYMQ8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4159 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:22.644" grpc.time_ms=0.321 pid=1382 span.kind=server system=grpc2005vm-test-run-nixbot-gitlab> gitlab # [  190.416129] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.022Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"2d3bda986d048836fd98a2ee","created_at":"2026-06-09T13:42:22.690Z","trace_propagation_headers":{"sentry-trace":"7cbb4b777a6a4edf99f08bad6208d089-afb3d62f20a04ba5","baggage":"sentry-trace_id=7cbb4b777a6a4edf99f08bad6208d089,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9XCRY3W5RRS5V9MPCYMQ8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.692Z","job_size_bytes":65,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-2d3bda986d048836fd98a2ee: done: 0.038086 sec","job_status":"done","queue_duration_s":0.29173,"scheduling_latency_s":0.29175,"redis_calls":10,"redis_duration_s":0.002366,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001219,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001147,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038086,"completed_at":"2026-06-09T13:42:23.022Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008673,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2006vm-test-run-nixbot-gitlab> gitlab # [  190.478202] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.024Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"cd825c4d759197f01bb19726","created_at":"2026-06-09T13:42:22.734Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6b865c0c866d4431","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.738Z","job_size_bytes":23,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-cd825c4d759197f01bb19726: start","job_status":"start","queue_duration_s":0.286253,"scheduling_latency_s":0.286281}2007vm-test-run-nixbot-gitlab> gitlab # [  190.546975] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.102Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"cd825c4d759197f01bb19726","created_at":"2026-06-09T13:42:22.734Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6b865c0c866d4431","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.738Z","job_size_bytes":23,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-cd825c4d759197f01bb19726: done: 0.078484 sec","job_status":"done","queue_duration_s":0.286253,"scheduling_latency_s":0.286281,"redis_calls":15,"redis_duration_s":0.003492,"redis_read_bytes":13,"redis_write_bytes":3011,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000384,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_calls":2,"redis_queues_duration_s":0.000334,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1626,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001816,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":742,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000444,"redis_rate_limiting_write_bytes":148,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000514,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":13,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":13,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061529,"worker_id":"sidekiq_0","rate_limiting_gates":["permanent_email_failure","temporary_email_failure"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000388876,"duration_s":0.078484,"completed_at":"2026-06-09T13:42:23.102Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010452,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2008vm-test-run-nixbot-gitlab> gitlab # [  190.577576] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.104Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"873fc4b65a77f05f3594e948","created_at":"2026-06-09T13:42:22.843Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6b865c0c866d4431","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.849Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-873fc4b65a77f05f3594e948: start","job_status":"start","queue_duration_s":0.255045,"scheduling_latency_s":0.255065}2009vm-test-run-nixbot-gitlab> gitlab # [  190.649204] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.127Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"873fc4b65a77f05f3594e948","created_at":"2026-06-09T13:42:22.843Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6b865c0c866d4431","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.849Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-873fc4b65a77f05f3594e948: done: 0.023045 sec","job_status":"done","queue_duration_s":0.255045,"scheduling_latency_s":0.255065,"redis_calls":10,"redis_duration_s":0.0021520000000000003,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000406,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001288,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000458,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000322946,"duration_s":0.023045,"completed_at":"2026-06-09T13:42:23.127Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002707,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2010vm-test-run-nixbot-gitlab> gitlab # [  190.673833] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.128Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"34055a28cfc08b9726fe544e","created_at":"2026-06-09T13:42:23.094Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-19c2594486074ba5","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineNotificationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:2b4a3b73f18ff59a27d7bd90262e14dfb58c644a7a30ed1538ad571dbef0ce60","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:23.096Z","job_size_bytes":464,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-34055a28cfc08b9726fe544e: start","job_status":"start","queue_duration_s":0.031618,"scheduling_latency_s":0.031638}2011vm-test-run-nixbot-gitlab> gitlab # [  190.744446] gitaly[1382]: time="2026-06-09T13:42:22.668Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9XCRY3W5RRS5V9MPCYMQ8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4161 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:22.667" grpc.time_ms=0.43 pid=1382 span.kind=server system=grpc2012vm-test-run-nixbot-gitlab> gitlab # [  190.745861] gitaly[1382]: time="2026-06-09T13:42:22.678Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XCRY3W5RRS5V9MPCYMQ8 diskcache=68b1f87f-bd66-431a-8625-3c65c4baeb72 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-09T13:42:32.006" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:22.616" pid=1382 ref=refs/keep-around/b4642d6abb5e0d622e301707a53f12f3a4185116 remote_ip="2001:db8:1::1" revision=b4642d6abb5e0d622e301707a53f12f3a4185116 span.kind=server system=grpc username=root2013vm-test-run-nixbot-gitlab> gitlab # [  190.747149] sidekiq-cluster[2069]: {"severity":"WARN","time":"2026-06-09T13:42:23.164Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"34055a28cfc08b9726fe544e","created_at":"2026-06-09T13:42:23.094Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-19c2594486074ba5","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineNotificationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:2b4a3b73f18ff59a27d7bd90262e14dfb58c644a7a30ed1538ad571dbef0ce60","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:23.096Z","job_size_bytes":464,"pid":2069,"sidekiq_tid":"m479","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-34055a28cfc08b9726fe544e: fail: 0.035285 sec","job_status":"fail","queue_duration_s":0.031618,"scheduling_latency_s":0.031638,"redis_calls":7,"redis_duration_s":0.001654,"redis_read_bytes":5,"redis_write_bytes":786,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001226,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000428,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035285,"completed_at":"2026-06-09T13:42:23.163Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/pipelines.rb:33:in `pipeline_mail'","app/mailers/emails/pipelines.rb:10:in `pipeline_failed_email'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/abbaw4w9gll6p923md75p3h3rrmhrdqn-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/bqz31s23z0jk4464lbybyz83ikl0gmyd-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/wp2rnxa243q2gn2f8h04d48hnvfr0387-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/85h4805ad7n5qn7wq2m6icypga7rnk80-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.004181,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2014vm-test-run-nixbot-gitlab> gitlab # [  191.332333] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.166Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"1da3935da27bfc5cf1d63be1","created_at":"2026-06-09T13:42:22.859Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6b865c0c866d4431","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.863Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-1da3935da27bfc5cf1d63be1: start","job_status":"start","queue_duration_s":0.302941,"scheduling_latency_s":0.302979}2015vm-test-run-nixbot-gitlab> gitlab # [  191.399144] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.327Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"1da3935da27bfc5cf1d63be1","created_at":"2026-06-09T13:42:22.859Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6b865c0c866d4431","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.863Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-1da3935da27bfc5cf1d63be1: done: 0.160501 sec","job_status":"done","queue_duration_s":0.302941,"scheduling_latency_s":0.302979,"redis_calls":10,"redis_duration_s":0.002388,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000547,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001415,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000426,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.134,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.129,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000358984,"duration_s":0.160501,"completed_at":"2026-06-09T13:42:23.327Z","load_balancing_strategy":"primary","db_duration_s":0.134018,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2016vm-test-run-nixbot-gitlab> gitlab # [  191.410266] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.328Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"bbc70d6de312d0eb7af0bacc","created_at":"2026-06-09T13:42:22.870Z","trace_propagation_headers":{"sentry-trace":"7cbb4b777a6a4edf99f08bad6208d089-afb3d62f20a04ba5","baggage":"sentry-trace_id=7cbb4b777a6a4edf99f08bad6208d089,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9XCRY3W5RRS5V9MPCYMQ8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.875Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-bbc70d6de312d0eb7af0bacc: start","job_status":"start","queue_duration_s":0.453669,"scheduling_latency_s":0.453689}2017vm-test-run-nixbot-gitlab> gitlab # [  191.484107] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.434Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"bbc70d6de312d0eb7af0bacc","created_at":"2026-06-09T13:42:22.870Z","trace_propagation_headers":{"sentry-trace":"7cbb4b777a6a4edf99f08bad6208d089-afb3d62f20a04ba5","baggage":"sentry-trace_id=7cbb4b777a6a4edf99f08bad6208d089,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9XCRY3W5RRS5V9MPCYMQ8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.875Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-bbc70d6de312d0eb7af0bacc: done: 0.106002 sec","job_status":"done","queue_duration_s":0.453669,"scheduling_latency_s":0.453689,"gitaly_calls":3,"gitaly_duration_s":0.008151,"redis_calls":44,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.007208,"redis_read_bytes":98,"redis_write_bytes":6014,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000927,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.001887,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_queues_calls":2,"redis_queues_duration_s":0.000299,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001545,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000252,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000415,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":31,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":31,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":19,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07543,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.086739795,"duration_s":0.106002,"completed_at":"2026-06-09T13:42:23.434Z","load_balancing_strategy":"primary","db_duration_s":0.021445,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2018vm-test-run-nixbot-gitlab> gitlab # [  191.514232] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.436Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"7101f137bcbd41b441933321","created_at":"2026-06-09T13:42:22.871Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6b865c0c866d4431","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.875Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-7101f137bcbd41b441933321: start","job_status":"start","queue_duration_s":0.560617,"scheduling_latency_s":0.560638}2019vm-test-run-nixbot-gitlab> gitlab # [  191.604376] gitaly[1382]: time="2026-06-09T13:42:22.678Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=47 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5093 command.oublock=8 command.real_time_ms=55 command.spawn_token_fork_ms=0 command.system_time_ms=34 command.user_time_ms=13 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XCRY3W5RRS5V9MPCYMQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-09T13:42:32.006" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-09T13:42:22.616" grpc.time_ms=61.84 pid=1382 ref=refs/keep-around/b4642d6abb5e0d622e301707a53f12f3a4185116 remote_ip="2001:db8:1::1" revision=b4642d6abb5e0d622e301707a53f12f3a4185116 span.kind=server system=grpc username=root2020vm-test-run-nixbot-gitlab> gitlab # [  191.605916] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.462Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"7101f137bcbd41b441933321","created_at":"2026-06-09T13:42:22.871Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6b865c0c866d4431","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.875Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-7101f137bcbd41b441933321: done: 0.025864 sec","job_status":"done","queue_duration_s":0.560617,"scheduling_latency_s":0.560638,"redis_calls":13,"redis_duration_s":0.002794,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000413,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001305,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000637,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000439,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000346692,"duration_s":0.025864,"completed_at":"2026-06-09T13:42:23.462Z","load_balancing_strategy":"primary","db_duration_s":0.002921,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2021vm-test-run-nixbot-gitlab> gitlab # [  191.631130] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.463Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0a7a6fafeafb4e9836c7009a","created_at":"2026-06-09T13:42:22.876Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6b865c0c866d4431","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.881Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0a7a6fafeafb4e9836c7009a: start","job_status":"start","queue_duration_s":0.581337,"scheduling_latency_s":0.581357}2022vm-test-run-nixbot-gitlab> gitlab # [  191.657418] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.485Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0a7a6fafeafb4e9836c7009a","created_at":"2026-06-09T13:42:22.876Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6b865c0c866d4431","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.881Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0a7a6fafeafb4e9836c7009a: done: 0.022242 sec","job_status":"done","queue_duration_s":0.581337,"scheduling_latency_s":0.581357,"redis_calls":10,"redis_duration_s":0.002184,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000416,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001328,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00044,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000330768,"duration_s":0.022242,"completed_at":"2026-06-09T13:42:23.485Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003868,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2023vm-test-run-nixbot-gitlab> gitlab # [  191.734332] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.486Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"04e91765aa2ce29ed59a4d73","created_at":"2026-06-09T13:42:22.882Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6b865c0c866d4431","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.886Z","job_size_bytes":19,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-04e91765aa2ce29ed59a4d73: start","job_status":"start","queue_duration_s":0.600053,"scheduling_latency_s":0.600072}2024vm-test-run-nixbot-gitlab> gitlab # [  191.811427] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.513Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"04e91765aa2ce29ed59a4d73","created_at":"2026-06-09T13:42:22.882Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6b865c0c866d4431","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.886Z","job_size_bytes":19,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-04e91765aa2ce29ed59a4d73: done: 0.026232 sec","job_status":"done","queue_duration_s":0.600053,"scheduling_latency_s":0.600072,"redis_calls":11,"redis_duration_s":0.002417,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000494,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001496,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000427,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032993,"duration_s":0.026232,"completed_at":"2026-06-09T13:42:23.513Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003119,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2025vm-test-run-nixbot-gitlab> gitlab # [  191.817970] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.514Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"failed\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"9409dfe970cabc1ec633f88c","created_at":"2026-06-09T13:42:22.888Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6b865c0c866d4431","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2e8f76273ed3dffe93170e4a8828cd9c1cde36f18ce9deaf751670cff2f2dad","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.892Z","job_size_bytes":65,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-9409dfe970cabc1ec633f88c: start","job_status":"start","queue_duration_s":0.621835,"scheduling_latency_s":0.621855}2026vm-test-run-nixbot-gitlab> gitlab # [  191.898421] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.536Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"failed\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"9409dfe970cabc1ec633f88c","created_at":"2026-06-09T13:42:22.888Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6b865c0c866d4431","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2e8f76273ed3dffe93170e4a8828cd9c1cde36f18ce9deaf751670cff2f2dad","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.892Z","job_size_bytes":65,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-9409dfe970cabc1ec633f88c: done: 0.021646 sec","job_status":"done","queue_duration_s":0.621835,"scheduling_latency_s":0.621855,"redis_calls":10,"redis_duration_s":0.002092,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000389,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001269,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000434,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000358147,"duration_s":0.021646,"completed_at":"2026-06-09T13:42:23.536Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002587,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2027vm-test-run-nixbot-gitlab> gitlab # [  191.916310] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.537Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"6f8d1bf6fffc776951a15fd7","created_at":"2026-06-09T13:42:22.893Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6b865c0c866d4431","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.895Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-6f8d1bf6fffc776951a15fd7: start","job_status":"start","queue_duration_s":0.642062,"scheduling_latency_s":0.642082}2028vm-test-run-nixbot-gitlab> gitlab # [  191.942191] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.560Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"6f8d1bf6fffc776951a15fd7","created_at":"2026-06-09T13:42:22.893Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6b865c0c866d4431","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.895Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-6f8d1bf6fffc776951a15fd7: done: 0.022586 sec","job_status":"done","queue_duration_s":0.642062,"scheduling_latency_s":0.642082,"redis_calls":7,"redis_duration_s":0.001647,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001181,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000466,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016074,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022586,"completed_at":"2026-06-09T13:42:23.560Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002475,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2029vm-test-run-nixbot-gitlab> gitlab # [  192.016309] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.561Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"05dd9c08f8b5c56a2b0221ce","created_at":"2026-06-09T13:42:22.924Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6b865c0c866d4431","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.928Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-05dd9c08f8b5c56a2b0221ce: start","job_status":"start","queue_duration_s":0.632598,"scheduling_latency_s":0.632619}2030vm-test-run-nixbot-gitlab> gitlab # [  192.093773] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.586Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"05dd9c08f8b5c56a2b0221ce","created_at":"2026-06-09T13:42:22.924Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6b865c0c866d4431","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.928Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-05dd9c08f8b5c56a2b0221ce: done: 0.025406 sec","job_status":"done","queue_duration_s":0.632598,"scheduling_latency_s":0.632619,"redis_calls":10,"redis_duration_s":0.0020930000000000002,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00042,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00127,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000403,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000330209,"duration_s":0.025406,"completed_at":"2026-06-09T13:42:23.586Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006016,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2031vm-test-run-nixbot-gitlab> gitlab # [  192.099853] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.588Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"9902b57aa43f2c79a54c389d","created_at":"2026-06-09T13:42:22.929Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6b865c0c866d4431","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.932Z","job_size_bytes":6,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-9902b57aa43f2c79a54c389d: start","job_status":"start","queue_duration_s":0.655736,"scheduling_latency_s":0.655756}2032vm-test-run-nixbot-gitlab> gitlab # [  192.169198] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.606Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"9902b57aa43f2c79a54c389d","created_at":"2026-06-09T13:42:22.929Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6b865c0c866d4431","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.932Z","job_size_bytes":6,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-9902b57aa43f2c79a54c389d: done: 0.017896 sec","job_status":"done","queue_duration_s":0.655736,"scheduling_latency_s":0.655756,"redis_calls":10,"redis_duration_s":0.0022110000000000003,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000478,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001327,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000406,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000329371,"duration_s":0.017896,"completed_at":"2026-06-09T13:42:23.605Z","load_balancing_strategy":"primary","db_duration_s":0.001479,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2033vm-test-run-nixbot-gitlab> gitlab # [  192.193581] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.607Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"f4580b283f85988c0a7e087f","created_at":"2026-06-09T13:42:22.958Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6b865c0c866d4431","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.959Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f4580b283f85988c0a7e087f: start","job_status":"start","queue_duration_s":0.647795,"scheduling_latency_s":0.647814}2034vm-test-run-nixbot-gitlab> gitlab # [  192.218627] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.622Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"f4580b283f85988c0a7e087f","created_at":"2026-06-09T13:42:22.958Z","trace_propagation_headers":{"sentry-trace":"f7f63030fdb04a2ebc2930b01fad5430-6b865c0c866d4431","baggage":"sentry-trace_id=f7f63030fdb04a2ebc2930b01fad5430,sentry-release=Unknown"},"correlation_id":"01KTP9XBHW6Y7HFQFV41F9DR1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:22.959Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f4580b283f85988c0a7e087f: done: 0.015304 sec","job_status":"done","queue_duration_s":0.647795,"scheduling_latency_s":0.647814,"redis_calls":8,"redis_duration_s":0.001752,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001258,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000494,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015304,"completed_at":"2026-06-09T13:42:23.622Z","load_balancing_strategy":"primary","db_duration_s":0.00123,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2035vm-test-run-nixbot-gitlab> gitlab # [  192.297131] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.623Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"72bd1e53ff7bed6060802d04","created_at":"2026-06-09T13:42:23.367Z","trace_propagation_headers":{"sentry-trace":"7cbb4b777a6a4edf99f08bad6208d089-c32503a7f2fb4fbb","baggage":"sentry-trace_id=7cbb4b777a6a4edf99f08bad6208d089,sentry-release=Unknown"},"correlation_id":"01KTP9XCRY3W5RRS5V9MPCYMQ8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:23.369Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-72bd1e53ff7bed6060802d04: start","job_status":"start","queue_duration_s":0.254355,"scheduling_latency_s":0.254376}2036vm-test-run-nixbot-gitlab> gitlab # [  192.307798] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:23.645Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"72bd1e53ff7bed6060802d04","created_at":"2026-06-09T13:42:23.367Z","trace_propagation_headers":{"sentry-trace":"7cbb4b777a6a4edf99f08bad6208d089-c32503a7f2fb4fbb","baggage":"sentry-trace_id=7cbb4b777a6a4edf99f08bad6208d089,sentry-release=Unknown"},"correlation_id":"01KTP9XCRY3W5RRS5V9MPCYMQ8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:23.369Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-72bd1e53ff7bed6060802d04: done: 0.0221 sec","job_status":"done","queue_duration_s":0.254355,"scheduling_latency_s":0.254376,"redis_calls":7,"redis_duration_s":0.001478,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001073,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000405,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0221,"completed_at":"2026-06-09T13:42:23.645Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002301,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2037vm-test-run-nixbot-gitlab> gitlab # [  192.377335] gitaly[1382]: time="2026-06-09T13:42:22.682Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XCRY3W5RRS5V9MPCYMQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:42:52.581" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:22.681" grpc.time_ms=0.431 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2038vm-test-run-nixbot-gitlab> gitlab # [  192.456368] gitaly[1382]: time="2026-06-09T13:42:22.780Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9XBHW6Y7HFQFV41F9DR1H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:22.779" grpc.time_ms=0.327 pid=1382 span.kind=server system=grpc2039vm-test-run-nixbot-gitlab> gitlab # [  192.458344] gitaly[1382]: time="2026-06-09T13:42:22.801Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9XBHW6Y7HFQFV41F9DR1H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3901 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:22.800" grpc.time_ms=0.381 pid=1382 span.kind=server system=grpc2040vm-test-run-nixbot-gitlab> gitlab # [  192.459857] gitaly[1382]: time="2026-06-09T13:42:22.823Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9XBHW6Y7HFQFV41F9DR1H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:22.822" grpc.time_ms=0.331 pid=1382 span.kind=server system=grpc2041vm-test-run-nixbot-gitlab> gitlab # [  192.461473] gitaly[1382]: time="2026-06-09T13:42:22.834Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XBHW6Y7HFQFV41F9DR1H diskcache=e2064786-5565-47ee-ab07-39e46ac8b20c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-09T13:42:52.652" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:22.753" pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2042vm-test-run-nixbot-gitlab> gitlab # [  192.463244] gitaly[1382]: time="2026-06-09T13:42:22.835Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=72 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=6944 command.oublock=0 command.real_time_ms=73 command.spawn_token_fork_ms=1 command.system_time_ms=51 command.user_time_ms=21 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XBHW6Y7HFQFV41F9DR1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-09T13:42:52.652" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:22.753" grpc.time_ms=81.764 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2043vm-test-run-nixbot-gitlab> gitlab # [  192.473497] gitaly[1382]: time="2026-06-09T13:42:22.902Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XBHW6Y7HFQFV41F9DR1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-09T13:42:52.800" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:22.900" grpc.time_ms=1.147 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2044vm-test-run-nixbot-gitlab> gitlab # [  192.494191] gitaly[1382]: time="2026-06-09T13:42:22.923Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XBHW6Y7HFQFV41F9DR1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:42:52.821" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:22.922" grpc.time_ms=0.593 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2045vm-test-run-nixbot-gitlab> gitlab # [  192.513427] gitaly[1382]: time="2026-06-09T13:42:22.952Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XBHW6Y7HFQFV41F9DR1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:42:52.851" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:22.951" grpc.time_ms=0.552 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2046vm-test-run-nixbot-gitlab> gitlab # [  192.582388] gitaly[1382]: time="2026-06-09T13:42:23.379Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XCRY3W5RRS5V9MPCYMQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-09T13:42:53.278" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:23.378" grpc.time_ms=0.699 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2047vm-test-run-nixbot-gitlab> gitlab # [  192.583975] gitaly[1382]: time="2026-06-09T13:42:23.403Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XCRY3W5RRS5V9MPCYMQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:42:53.302" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:23.403" grpc.time_ms=0.453 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2048vm-test-run-nixbot-gitlab> gitlab # [  192.585109] gitaly[1382]: time="2026-06-09T13:42:23.424Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XCRY3W5RRS5V9MPCYMQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:42:53.323" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:23.423" grpc.time_ms=0.57 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2049vm-test-run-nixbot-gitlab> gitlab # [  192.674857] nixbot[2998]: INFO:     ::ffff:127.0.0.1:33984 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b4642d6abb5e0d622e301707a53f12f3a4185116 HTTP/1.1" 200 OK2050vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b4642d6abb5e0d622e301707a53f12f3a4185116', in 2.50 seconds)2051vm-test-run-nixbot-gitlab> [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'b4642d6abb5e0d622e301707a53f12f3a4185116', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-06-09T13:42:22.229268Z', 'started_at': '2026-06-09T13:42:22.893850Z', 'finished_at': None}]2052vm-test-run-nixbot-gitlab> (finished: subtest: push delivers the webhook, in 5.82 seconds)2053vm-test-run-nixbot-gitlab> subtest: eval and build post commit statuses2054vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses2055vm-test-run-nixbot-gitlab> gitlab # [  192.757753] nix-daemon[3309]: accepted connection from pid 3410, user nixbot2056vm-test-run-nixbot-gitlab> gitlab # [  192.764243] nix-daemon[3309]: accepted connection from pid 3411, user nixbot2057vm-test-run-nixbot-gitlab> gitlab # [  192.792730] gitaly[1382]: time="2026-06-09T13:42:25.619Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XG0H8YXQPYYYEBBNHFPN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:42:55.118" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:25.618" grpc.time_ms=0.535 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2058vm-test-run-nixbot-gitlab> gitlab # [  192.816138] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:25 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 882059vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses, in 0.11 seconds)2060vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': 'b4642d6abb5e0d622e301707a53f12f3a4185116', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-06-09T13:42:22.865Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2061vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses2062vm-test-run-nixbot-gitlab> gitlab # [  193.902247] gitaly[1382]: time="2026-06-09T13:42:26.728Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XH3QFCHEF0HYBP481X5C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:42:56.627" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:26.727" grpc.time_ms=0.716 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2063vm-test-run-nixbot-gitlab> gitlab # [  193.972187] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:26 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1182064vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses, in 0.16 seconds)2065vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': 'b4642d6abb5e0d622e301707a53f12f3a4185116', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-06-09T13:42:22.865Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2066vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses2067vm-test-run-nixbot-gitlab> gitlab # [  195.076510] gitaly[1382]: time="2026-06-09T13:42:27.903Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XJ81VSJ1VWGV7Y0WQ06R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:42:57.402" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:27.902" grpc.time_ms=0.591 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2068vm-test-run-nixbot-gitlab> gitlab # [  195.108897] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 932069vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses, in 0.13 seconds)2070vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': 'b4642d6abb5e0d622e301707a53f12f3a4185116', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-06-09T13:42:22.865Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2071vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses2072vm-test-run-nixbot-gitlab> gitlab # [  196.221772] gitaly[1382]: time="2026-06-09T13:42:29.046Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XKBGTZE93XN7484ERM59 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:42:59.044" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:29.045" grpc.time_ms=0.768 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2073vm-test-run-nixbot-gitlab> gitlab # [  196.246319] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 952074vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses, in 0.13 seconds)2075vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': 'b4642d6abb5e0d622e301707a53f12f3a4185116', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-06-09T13:42:22.865Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2076vm-test-run-nixbot-gitlab> gitlab # [  197.083260] nix-daemon[3309]: accepted connection from pid 3437, user nixbot2077vm-test-run-nixbot-gitlab> gitlab # [  197.112149] gitaly[1382]: time="2026-06-09T13:42:29.938Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XM81BZCZ68ZYNEN7F9SN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:42:59.837" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:29.937" grpc.time_ms=0.67 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2078vm-test-run-nixbot-gitlab> gitlab # [  197.197357] gitaly[1382]: time="2026-06-09T13:42:30.024Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XM81BZCZ68ZYNEN7F9SN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-09T13:42:40.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:30.018" grpc.time_ms=5.82 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2079vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses2080vm-test-run-nixbot-gitlab> gitlab # [  197.232160] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:30.058Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"32b80ed6921a828299eaeebc","created_at":"2026-06-09T13:42:30.048Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-91ed7a8939cf4dcc","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.052Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-32b80ed6921a828299eaeebc: start","job_status":"start","queue_duration_s":0.005526,"scheduling_latency_s":0.005559}2081vm-test-run-nixbot-gitlab> gitlab # [  197.257527] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:30 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b4642d6abb5e0d622e301707a53f12f3a4185116 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 1732082vm-test-run-nixbot-gitlab> gitlab # [  197.259048] nixbot[2998]: {"ts": "2026-06-09T13:42:30.079Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/b4642d6abb5e0d622e301707a53f12f3a4185116 \"HTTP/1.1 201 Created\""}2083vm-test-run-nixbot-gitlab> gitlab # [  197.306203] gitaly[1382]: time="2026-06-09T13:42:30.132Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XME490JY21XK401Z37PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:43:00.029" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:30.130" grpc.time_ms=1.009 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2084vm-test-run-nixbot-gitlab> gitlab # [  197.331123] gitaly[1382]: time="2026-06-09T13:42:30.158Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XMEP4AP0RKVHZJJK313G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:43:00.156" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:30.157" grpc.time_ms=0.465 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2085vm-test-run-nixbot-gitlab> gitlab # [  197.350590] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:30 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses HTTP/1.1" 200 671 "" "curl/8.20.0" 752086vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses, in 0.10 seconds)2087vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': 'b4642d6abb5e0d622e301707a53f12f3a4185116', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-06-09T13:42:22.865Z', 'started_at': None, 'finished_at': '2026-06-09T13:42:30.041Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2088vm-test-run-nixbot-gitlab> gitlab # [  197.361128] gitaly[1382]: time="2026-06-09T13:42:30.187Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=23 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XME490JY21XK401Z37PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-09T13:42:40.067" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:30.158" grpc.time_ms=29.352 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2089vm-test-run-nixbot-gitlab> gitlab # [  197.405479] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:30 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b4642d6abb5e0d622e301707a53f12f3a4185116 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1472090vm-test-run-nixbot-gitlab> gitlab # [  197.406821] nixbot[2998]: {"ts": "2026-06-09T13:42:30.233Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/b4642d6abb5e0d622e301707a53f12f3a4185116 \"HTTP/1.1 201 Created\""}2091vm-test-run-nixbot-gitlab> gitlab # [  197.571398] gitaly[1382]: time="2026-06-09T13:42:30.398Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9XM81BZCZ68ZYNEN7F9SN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:30.397" grpc.time_ms=0.976 pid=1382 span.kind=server system=grpc2092vm-test-run-nixbot-gitlab> gitlab # [  197.614246] gitaly[1382]: time="2026-06-09T13:42:30.440Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9XM81BZCZ68ZYNEN7F9SN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3901 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:30.440" grpc.time_ms=0.326 pid=1382 span.kind=server system=grpc2093vm-test-run-nixbot-gitlab> gitlab # [  197.651866] gitaly[1382]: time="2026-06-09T13:42:30.478Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9XM81BZCZ68ZYNEN7F9SN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:30.478" grpc.time_ms=0.319 pid=1382 span.kind=server system=grpc2094vm-test-run-nixbot-gitlab> gitlab # [  197.675764] gitaly[1382]: time="2026-06-09T13:42:30.502Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XM81BZCZ68ZYNEN7F9SN diskcache=bb7b3752-2b3a-43d4-88bc-e270b7014ece grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-09T13:43:00.267" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:30.368" pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2095vm-test-run-nixbot-gitlab> gitlab # [  197.677354] gitaly[1382]: time="2026-06-09T13:42:30.502Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=97 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7105 command.oublock=0 command.real_time_ms=129 command.spawn_token_fork_ms=0 command.system_time_ms=62 command.user_time_ms=35 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XM81BZCZ68ZYNEN7F9SN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-09T13:43:00.267" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:30.368" grpc.time_ms=134.661 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2096vm-test-run-nixbot-gitlab> gitlab # [  197.745555] gitaly[1382]: time="2026-06-09T13:42:30.572Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XM81BZCZ68ZYNEN7F9SN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-09T13:43:00.471" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:30.571" grpc.time_ms=0.863 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2097vm-test-run-nixbot-gitlab> gitlab # [  197.775824] gitaly[1382]: time="2026-06-09T13:42:30.602Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XM81BZCZ68ZYNEN7F9SN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:43:00.501" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:30.602" grpc.time_ms=0.464 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2098vm-test-run-nixbot-gitlab> gitlab # [  197.860798] gitaly[1382]: time="2026-06-09T13:42:30.687Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XM81BZCZ68ZYNEN7F9SN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:43:00.586" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:30.686" grpc.time_ms=0.728 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2099vm-test-run-nixbot-gitlab> gitlab # [  197.880869] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:30.703Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"d920637c29ca8cd56f3f1f48","created_at":"2026-06-09T13:42:30.697Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"32b80ed6921a828299eaeebc","job_size_bytes":3,"pid":2069,"job_status":"deduplicated","message":"PipelineProcessWorker JID-d920637c29ca8cd56f3f1f48: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2100vm-test-run-nixbot-gitlab> gitlab # [  197.905764] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:30.732Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"32b80ed6921a828299eaeebc","created_at":"2026-06-09T13:42:30.048Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-91ed7a8939cf4dcc","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.052Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2069,"job_status":"rescheduled","message":"PipelineProcessWorker JID-32b80ed6921a828299eaeebc: rescheduled"}2101vm-test-run-nixbot-gitlab> gitlab # [  197.953180] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:30.779Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"32b80ed6921a828299eaeebc","created_at":"2026-06-09T13:42:30.048Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-91ed7a8939cf4dcc","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.052Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-32b80ed6921a828299eaeebc: done: 0.722592 sec","job_status":"done","queue_duration_s":0.005526,"scheduling_latency_s":0.005559,"gitaly_calls":4,"gitaly_duration_s":0.152252,"redis_calls":93,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.377812,"redis_read_bytes":262,"redis_write_bytes":23386,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.139921,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":21,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.01107,"redis_cache_read_bytes":39,"redis_cache_write_bytes":1840,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004763,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":712,"redis_queues_calls":25,"redis_queues_duration_s":0.012672,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14467,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.052116,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.003682,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002913,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.010754,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":38,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":38,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.104,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":23,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.051,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.055,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.057,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.139207,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.60895449,"duration_s":0.722592,"completed_at":"2026-06-09T13:42:30.779Z","load_balancing_strategy":"primary","db_duration_s":0.14263,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2102vm-test-run-nixbot-gitlab> gitlab # [  198.044398] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:30.870Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"52c4cd0721c4b73be5af7d8c","created_at":"2026-06-09T13:42:30.358Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.361Z","job_size_bytes":23,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-52c4cd0721c4b73be5af7d8c: start","job_status":"start","queue_duration_s":0.509537,"scheduling_latency_s":0.509574}2103vm-test-run-nixbot-gitlab> gitlab # [  198.171200] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:30.997Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"52c4cd0721c4b73be5af7d8c","created_at":"2026-06-09T13:42:30.358Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.361Z","job_size_bytes":23,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-52c4cd0721c4b73be5af7d8c: done: 0.126199 sec","job_status":"done","queue_duration_s":0.509537,"scheduling_latency_s":0.509574,"redis_calls":7,"redis_duration_s":0.016927,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.013277,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00365,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.126199,"completed_at":"2026-06-09T13:42:30.996Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040525,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2104vm-test-run-nixbot-gitlab> gitlab # [  198.176864] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.003Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"21a0c7790823d6580c5020f9","created_at":"2026-06-09T13:42:30.509Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.513Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-21a0c7790823d6580c5020f9: start","job_status":"start","queue_duration_s":0.48983,"scheduling_latency_s":0.489884}2105vm-test-run-nixbot-gitlab> gitlab # [  198.244772] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.070Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"21a0c7790823d6580c5020f9","created_at":"2026-06-09T13:42:30.509Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.513Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-21a0c7790823d6580c5020f9: done: 0.067003 sec","job_status":"done","queue_duration_s":0.48983,"scheduling_latency_s":0.489884,"redis_calls":7,"redis_duration_s":0.0143,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009971,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004329,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.067003,"completed_at":"2026-06-09T13:42:31.070Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00889,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2106vm-test-run-nixbot-gitlab> gitlab # [  198.262622] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.083Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"b190b76e439681d728b94324","created_at":"2026-06-09T13:42:30.531Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.533Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-b190b76e439681d728b94324: start","job_status":"start","queue_duration_s":0.549856,"scheduling_latency_s":0.5499}2107vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses2108vm-test-run-nixbot-gitlab> gitlab # [  198.333887] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.147Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"b190b76e439681d728b94324","created_at":"2026-06-09T13:42:30.531Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.533Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-b190b76e439681d728b94324: done: 0.063833 sec","job_status":"done","queue_duration_s":0.549856,"scheduling_latency_s":0.5499,"redis_calls":7,"redis_duration_s":0.014591,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009655,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004936,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.063833,"completed_at":"2026-06-09T13:42:31.147Z","load_balancing_strategy":"primary","db_duration_s":0.013482,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2109vm-test-run-nixbot-gitlab> gitlab # [  198.410971] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.152Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"14eab0d38713b6de51d201dc","created_at":"2026-06-09T13:42:30.544Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.547Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-14eab0d38713b6de51d201dc: start","job_status":"start","queue_duration_s":0.604978,"scheduling_latency_s":0.60502}2110vm-test-run-nixbot-gitlab> gitlab # [  198.412312] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.228Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"14eab0d38713b6de51d201dc","created_at":"2026-06-09T13:42:30.544Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.547Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-14eab0d38713b6de51d201dc: done: 0.076255 sec","job_status":"done","queue_duration_s":0.604978,"scheduling_latency_s":0.60502,"redis_calls":10,"redis_duration_s":0.010111,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00562,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002747,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001744,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.076255,"completed_at":"2026-06-09T13:42:31.228Z","load_balancing_strategy":"primary","db_duration_s":0.008478,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2111vm-test-run-nixbot-gitlab> gitlab # [  198.491793] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.231Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4257e5afe9443db07a4281f5","created_at":"2026-06-09T13:42:30.548Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.551Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4257e5afe9443db07a4281f5: start","job_status":"start","queue_duration_s":0.680308,"scheduling_latency_s":0.680334}2112vm-test-run-nixbot-gitlab> gitlab # [  198.493233] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.264Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4257e5afe9443db07a4281f5","created_at":"2026-06-09T13:42:30.548Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.551Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4257e5afe9443db07a4281f5: done: 0.033292 sec","job_status":"done","queue_duration_s":0.680308,"scheduling_latency_s":0.680334,"redis_calls":7,"redis_duration_s":0.0063880000000000004,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005145,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001243,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033292,"completed_at":"2026-06-09T13:42:31.264Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010176,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2113vm-test-run-nixbot-gitlab> gitlab # [  198.596178] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.268Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"2d2e70c3755d30c26827f215","created_at":"2026-06-09T13:42:30.552Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.556Z","job_size_bytes":19,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-2d2e70c3755d30c26827f215: start","job_status":"start","queue_duration_s":0.712716,"scheduling_latency_s":0.712739}2114vm-test-run-nixbot-gitlab> gitlab # [  198.597391] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.301Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"2d2e70c3755d30c26827f215","created_at":"2026-06-09T13:42:30.552Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.556Z","job_size_bytes":19,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-2d2e70c3755d30c26827f215: done: 0.032336 sec","job_status":"done","queue_duration_s":0.712716,"scheduling_latency_s":0.712739,"redis_calls":8,"redis_duration_s":0.00673,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004707,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002023,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032336,"completed_at":"2026-06-09T13:42:31.301Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003831,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2115vm-test-run-nixbot-gitlab> gitlab # [  198.668170] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.305Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f9e87e3a3f7c1a6caff2e7f0","created_at":"2026-06-09T13:42:30.557Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.560Z","job_size_bytes":66,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f9e87e3a3f7c1a6caff2e7f0: start","job_status":"start","queue_duration_s":0.744929,"scheduling_latency_s":0.744952}2116vm-test-run-nixbot-gitlab> gitlab # [  198.669467] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.334Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f9e87e3a3f7c1a6caff2e7f0","created_at":"2026-06-09T13:42:30.557Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.560Z","job_size_bytes":66,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f9e87e3a3f7c1a6caff2e7f0: done: 0.029089 sec","job_status":"done","queue_duration_s":0.744929,"scheduling_latency_s":0.744952,"redis_calls":7,"redis_duration_s":0.006742,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00423,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002512,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029089,"completed_at":"2026-06-09T13:42:31.334Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002615,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2117vm-test-run-nixbot-gitlab> gitlab # [  198.740679] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.337Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"155a0e28aef12f4a7c7a9571","created_at":"2026-06-09T13:42:30.561Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.564Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-155a0e28aef12f4a7c7a9571: start","job_status":"start","queue_duration_s":0.7729,"scheduling_latency_s":0.772922}2118vm-test-run-nixbot-gitlab> gitlab # [  198.741934] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.377Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"155a0e28aef12f4a7c7a9571","created_at":"2026-06-09T13:42:30.561Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.564Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-155a0e28aef12f4a7c7a9571: done: 0.039858 sec","job_status":"done","queue_duration_s":0.7729,"scheduling_latency_s":0.772922,"redis_calls":7,"redis_duration_s":0.006232,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004563,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001669,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039858,"completed_at":"2026-06-09T13:42:31.377Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007526,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2119vm-test-run-nixbot-gitlab> gitlab # [  198.810335] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.380Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"011256c4cfb5357cd76729eb","created_at":"2026-06-09T13:42:30.624Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.630Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-011256c4cfb5357cd76729eb: start","job_status":"start","queue_duration_s":0.750421,"scheduling_latency_s":0.750453}2120vm-test-run-nixbot-gitlab> gitlab # [  198.831420] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.410Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"011256c4cfb5357cd76729eb","created_at":"2026-06-09T13:42:30.624Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.630Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-011256c4cfb5357cd76729eb: done: 0.029467 sec","job_status":"done","queue_duration_s":0.750421,"scheduling_latency_s":0.750453,"redis_calls":7,"redis_duration_s":0.00451,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003821,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000689,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029467,"completed_at":"2026-06-09T13:42:31.410Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003743,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2121vm-test-run-nixbot-gitlab> gitlab # [  198.912186] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.413Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"6d4a0e761100c0fc526291c1","created_at":"2026-06-09T13:42:30.631Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.636Z","job_size_bytes":6,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-6d4a0e761100c0fc526291c1: start","job_status":"start","queue_duration_s":0.776611,"scheduling_latency_s":0.776633}2122vm-test-run-nixbot-gitlab> gitlab # [  198.921248] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.443Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"6d4a0e761100c0fc526291c1","created_at":"2026-06-09T13:42:30.631Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.636Z","job_size_bytes":6,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-6d4a0e761100c0fc526291c1: done: 0.029714 sec","job_status":"done","queue_duration_s":0.776611,"scheduling_latency_s":0.776633,"redis_calls":7,"redis_duration_s":0.005116,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004432,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000684,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029714,"completed_at":"2026-06-09T13:42:31.443Z","load_balancing_strategy":"primary","db_duration_s":0.001245,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2123vm-test-run-nixbot-gitlab> gitlab # [  198.999081] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.446Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"4bb539499ce943a36f7c3178","created_at":"2026-06-09T13:42:30.637Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.648Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-4bb539499ce943a36f7c3178: start","job_status":"start","queue_duration_s":0.798304,"scheduling_latency_s":0.798327}2124vm-test-run-nixbot-gitlab> gitlab # [  199.008967] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.485Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"4bb539499ce943a36f7c3178","created_at":"2026-06-09T13:42:30.637Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.648Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-4bb539499ce943a36f7c3178: done: 0.038514 sec","job_status":"done","queue_duration_s":0.798304,"scheduling_latency_s":0.798327,"redis_calls":10,"redis_duration_s":0.0075049999999999995,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001416,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005417,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000672,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001216635,"duration_s":0.038514,"completed_at":"2026-06-09T13:42:31.485Z","load_balancing_strategy":"primary","db_duration_s":0.007106,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2125vm-test-run-nixbot-gitlab> gitlab # [  199.080119] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.489Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"cb2eadf9dae4c35e0070ac20","created_at":"2026-06-09T13:42:30.756Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.762Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-cb2eadf9dae4c35e0070ac20: start","job_status":"start","queue_duration_s":0.726321,"scheduling_latency_s":0.726341}2126vm-test-run-nixbot-gitlab> gitlab # [  199.099578] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.606Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"cb2eadf9dae4c35e0070ac20","created_at":"2026-06-09T13:42:30.756Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-66d6d59e5f014b80","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:30.762Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-cb2eadf9dae4c35e0070ac20: done: 0.117496 sec","job_status":"done","queue_duration_s":0.726321,"scheduling_latency_s":0.726341,"gitaly_calls":3,"gitaly_duration_s":0.00679,"redis_calls":44,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.014615,"redis_read_bytes":98,"redis_write_bytes":6014,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.003161,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.0017,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_queues_calls":2,"redis_queues_duration_s":0.000288,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002947,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000389,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000413,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002556,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":20,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070721,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.090552571,"duration_s":0.117496,"completed_at":"2026-06-09T13:42:31.606Z","load_balancing_strategy":"primary","db_duration_s":0.031589,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2127vm-test-run-nixbot-gitlab> gitlab # [  199.212834] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.607Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"4e31ea77d68eb3e61c904981","created_at":"2026-06-09T13:42:31.547Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-c1343d9ad18448d9","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:31.548Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-4e31ea77d68eb3e61c904981: start","job_status":"start","queue_duration_s":0.059025,"scheduling_latency_s":0.059047}2128vm-test-run-nixbot-gitlab> gitlab # [  199.214113] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:31.630Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"4e31ea77d68eb3e61c904981","created_at":"2026-06-09T13:42:31.547Z","trace_propagation_headers":{"sentry-trace":"459e671dbe864c0b8fe3e1ddb4691996-c1343d9ad18448d9","baggage":"sentry-trace_id=459e671dbe864c0b8fe3e1ddb4691996,sentry-release=Unknown"},"correlation_id":"01KTP9XM81BZCZ68ZYNEN7F9SN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:31.548Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-4e31ea77d68eb3e61c904981: done: 0.022593 sec","job_status":"done","queue_duration_s":0.059025,"scheduling_latency_s":0.059047,"redis_calls":7,"redis_duration_s":0.001562,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001141,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000421,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022593,"completed_at":"2026-06-09T13:42:31.630Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002488,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2129vm-test-run-nixbot-gitlab> gitlab # [  199.283544] gitaly[1382]: time="2026-06-09T13:42:31.557Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XM81BZCZ68ZYNEN7F9SN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-09T13:43:01.456" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:31.556" grpc.time_ms=0.702 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2130vm-test-run-nixbot-gitlab> gitlab # [  199.287096] gitaly[1382]: time="2026-06-09T13:42:31.578Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XM81BZCZ68ZYNEN7F9SN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:43:01.477" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:31.577" grpc.time_ms=0.439 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2131vm-test-run-nixbot-gitlab> gitlab # [  199.360470] gitaly[1382]: time="2026-06-09T13:42:31.597Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XM81BZCZ68ZYNEN7F9SN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:43:01.496" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:31.596" grpc.time_ms=0.511 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2132vm-test-run-nixbot-gitlab> gitlab # [  199.428791] gitaly[1382]: time="2026-06-09T13:42:32.255Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XNH6PWDMR61GY6FE0Z60 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:43:02.153" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:32.254" grpc.time_ms=1.038 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2133vm-test-run-nixbot-gitlab> gitlab # [  199.489161] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:32 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 11082134vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses, in 1.15 seconds)2135vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': 'b4642d6abb5e0d622e301707a53f12f3a4185116', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-06-09T13:42:22.865Z', 'started_at': None, 'finished_at': '2026-06-09T13:42:30.041Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': 'b4642d6abb5e0d622e301707a53f12f3a4185116', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-06-09T13:42:30.214Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2136vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses2137vm-test-run-nixbot-gitlab> gitlab # [  200.600354] gitaly[1382]: time="2026-06-09T13:42:33.426Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XQMF5YNHC0G8K67TYH00 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:43:03.424" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:33.424" grpc.time_ms=0.919 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2138vm-test-run-nixbot-gitlab> gitlab # [  200.619848] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:33 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 862139vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses, in 0.13 seconds)2140vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': 'b4642d6abb5e0d622e301707a53f12f3a4185116', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-06-09T13:42:22.865Z', 'started_at': None, 'finished_at': '2026-06-09T13:42:30.041Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': 'b4642d6abb5e0d622e301707a53f12f3a4185116', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-06-09T13:42:30.214Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2141vm-test-run-nixbot-gitlab> gitlab # [  201.556549] nix-daemon[3309]: accepted connection from pid 3506, user nixbot2142vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses2143vm-test-run-nixbot-gitlab> gitlab # [  201.642551] gitaly[1382]: time="2026-06-09T13:42:34.468Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XRNJTKH95GJEF5SCMDVJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:43:04.466" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:34.467" grpc.time_ms=0.722 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2144vm-test-run-nixbot-gitlab> gitlab # [  201.673566] gitaly[1382]: time="2026-06-09T13:42:34.500Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KTP9XRNJTKH95GJEF5SCMDVJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-09T13:42:44.090" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-09T13:42:34.491" grpc.time_ms=8.848 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2145vm-test-run-nixbot-gitlab> gitlab # [  201.715327] sidekiq-cluster[2069]: {"severity":"INFO","time":"2026-06-09T13:42:34.541Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f684e5911574682090668dca","created_at":"2026-06-09T13:42:34.537Z","trace_propagation_headers":{"sentry-trace":"78bcf396bc4248dfa9eae8b982aa9059-f94e80eb7d16414c","baggage":"sentry-trace_id=78bcf396bc4248dfa9eae8b982aa9059,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KTP9XRNJTKH95GJEF5SCMDVJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-09T13:42:34.540Z","job_size_bytes":3,"pid":2069,"sidekiq_tid":"ma4l","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f684e5911574682090668dca: start","job_status":"start","queue_duration_s":0.001215,"scheduling_latency_s":0.001251}2146vm-test-run-nixbot-gitlab> gitlab # [  201.734307] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b4642d6abb5e0d622e301707a53f12f3a4185116 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1412147vm-test-run-nixbot-gitlab> gitlab # [  201.737536] nixbot[2998]: {"ts": "2026-06-09T13:42:34.563Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/b4642d6abb5e0d622e301707a53f12f3a4185116 \"HTTP/1.1 201 Created\""}2148vm-test-run-nixbot-gitlab> gitlab # [  201.801237] gitaly[1382]: time="2026-06-09T13:42:34.627Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9XRNJTKH95GJEF5SCMDVJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:34.627" grpc.time_ms=0.374 pid=1382 span.kind=server system=grpc2149vm-test-run-nixbot-gitlab> gitlab # [  201.806934] gitaly[1382]: time="2026-06-09T13:42:34.633Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KTP9XRV2KFR8VACS45PTTGQ6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-09T13:43:04.131" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-09T13:42:34.632" grpc.time_ms=0.722 pid=1382 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2150vm-test-run-nixbot-gitlab> gitlab # [  201.831542] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/06/09:13:42:34 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses HTTP/1.1" 200 1328 "" "curl/8.20.0" 632151vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b4642d6abb5e0d622e301707a53f12f3a4185116/statuses, in 0.20 seconds)2152vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': 'b4642d6abb5e0d622e301707a53f12f3a4185116', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-06-09T13:42:22.865Z', 'started_at': None, 'finished_at': '2026-06-09T13:42:30.041Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': 'b4642d6abb5e0d622e301707a53f12f3a4185116', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-06-09T13:42:30.214Z', 'started_at': None, 'finished_at': '2026-06-09T13:42:34.530Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2153vm-test-run-nixbot-gitlab> (finished: subtest: eval and build post commit statuses, in 9.13 seconds)2154vm-test-run-nixbot-gitlab> (finished: run the VM test script, in 240.37 seconds)2155vm-test-run-nixbot-gitlab> gitlab # [  201.869672] gitaly[1382]: time="2026-06-09T13:42:34.696Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KTP9XRNJTKH95GJEF5SCMDVJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3901 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-09T13:42:34.696" grpc.time_ms=0.481 pid=1382 span.kind=server system=grpc2156vm-test-run-nixbot-gitlab> test script finished in 240.42s2157vm-test-run-nixbot-gitlab> cleanup2158vm-test-run-nixbot-gitlab> kill QemuMachine (pid 13)2159vm-test-run-nixbot-gitlab> gitlab # qemu-system-x86_64: terminating on signal 15 from pid 6 (/nix/store/60m4rxhg2fldqaak400c0lry96ijrzqn-python3-3.13.13/bin/python3.13)2160vm-test-run-nixbot-gitlab> (finished: cleanup, in 1.33 seconds)21612162post-build step Upload coverage to codecov: ok2163Skipping codecov: project=Mic92/nixbot attr=x86_64-linux.nixbot-gitlab