1these 14 derivations will be built:2 /nix/store/mhjfjbyvw8xvgbhdwzypl676gcpph1lk-python3.13-nixbot.drv3 /nix/store/xw1ya1y8x4byj12yb6jfz03sp1gw5g24-nixbot-effects.drv4 /nix/store/inn3mcns5y1jzllj7c5iad4zi888848i-unit-nixbot.service.drv5 /nix/store/w7kijnpbzajdplsqw79jpkfq2sarg97y-system-units.drv6 /nix/store/1nq22r88gplrlvd9h8bs2njnsm2dgalq-etc.drv7 /nix/store/cgrdk5h4ky0j4v7bsjczns90lhimvfzz-activate.drv8 /nix/store/h3s27jbgjr1727z9srsrclblw5hrc1f4-nixos-system-gitlab-test.drv9 /nix/store/8l7rrg7ns8wc30hzmfk8apn2ikmnqxkc-closure-info.drv10 /nix/store/sb87lviyf5619aaj217xk327cbdjb0dq-closure-info.drv11 /nix/store/y9cagfa02pr8s4p0lfa5xxx0hvk9391a-run-nixos-vm.drv12 /nix/store/kq2hilpj3qlvr5mbybz4fmi1d7ss50ay-nixos-vm.drv13 /nix/store/br0b3qdmxcfprlnd0vlx9sms9w6ib0ci-driverConfiguration.json.drv14 /nix/store/j66rx79033mnryvaj8is72jz0x214sl3-nixos-test-driver-nixbot-gitlab.drv15 /nix/store/4xabklngh44aaffm92409gcr910f0jxn-vm-test-run-nixbot-gitlab.drv16building '/nix/store/xw1ya1y8x4byj12yb6jfz03sp1gw5g24-nixbot-effects.drv' on 'ssh-ng://nix@jamie'17building '/nix/store/xw1ya1y8x4byj12yb6jfz03sp1gw5g24-nixbot-effects.drv'18nixbot-effects> Sourcing python-remove-tests-dir-hook19nixbot-effects> Sourcing python-catch-conflicts-hook.sh20nixbot-effects> Sourcing python-remove-bin-bytecode-hook.sh21nixbot-effects> Sourcing pypa-build-hook22nixbot-effects> Using pypaBuildPhase23nixbot-effects> Sourcing python-runtime-deps-check-hook24nixbot-effects> Using pythonRuntimeDepsCheckHook25nixbot-effects> Sourcing pypa-install-hook26nixbot-effects> Using pypaInstallPhase27nixbot-effects> Sourcing python-imports-check-hook.sh28nixbot-effects> Using pythonImportsCheckPhase29nixbot-effects> Sourcing python-namespaces-hook30nixbot-effects> Sourcing python-catch-conflicts-hook.sh31nixbot-effects> Running phase: unpackPhase32nixbot-effects> unpacking source archive /nix/store/k8mdjs19pkh4g6mfay3al6zlgymn3m8l-nixbot_effects33nixbot-effects> source root is nixbot_effects34nixbot-effects> setting SOURCE_DATE_EPOCH to timestamp 315619200 of file "nixbot_effects/pyproject.toml"35nixbot-effects> Running phase: patchPhase36nixbot-effects> Running phase: updateAutotoolsGnuConfigScriptsPhase37nixbot-effects> Running phase: configurePhase38nixbot-effects> no configure script, doing nothing39nixbot-effects> Running phase: buildPhase40nixbot-effects> Executing pypaBuildPhase41nixbot-effects> Creating a wheel...42nixbot-effects> pypa build flags: --no-isolation --outdir dist/ --wheel43nixbot-effects> * Getting build dependencies for wheel...44nixbot-effects> * Building wheel...45nixbot-effects> Successfully built nixbot_effects-0.0.1-py3-none-any.whl46nixbot-effects> Finished creating a wheel...47nixbot-effects> Finished executing pypaBuildPhase48nixbot-effects> Running phase: pythonRuntimeDepsCheckHook49nixbot-effects> Executing pythonRuntimeDepsCheck50nixbot-effects> Checking runtime dependencies for nixbot_effects-0.0.1-py3-none-any.whl51nixbot-effects> Finished executing pythonRuntimeDepsCheck52nixbot-effects> Running phase: installPhase53nixbot-effects> Executing pypaInstallPhase54nixbot-effects> Successfully installed nixbot_effects-0.0.1-py3-none-any.whl55nixbot-effects> Finished executing pypaInstallPhase56nixbot-effects> Running phase: pythonOutputDistPhase57nixbot-effects> Executing pythonOutputDistPhase58nixbot-effects> Finished executing pythonOutputDistPhase59nixbot-effects> Running phase: fixupPhase60nixbot-effects> shrinking RPATHs of ELF executables and libraries in /nix/store/1sb10gyj40bxh3f3sa5yjqj0p47mjzh4-nixbot-effects61nixbot-effects> checking for references to /build/ in /nix/store/1sb10gyj40bxh3f3sa5yjqj0p47mjzh4-nixbot-effects...62nixbot-effects> patching script interpreter paths in /nix/store/1sb10gyj40bxh3f3sa5yjqj0p47mjzh4-nixbot-effects63nixbot-effects> stripping (with command strip and flags -S -p) in /nix/store/1sb10gyj40bxh3f3sa5yjqj0p47mjzh4-nixbot-effects/lib /nix/store/1sb10gyj40bxh3f3sa5yjqj0p47mjzh4-nixbot-effects/bin64nixbot-effects> shrinking RPATHs of ELF executables and libraries in /nix/store/75xmz5dw3w49d45vk4lpikr0fpwmlxlr-nixbot-effects-dist65nixbot-effects> checking for references to /build/ in /nix/store/75xmz5dw3w49d45vk4lpikr0fpwmlxlr-nixbot-effects-dist...66nixbot-effects> patching script interpreter paths in /nix/store/75xmz5dw3w49d45vk4lpikr0fpwmlxlr-nixbot-effects-dist67nixbot-effects> Rewriting #!/nix/store/60m4rxhg2fldqaak400c0lry96ijrzqn-python3-3.13.13/bin/python3.13 to #!/nix/store/60m4rxhg2fldqaak400c0lry96ijrzqn-python3-3.13.1368nixbot-effects> wrapping `/nix/store/1sb10gyj40bxh3f3sa5yjqj0p47mjzh4-nixbot-effects/bin/nixbot-effects'...69nixbot-effects> Executing pythonRemoveTestsDir70nixbot-effects> Finished executing pythonRemoveTestsDir71nixbot-effects> Running phase: installCheckPhase72nixbot-effects> no Makefile or custom installCheckPhase, doing nothing73nixbot-effects> Running phase: pythonCatchConflictsPhase74nixbot-effects> Running phase: pythonRemoveBinBytecodePhase75nixbot-effects> Running phase: pythonImportsCheckPhase76nixbot-effects> Executing pythonImportsCheckPhase77building '/nix/store/inn3mcns5y1jzllj7c5iad4zi888848i-unit-nixbot.service.drv'78building '/nix/store/w7kijnpbzajdplsqw79jpkfq2sarg97y-system-units.drv'79building '/nix/store/1nq22r88gplrlvd9h8bs2njnsm2dgalq-etc.drv'80building '/nix/store/cgrdk5h4ky0j4v7bsjczns90lhimvfzz-activate.drv'81building '/nix/store/h3s27jbgjr1727z9srsrclblw5hrc1f4-nixos-system-gitlab-test.drv'82nixos-system-gitlab-test> structuredAttrs is enabled83building '/nix/store/8l7rrg7ns8wc30hzmfk8apn2ikmnqxkc-closure-info.drv'84closure-info> structuredAttrs is enabled85building '/nix/store/sb87lviyf5619aaj217xk327cbdjb0dq-closure-info.drv'86closure-info> structuredAttrs is enabled87building '/nix/store/y9cagfa02pr8s4p0lfa5xxx0hvk9391a-run-nixos-vm.drv'88building '/nix/store/kq2hilpj3qlvr5mbybz4fmi1d7ss50ay-nixos-vm.drv'89building '/nix/store/br0b3qdmxcfprlnd0vlx9sms9w6ib0ci-driverConfiguration.json.drv'90driverConfiguration.json> structuredAttrs is enabled91building '/nix/store/j66rx79033mnryvaj8is72jz0x214sl3-nixos-test-driver-nixbot-gitlab.drv'92nixos-test-driver-nixbot-gitlab> Running type check (enable/disable: config.skipTypeCheck)93nixos-test-driver-nixbot-gitlab> See https://nixos.org/manual/nixos/stable/#test-opt-skipTypeCheck94nixos-test-driver-nixbot-gitlab> All checks passed!95nixos-test-driver-nixbot-gitlab> Linting test script (enable/disable: config.skipLint)96nixos-test-driver-nixbot-gitlab> See https://nixos.org/manual/nixos/stable/#test-opt-skipLint97nixos-test-driver-nixbot-gitlab> All checks passed!98building '/nix/store/4xabklngh44aaffm92409gcr910f0jxn-vm-test-run-nixbot-gitlab.drv' on 'ssh-ng://nix@jamie'99building '/nix/store/4xabklngh44aaffm92409gcr910f0jxn-vm-test-run-nixbot-gitlab.drv'100vm-test-run-nixbot-gitlab> Machine state will be reset. To keep it, pass --keep-machine-state101vm-test-run-nixbot-gitlab> start all VLans102vm-test-run-nixbot-gitlab> (finished: start all VLans, in 0.00 seconds)103vm-test-run-nixbot-gitlab> Test will time out and terminate in 3600 seconds104vm-test-run-nixbot-gitlab> run the VM test script105vm-test-run-nixbot-gitlab> additionally exposed symbols:106vm-test-run-nixbot-gitlab> gitlab,107vm-test-run-nixbot-gitlab> vlan1,108vm-test-run-nixbot-gitlab> start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh109vm-test-run-nixbot-gitlab> start all VMs110vm-test-run-nixbot-gitlab> gitlab: starting vm111vm-test-run-nixbot-gitlab> gitlab # Disk image does not exist, creating the virtualisation disk image...112vm-test-run-nixbot-gitlab> gitlab: QEMU running (pid 13)113vm-test-run-nixbot-gitlab> gitlab # Formatting '/build/vm-state-gitlab/tmp.LXMSs7tzbW', fmt=raw size=1073741824114vm-test-run-nixbot-gitlab> gitlab # mke2fs 1.47.3 (8-Jul-2025)115vm-test-run-nixbot-gitlab> gitlab # Discarding device blocks: 0/262144 done116vm-test-run-nixbot-gitlab> gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes117vm-test-run-nixbot-gitlab> gitlab # Filesystem UUID: 0c454625-1272-4c9e-b6bf-5ab899735482118vm-test-run-nixbot-gitlab> gitlab # Superblock backups stored on blocks:119vm-test-run-nixbot-gitlab> gitlab # 32768, 98304, 163840, 229376120vm-test-run-nixbot-gitlab> gitlab # 121vm-test-run-nixbot-gitlab> gitlab # Allocating group tables: 0/8 done122vm-test-run-nixbot-gitlab> gitlab # Writing inode tables: 0/8 done123vm-test-run-nixbot-gitlab> gitlab # Creating journal (8192 blocks): done124vm-test-run-nixbot-gitlab> gitlab # Writing superblocks and filesystem accounting information: 0/8 done125vm-test-run-nixbot-gitlab> gitlab # 126vm-test-run-nixbot-gitlab> gitlab # Virtualisation disk image created.127vm-test-run-nixbot-gitlab> gitlab # Creating Nix store image...128vm-test-run-nixbot-gitlab> gitlab # Created Nix store image.129vm-test-run-nixbot-gitlab> (finished: start all VMs, in 37.44 seconds)130vm-test-run-nixbot-gitlab> gitlab: waiting for unit setup-gitlab.service131vm-test-run-nixbot-gitlab> gitlab: waiting for the VM to finish booting132vm-test-run-nixbot-gitlab> gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)133vm-test-run-nixbot-gitlab> gitlab # 134vm-test-run-nixbot-gitlab> gitlab # 135vm-test-run-nixbot-gitlab> gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA00136vm-test-run-nixbot-gitlab> gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...137vm-test-run-nixbot-gitlab> gitlab # 138vm-test-run-nixbot-gitlab> gitlab # 139vm-test-run-nixbot-gitlab> gitlab # 140vm-test-run-nixbot-gitlab> gitlab # 141vm-test-run-nixbot-gitlab> gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB00142vm-test-run-nixbot-gitlab> gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...143vm-test-run-nixbot-gitlab> gitlab # 144vm-test-run-nixbot-gitlab> gitlab # 145vm-test-run-nixbot-gitlab> gitlab # Booting from ROM...146vm-test-run-nixbot-gitlab> gitlab # Probing EDD (edd=off to disable)... ok147vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Linux version 6.18.34 (nixbld@localhost) (gcc (GCC) 15.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Jun 1 15:51:08 UTC 2026148vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/p0qj7z4r3akcvwhzgyd8sba9pfn9a0z8-nixos-system-gitlab-test/init regInfo=/nix/store/lym23hc710kwqdd7k33lj4z854f8dggb-closure-info/registration console=ttyS0,115200n8 console=tty0149vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-provided physical RAM map:150vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable151vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved152vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved153vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable154vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved155vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved156vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved157vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable158vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved159vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] NX (Execute Disable) protection: active160vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] APIC: Static calls initialized161vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] SMBIOS 2.8 present.162vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014163vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] DMI: Memory slots populated: 1/1164vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Hypervisor detected: KVM165vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000166vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00167vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] kvm-clock: using sched offset of 528316502 cycles168vm-test-run-nixbot-gitlab> gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns169vm-test-run-nixbot-gitlab> gitlab # [ 0.000005] tsc: Detected 2400.010 MHz processor170vm-test-run-nixbot-gitlab> gitlab # [ 0.000812] last_pfn = 0x1c0000 max_arch_pfn = 0x10000000000171vm-test-run-nixbot-gitlab> gitlab # [ 0.000849] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs172vm-test-run-nixbot-gitlab> gitlab # [ 0.000852] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT173vm-test-run-nixbot-gitlab> gitlab # [ 0.000903] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000174vm-test-run-nixbot-gitlab> gitlab # [ 0.002756] found SMP MP-table at [mem 0x000f5470-0x000f547f]175vm-test-run-nixbot-gitlab> gitlab # [ 0.002768] Using GB pages for direct mapping176vm-test-run-nixbot-gitlab> gitlab # [ 0.002855] RAMDISK: [mem 0xbe4e0000-0xbffcffff]177vm-test-run-nixbot-gitlab> gitlab # [ 0.002861] ACPI: Early table checksum verification disabled178vm-test-run-nixbot-gitlab> gitlab # [ 0.002864] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )179vm-test-run-nixbot-gitlab> gitlab # [ 0.002867] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)180vm-test-run-nixbot-gitlab> gitlab # [ 0.002872] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)181vm-test-run-nixbot-gitlab> gitlab # [ 0.002878] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)182vm-test-run-nixbot-gitlab> gitlab # [ 0.002880] ACPI: FACS 0x00000000BFFE0000 000040183vm-test-run-nixbot-gitlab> gitlab # [ 0.002882] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)184vm-test-run-nixbot-gitlab> gitlab # [ 0.002883] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)185vm-test-run-nixbot-gitlab> gitlab # [ 0.002885] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)186vm-test-run-nixbot-gitlab> gitlab # [ 0.002886] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]187vm-test-run-nixbot-gitlab> gitlab # [ 0.002887] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]188vm-test-run-nixbot-gitlab> gitlab # [ 0.002888] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]189vm-test-run-nixbot-gitlab> gitlab # [ 0.002888] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]190vm-test-run-nixbot-gitlab> gitlab # [ 0.002889] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]191vm-test-run-nixbot-gitlab> gitlab # [ 0.002889] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]192vm-test-run-nixbot-gitlab> gitlab # [ 0.003378] No NUMA configuration found193vm-test-run-nixbot-gitlab> gitlab # [ 0.003380] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]194vm-test-run-nixbot-gitlab> gitlab # [ 0.003383] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]195vm-test-run-nixbot-gitlab> gitlab # [ 0.006026] Zone ranges:196vm-test-run-nixbot-gitlab> gitlab # [ 0.006027] DMA [mem 0x0000000000001000-0x0000000000ffffff]197vm-test-run-nixbot-gitlab> gitlab # [ 0.006029] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]198vm-test-run-nixbot-gitlab> gitlab # [ 0.006030] Normal [mem 0x0000000100000000-0x00000001bfffffff]199vm-test-run-nixbot-gitlab> gitlab # [ 0.006031] Device empty200vm-test-run-nixbot-gitlab> gitlab # [ 0.006031] Movable zone start for each node201vm-test-run-nixbot-gitlab> gitlab # [ 0.006032] Early memory node ranges202vm-test-run-nixbot-gitlab> gitlab # [ 0.006032] node 0: [mem 0x0000000000001000-0x000000000009efff]203vm-test-run-nixbot-gitlab> gitlab # [ 0.006033] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]204vm-test-run-nixbot-gitlab> gitlab # [ 0.006034] node 0: [mem 0x0000000100000000-0x00000001bfffffff]205vm-test-run-nixbot-gitlab> gitlab # [ 0.006035] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]206vm-test-run-nixbot-gitlab> gitlab # [ 0.006056] On node 0, zone DMA: 1 pages in unavailable ranges207vm-test-run-nixbot-gitlab> gitlab # [ 0.006335] On node 0, zone DMA: 97 pages in unavailable ranges208vm-test-run-nixbot-gitlab> gitlab # [ 0.118290] On node 0, zone Normal: 40 pages in unavailable ranges209vm-test-run-nixbot-gitlab> gitlab # [ 0.119322] ACPI: PM-Timer IO Port: 0x608210vm-test-run-nixbot-gitlab> gitlab # [ 0.119340] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])211vm-test-run-nixbot-gitlab> gitlab # [ 0.119380] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23212vm-test-run-nixbot-gitlab> gitlab # [ 0.119383] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)213vm-test-run-nixbot-gitlab> gitlab # [ 0.119385] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)214vm-test-run-nixbot-gitlab> gitlab # [ 0.119386] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)215vm-test-run-nixbot-gitlab> gitlab # [ 0.119387] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)216vm-test-run-nixbot-gitlab> gitlab # [ 0.119388] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)217vm-test-run-nixbot-gitlab> gitlab # [ 0.119390] ACPI: Using ACPI (MADT) for SMP configuration information218vm-test-run-nixbot-gitlab> gitlab # [ 0.119392] ACPI: HPET id: 0x8086a201 base: 0xfed00000219vm-test-run-nixbot-gitlab> gitlab # [ 0.119398] TSC deadline timer available220vm-test-run-nixbot-gitlab> gitlab # [ 0.119402] CPU topo: Max. logical packages: 1221vm-test-run-nixbot-gitlab> gitlab # [ 0.119403] CPU topo: Max. logical dies: 1222vm-test-run-nixbot-gitlab> gitlab # [ 0.119403] CPU topo: Max. dies per package: 1223vm-test-run-nixbot-gitlab> gitlab # [ 0.119407] CPU topo: Max. threads per core: 1224vm-test-run-nixbot-gitlab> gitlab # [ 0.119407] CPU topo: Num. cores per package: 4225vm-test-run-nixbot-gitlab> gitlab # [ 0.119408] CPU topo: Num. threads per package: 4226vm-test-run-nixbot-gitlab> gitlab # [ 0.119408] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs227vm-test-run-nixbot-gitlab> gitlab # [ 0.119432] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()228vm-test-run-nixbot-gitlab> gitlab # [ 0.119450] kvm-guest: KVM setup pv remote TLB flush229vm-test-run-nixbot-gitlab> gitlab # [ 0.119454] kvm-guest: setup PV sched yield230vm-test-run-nixbot-gitlab> gitlab # [ 0.119473] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]231vm-test-run-nixbot-gitlab> gitlab # [ 0.119475] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]232vm-test-run-nixbot-gitlab> gitlab # [ 0.119476] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]233vm-test-run-nixbot-gitlab> gitlab # [ 0.119477] [mem 0xc0000000-0xfeffbfff] available for PCI devices234vm-test-run-nixbot-gitlab> gitlab # [ 0.119479] Booting paravirtualized kernel on KVM235vm-test-run-nixbot-gitlab> gitlab # [ 0.119482] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns236vm-test-run-nixbot-gitlab> gitlab # [ 0.123921] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1237vm-test-run-nixbot-gitlab> gitlab # [ 0.126219] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288238vm-test-run-nixbot-gitlab> gitlab # [ 0.126280] kvm-guest: PV spinlocks enabled239vm-test-run-nixbot-gitlab> gitlab # [ 0.126281] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)240vm-test-run-nixbot-gitlab> gitlab # [ 0.126284] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/p0qj7z4r3akcvwhzgyd8sba9pfn9a0z8-nixos-system-gitlab-test/init regInfo=/nix/store/lym23hc710kwqdd7k33lj4z854f8dggb-closure-info/registration console=ttyS0,115200n8 console=tty0241vm-test-run-nixbot-gitlab> gitlab # [ 0.126379] Unknown kernel command line parameters "regInfo=/nix/store/lym23hc710kwqdd7k33lj4z854f8dggb-closure-info/registration", will be passed to user space.242vm-test-run-nixbot-gitlab> gitlab # [ 0.126392] random: crng init done243vm-test-run-nixbot-gitlab> gitlab # [ 0.126393] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes244vm-test-run-nixbot-gitlab> gitlab # [ 0.135635] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)245vm-test-run-nixbot-gitlab> gitlab # [ 0.140354] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)246vm-test-run-nixbot-gitlab> gitlab # [ 0.140432] software IO TLB: area num 4.247vm-test-run-nixbot-gitlab> gitlab # [ 0.217533] Fallback order for Node 0: 0248vm-test-run-nixbot-gitlab> gitlab # [ 0.217541] Built 1 zonelists, mobility grouping on. Total pages: 1572726249vm-test-run-nixbot-gitlab> gitlab # [ 0.217543] Policy zone: Normal250vm-test-run-nixbot-gitlab> gitlab # [ 0.220152] mem auto-init: stack:all(zero), heap alloc:on, heap free:off251vm-test-run-nixbot-gitlab> gitlab # [ 0.229692] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1252vm-test-run-nixbot-gitlab> gitlab # [ 0.244023] allocated 12582912 bytes of page_ext253vm-test-run-nixbot-gitlab> gitlab # [ 0.254039] ftrace: allocating 48565 entries in 192 pages254vm-test-run-nixbot-gitlab> gitlab # [ 0.254041] ftrace: allocated 192 pages with 2 groups255vm-test-run-nixbot-gitlab> gitlab # [ 0.254912] Dynamic Preempt: lazy256vm-test-run-nixbot-gitlab> gitlab # [ 0.255100] rcu: Preemptible hierarchical RCU implementation.257vm-test-run-nixbot-gitlab> gitlab # [ 0.255100] rcu: RCU event tracing is enabled.258vm-test-run-nixbot-gitlab> gitlab # [ 0.255101] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.259vm-test-run-nixbot-gitlab> gitlab # [ 0.255102] Trampoline variant of Tasks RCU enabled.260vm-test-run-nixbot-gitlab> gitlab # [ 0.255103] Rude variant of Tasks RCU enabled.261vm-test-run-nixbot-gitlab> gitlab # [ 0.255103] Tracing variant of Tasks RCU enabled.262vm-test-run-nixbot-gitlab> gitlab # [ 0.255104] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.263vm-test-run-nixbot-gitlab> gitlab # [ 0.255105] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4264vm-test-run-nixbot-gitlab> gitlab # [ 0.255130] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.265vm-test-run-nixbot-gitlab> gitlab # [ 0.255131] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.266vm-test-run-nixbot-gitlab> gitlab # [ 0.255133] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.267vm-test-run-nixbot-gitlab> gitlab # [ 0.259468] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16268vm-test-run-nixbot-gitlab> gitlab # [ 0.259799] rcu: srcu_init: Setting srcu_struct sizes based on contention.269vm-test-run-nixbot-gitlab> gitlab # [ 0.259923] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)270vm-test-run-nixbot-gitlab> gitlab # [ 0.267275] Console: colour VGA+ 80x25271vm-test-run-nixbot-gitlab> gitlab # [ 0.267279] printk: legacy console [tty0] enabled272vm-test-run-nixbot-gitlab> gitlab # [ 0.311260] printk: legacy console [ttyS0] enabled273vm-test-run-nixbot-gitlab> gitlab # [ 0.513207] ACPI: Core revision 20250807274vm-test-run-nixbot-gitlab> gitlab # [ 0.514922] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns275vm-test-run-nixbot-gitlab> gitlab # [ 0.517773] APIC: Switch to symmetric I/O mode setup276vm-test-run-nixbot-gitlab> gitlab # [ 0.519537] x2apic enabled277vm-test-run-nixbot-gitlab> gitlab # [ 0.520782] APIC: Switched APIC routing to: physical x2apic278vm-test-run-nixbot-gitlab> gitlab # [ 0.522490] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()279vm-test-run-nixbot-gitlab> gitlab # [ 0.524733] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()280vm-test-run-nixbot-gitlab> gitlab # [ 0.527504] kvm-guest: setup PV IPIs281vm-test-run-nixbot-gitlab> gitlab # [ 0.529885] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1282vm-test-run-nixbot-gitlab> gitlab # [ 0.531715] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns283vm-test-run-nixbot-gitlab> gitlab # [ 0.534878] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400010)284vm-test-run-nixbot-gitlab> gitlab # [ 0.535992] x86/cpu: User Mode Instruction Prevention (UMIP) activated285vm-test-run-nixbot-gitlab> gitlab # [ 0.538032] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127286vm-test-run-nixbot-gitlab> gitlab # [ 0.539876] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0287vm-test-run-nixbot-gitlab> gitlab # [ 0.540880] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto288vm-test-run-nixbot-gitlab> gitlab # [ 0.543877] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl289vm-test-run-nixbot-gitlab> gitlab # [ 0.544877] Transient Scheduler Attacks: Mitigation: Clear CPU buffers290vm-test-run-nixbot-gitlab> gitlab # [ 0.545876] Spectre V2 : Mitigation: Enhanced / Automatic IBRS291vm-test-run-nixbot-gitlab> gitlab # [ 0.546876] Speculative Return Stack Overflow: Mitigation: Safe RET292vm-test-run-nixbot-gitlab> gitlab # [ 0.547876] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization293vm-test-run-nixbot-gitlab> gitlab # [ 0.548882] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier294vm-test-run-nixbot-gitlab> gitlab # [ 0.550877] active return thunk: srso_alias_return_thunk295vm-test-run-nixbot-gitlab> gitlab # [ 0.551905] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'296vm-test-run-nixbot-gitlab> gitlab # [ 0.552876] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'297vm-test-run-nixbot-gitlab> gitlab # [ 0.553876] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'298vm-test-run-nixbot-gitlab> gitlab # [ 0.554876] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'299vm-test-run-nixbot-gitlab> gitlab # [ 0.555876] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'300vm-test-run-nixbot-gitlab> gitlab # [ 0.556877] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'301vm-test-run-nixbot-gitlab> gitlab # [ 0.558877] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'302vm-test-run-nixbot-gitlab> gitlab # [ 0.560876] x86/fpu: Supporting XSAVE feature 0x800: 'Control-flow User registers'303vm-test-run-nixbot-gitlab> gitlab # [ 0.561876] x86/fpu: Supporting XSAVE feature 0x1000: 'Control-flow Kernel registers (KVM only)'304vm-test-run-nixbot-gitlab> gitlab # [ 0.562877] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256305vm-test-run-nixbot-gitlab> gitlab # [ 0.563876] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64306vm-test-run-nixbot-gitlab> gitlab # [ 0.565876] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512307vm-test-run-nixbot-gitlab> gitlab # [ 0.567876] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024308vm-test-run-nixbot-gitlab> gitlab # [ 0.568876] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8309vm-test-run-nixbot-gitlab> gitlab # [ 0.569876] x86/fpu: xstate_offset[11]: 2440, xstate_sizes[11]: 16310vm-test-run-nixbot-gitlab> gitlab # [ 0.570876] x86/fpu: xstate_offset[12]: 2456, xstate_sizes[12]: 24311vm-test-run-nixbot-gitlab> gitlab # [ 0.571876] x86/fpu: Enabled xstate features 0x1ae7, context size is 2480 bytes, using 'compacted' format.312vm-test-run-nixbot-gitlab> gitlab # [ 0.602667] Freeing SMP alternatives memory: 44K313vm-test-run-nixbot-gitlab> gitlab # [ 0.603878] pid_max: default: 32768 minimum: 301314vm-test-run-nixbot-gitlab> gitlab # [ 0.605003] LSM: initializing lsm=capability,landlock,yama,bpf,ima315vm-test-run-nixbot-gitlab> gitlab # [ 0.606988] landlock: Up and running.316vm-test-run-nixbot-gitlab> gitlab # [ 0.608748] Yama: becoming mindful.317vm-test-run-nixbot-gitlab> gitlab # [ 0.610087] LSM support for eBPF active318vm-test-run-nixbot-gitlab> gitlab # [ 0.611110] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)319vm-test-run-nixbot-gitlab> gitlab # [ 0.613030] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)320vm-test-run-nixbot-gitlab> gitlab # [ 0.615739] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)321vm-test-run-nixbot-gitlab> gitlab # [ 0.616452] Performance Events: Fam17h+ core perfctr, AMD PMU driver.322vm-test-run-nixbot-gitlab> gitlab # [ 0.616881] ... version: 2323vm-test-run-nixbot-gitlab> gitlab # [ 0.617878] ... bit width: 48324vm-test-run-nixbot-gitlab> gitlab # [ 0.618892] ... generic counters: 6325vm-test-run-nixbot-gitlab> gitlab # [ 0.619878] ... generic bitmap: 000000000000003f326vm-test-run-nixbot-gitlab> gitlab # [ 0.620878] ... fixed-purpose counters: 0327vm-test-run-nixbot-gitlab> gitlab # [ 0.621878] ... fixed-purpose bitmap: 0000000000000000328vm-test-run-nixbot-gitlab> gitlab # [ 0.622878] ... value mask: 0000ffffffffffff329vm-test-run-nixbot-gitlab> gitlab # [ 0.623878] ... max period: 00007fffffffffff330vm-test-run-nixbot-gitlab> gitlab # [ 0.624878] ... global_ctrl mask: 000000000000003f331vm-test-run-nixbot-gitlab> gitlab # [ 0.626023] signal: max sigframe size: 3376332vm-test-run-nixbot-gitlab> gitlab # [ 0.626959] rcu: Hierarchical SRCU implementation.333vm-test-run-nixbot-gitlab> gitlab # [ 0.627883] rcu: Max phase no-delay instances is 400.334vm-test-run-nixbot-gitlab> gitlab # [ 0.629102] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level335vm-test-run-nixbot-gitlab> gitlab # [ 0.634358] smp: Bringing up secondary CPUs ...336vm-test-run-nixbot-gitlab> gitlab # [ 0.635297] smpboot: x86: Booting SMP configuration:337vm-test-run-nixbot-gitlab> gitlab # [ 0.635882] .... node #0, CPUs: #1 #2 #3338vm-test-run-nixbot-gitlab> gitlab # [ 0.639973] smp: Brought up 1 node, 4 CPUs339vm-test-run-nixbot-gitlab> gitlab # [ 0.641878] smpboot: Total of 4 processors activated (19200.08 BogoMIPS)340vm-test-run-nixbot-gitlab> gitlab # [ 0.643468] Memory: 6013380K/6290904K available (17098K kernel code, 2721K rwdata, 13520K rodata, 3644K init, 3008K bss, 258300K reserved, 0K cma-reserved)341vm-test-run-nixbot-gitlab> gitlab # [ 0.645877] devtmpfs: initialized342vm-test-run-nixbot-gitlab> gitlab # [ 0.647110] x86/mm: Memory block size: 128MB343vm-test-run-nixbot-gitlab> gitlab # [ 0.650032] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns344vm-test-run-nixbot-gitlab> gitlab # [ 0.651934] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)345vm-test-run-nixbot-gitlab> gitlab # [ 0.652958] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).346vm-test-run-nixbot-gitlab> gitlab # [ 0.653986] pinctrl core: initialized pinctrl subsystem347vm-test-run-nixbot-gitlab> gitlab # [ 0.655199] PM: RTC time: 07:54:47, date: 2026-06-30348vm-test-run-nixbot-gitlab> gitlab # [ 0.659119] NET: Registered PF_NETLINK/PF_ROUTE protocol family349vm-test-run-nixbot-gitlab> gitlab # [ 0.661332] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations350vm-test-run-nixbot-gitlab> gitlab # [ 0.661939] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations351vm-test-run-nixbot-gitlab> gitlab # [ 0.664001] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations352vm-test-run-nixbot-gitlab> gitlab # [ 0.664892] audit: initializing netlink subsys (disabled)353vm-test-run-nixbot-gitlab> gitlab # [ 0.666051] audit: type=2000 audit(1782806087.452:1): state=initialized audit_enabled=0 res=1354vm-test-run-nixbot-gitlab> gitlab # [ 0.666139] thermal_sys: Registered thermal governor 'fair_share'355vm-test-run-nixbot-gitlab> gitlab # [ 0.667879] thermal_sys: Registered thermal governor 'bang_bang'356vm-test-run-nixbot-gitlab> gitlab # [ 0.668879] thermal_sys: Registered thermal governor 'step_wise'357vm-test-run-nixbot-gitlab> gitlab # [ 0.669878] thermal_sys: Registered thermal governor 'user_space'358vm-test-run-nixbot-gitlab> gitlab # [ 0.670879] thermal_sys: Registered thermal governor 'power_allocator'359vm-test-run-nixbot-gitlab> gitlab # [ 0.671897] cpuidle: using governor menu360vm-test-run-nixbot-gitlab> gitlab # [ 0.675091] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5361vm-test-run-nixbot-gitlab> gitlab # [ 0.676185] PCI: Using configuration type 1 for base access362vm-test-run-nixbot-gitlab> gitlab # [ 0.676879] PCI: Using configuration type 1 for extended access363vm-test-run-nixbot-gitlab> gitlab # [ 0.678107] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.364vm-test-run-nixbot-gitlab> gitlab # [ 0.680903] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages365vm-test-run-nixbot-gitlab> gitlab # [ 0.681880] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page366vm-test-run-nixbot-gitlab> gitlab # [ 0.682879] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages367vm-test-run-nixbot-gitlab> gitlab # [ 0.683878] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page368vm-test-run-nixbot-gitlab> gitlab # [ 0.688159] ACPI: Added _OSI(Module Device)369vm-test-run-nixbot-gitlab> gitlab # [ 0.691889] ACPI: Added _OSI(Processor Device)370vm-test-run-nixbot-gitlab> gitlab # [ 0.694888] ACPI: Added _OSI(Processor Aggregator Device)371vm-test-run-nixbot-gitlab> gitlab # [ 0.703824] ACPI: 1 ACPI AML tables successfully acquired and loaded372vm-test-run-nixbot-gitlab> gitlab # [ 0.713589] ACPI: Interpreter enabled373vm-test-run-nixbot-gitlab> gitlab # [ 0.717070] ACPI: PM: (supports S0 S3 S4 S5)374vm-test-run-nixbot-gitlab> gitlab # [ 0.719886] ACPI: Using IOAPIC for interrupt routing375vm-test-run-nixbot-gitlab> gitlab # [ 0.724176] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug376vm-test-run-nixbot-gitlab> gitlab # [ 0.730886] PCI: Using E820 reservations for host bridge windows377vm-test-run-nixbot-gitlab> gitlab # [ 0.736579] ACPI: Enabled 2 GPEs in block 00 to 0F378vm-test-run-nixbot-gitlab> gitlab # [ 0.752068] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])379vm-test-run-nixbot-gitlab> gitlab # [ 0.755894] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]380vm-test-run-nixbot-gitlab> gitlab # [ 0.761989] acpiphp: Slot [3] registered381vm-test-run-nixbot-gitlab> gitlab # [ 0.764999] acpiphp: Slot [4] registered382vm-test-run-nixbot-gitlab> gitlab # [ 0.767002] acpiphp: Slot [5] registered383vm-test-run-nixbot-gitlab> gitlab # [ 0.770021] acpiphp: Slot [6] registered384vm-test-run-nixbot-gitlab> gitlab # [ 0.772002] acpiphp: Slot [7] registered385vm-test-run-nixbot-gitlab> gitlab # [ 0.773944] acpiphp: Slot [8] registered386vm-test-run-nixbot-gitlab> gitlab # [ 0.775942] acpiphp: Slot [9] registered387vm-test-run-nixbot-gitlab> gitlab # [ 0.776956] acpiphp: Slot [10] registered388vm-test-run-nixbot-gitlab> gitlab # [ 0.777942] acpiphp: Slot [11] registered389vm-test-run-nixbot-gitlab> gitlab # [ 0.778942] acpiphp: Slot [12] registered390vm-test-run-nixbot-gitlab> gitlab # [ 0.780960] acpiphp: Slot [13] registered391vm-test-run-nixbot-gitlab> gitlab # [ 0.781913] acpiphp: Slot [14] registered392vm-test-run-nixbot-gitlab> gitlab # [ 0.783391] acpiphp: Slot [15] registered393vm-test-run-nixbot-gitlab> gitlab # [ 0.786973] acpiphp: Slot [16] registered394vm-test-run-nixbot-gitlab> gitlab # [ 0.789985] acpiphp: Slot [17] registered395vm-test-run-nixbot-gitlab> gitlab # [ 0.794003] acpiphp: Slot [18] registered396vm-test-run-nixbot-gitlab> gitlab # [ 0.796968] acpiphp: Slot [19] registered397vm-test-run-nixbot-gitlab> gitlab # [ 0.799970] acpiphp: Slot [20] registered398vm-test-run-nixbot-gitlab> gitlab # [ 0.802969] acpiphp: Slot [21] registered399vm-test-run-nixbot-gitlab> gitlab # [ 0.807004] acpiphp: Slot [22] registered400vm-test-run-nixbot-gitlab> gitlab # [ 0.809970] acpiphp: Slot [23] registered401vm-test-run-nixbot-gitlab> gitlab # [ 0.812988] acpiphp: Slot [24] registered402vm-test-run-nixbot-gitlab> gitlab # [ 0.816968] acpiphp: Slot [25] registered403vm-test-run-nixbot-gitlab> gitlab # [ 0.820001] acpiphp: Slot [26] registered404vm-test-run-nixbot-gitlab> gitlab # [ 0.822970] acpiphp: Slot [27] registered405vm-test-run-nixbot-gitlab> gitlab # [ 0.825988] acpiphp: Slot [28] registered406vm-test-run-nixbot-gitlab> gitlab # [ 0.829002] acpiphp: Slot [29] registered407vm-test-run-nixbot-gitlab> gitlab # [ 0.831980] acpiphp: Slot [30] registered408vm-test-run-nixbot-gitlab> gitlab # [ 0.834951] acpiphp: Slot [31] registered409vm-test-run-nixbot-gitlab> gitlab # [ 0.837073] PCI host bridge to bus 0000:00410vm-test-run-nixbot-gitlab> gitlab # [ 0.839897] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]411vm-test-run-nixbot-gitlab> gitlab # [ 0.843885] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]412vm-test-run-nixbot-gitlab> gitlab # [ 0.847890] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]413vm-test-run-nixbot-gitlab> gitlab # [ 0.850888] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]414vm-test-run-nixbot-gitlab> gitlab # [ 0.855889] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]415vm-test-run-nixbot-gitlab> gitlab # [ 0.861891] pci_bus 0000:00: root bus resource [bus 00-ff]416vm-test-run-nixbot-gitlab> gitlab # [ 0.867018] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint417vm-test-run-nixbot-gitlab> gitlab # [ 0.876258] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint418vm-test-run-nixbot-gitlab> gitlab # [ 0.884204] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint419vm-test-run-nixbot-gitlab> gitlab # [ 0.896052] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]420vm-test-run-nixbot-gitlab> gitlab # [ 0.900054] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk421vm-test-run-nixbot-gitlab> gitlab # [ 0.904887] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk422vm-test-run-nixbot-gitlab> gitlab # [ 0.907886] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk423vm-test-run-nixbot-gitlab> gitlab # [ 0.911892] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk424vm-test-run-nixbot-gitlab> gitlab # [ 0.916518] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint425vm-test-run-nixbot-gitlab> gitlab # [ 0.923879] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]426vm-test-run-nixbot-gitlab> gitlab # [ 0.926372] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint427vm-test-run-nixbot-gitlab> gitlab # [ 0.931610] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI428vm-test-run-nixbot-gitlab> gitlab # [ 0.937924] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB429vm-test-run-nixbot-gitlab> gitlab # [ 0.943067] pci 0000:00:01.3: quirk_piix4_acpi+0x0/0x180 took 10742 usecs430vm-test-run-nixbot-gitlab> gitlab # [ 0.948810] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint431vm-test-run-nixbot-gitlab> gitlab # [ 0.970022] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]432vm-test-run-nixbot-gitlab> gitlab # [ 0.972906] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]433vm-test-run-nixbot-gitlab> gitlab # [ 0.973933] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]434vm-test-run-nixbot-gitlab> gitlab # [ 0.976456] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]435vm-test-run-nixbot-gitlab> gitlab # [ 0.991884] pci 0000:00:02.0: pci_fixup_video+0x0/0x100 took 14648 usecs436vm-test-run-nixbot-gitlab> gitlab # [ 0.994950] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint437vm-test-run-nixbot-gitlab> gitlab # [ 1.003942] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]438vm-test-run-nixbot-gitlab> gitlab # [ 1.007926] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]439vm-test-run-nixbot-gitlab> gitlab # [ 1.013049] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]440vm-test-run-nixbot-gitlab> gitlab # [ 1.017924] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]441vm-test-run-nixbot-gitlab> gitlab # [ 1.028887] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint442vm-test-run-nixbot-gitlab> gitlab # [ 1.041938] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]443vm-test-run-nixbot-gitlab> gitlab # [ 1.044915] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]444vm-test-run-nixbot-gitlab> gitlab # [ 1.048993] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]445vm-test-run-nixbot-gitlab> gitlab # [ 1.058396] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint446vm-test-run-nixbot-gitlab> gitlab # [ 1.063901] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]447vm-test-run-nixbot-gitlab> gitlab # [ 1.065895] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]448vm-test-run-nixbot-gitlab> gitlab # [ 1.067934] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]449vm-test-run-nixbot-gitlab> gitlab # [ 1.072445] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint450vm-test-run-nixbot-gitlab> gitlab # [ 1.078919] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]451vm-test-run-nixbot-gitlab> gitlab # [ 1.080893] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]452vm-test-run-nixbot-gitlab> gitlab # [ 1.083933] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]453vm-test-run-nixbot-gitlab> gitlab # [ 1.088931] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint454vm-test-run-nixbot-gitlab> gitlab # [ 1.095233] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]455vm-test-run-nixbot-gitlab> gitlab # [ 1.096894] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]456vm-test-run-nixbot-gitlab> gitlab # [ 1.098932] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]457vm-test-run-nixbot-gitlab> gitlab # [ 1.102931] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint458vm-test-run-nixbot-gitlab> gitlab # [ 1.110148] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]459vm-test-run-nixbot-gitlab> gitlab # [ 1.111893] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]460vm-test-run-nixbot-gitlab> gitlab # [ 1.112933] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]461vm-test-run-nixbot-gitlab> gitlab # [ 1.117918] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint462vm-test-run-nixbot-gitlab> gitlab # [ 1.123921] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]463vm-test-run-nixbot-gitlab> gitlab # [ 1.125903] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]464vm-test-run-nixbot-gitlab> gitlab # [ 1.127936] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]465vm-test-run-nixbot-gitlab> gitlab # [ 1.129897] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]466vm-test-run-nixbot-gitlab> gitlab # [ 1.137016] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint467vm-test-run-nixbot-gitlab> gitlab # [ 1.149954] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]468vm-test-run-nixbot-gitlab> gitlab # [ 1.154024] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]469vm-test-run-nixbot-gitlab> gitlab # [ 1.166048] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint470vm-test-run-nixbot-gitlab> gitlab # [ 1.177917] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]471vm-test-run-nixbot-gitlab> gitlab # [ 1.180916] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]472vm-test-run-nixbot-gitlab> gitlab # [ 1.186003] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]473vm-test-run-nixbot-gitlab> gitlab # [ 1.193098] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint474vm-test-run-nixbot-gitlab> gitlab # [ 1.202922] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]475vm-test-run-nixbot-gitlab> gitlab # [ 1.206923] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]476vm-test-run-nixbot-gitlab> gitlab # [ 1.212038] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]477vm-test-run-nixbot-gitlab> gitlab # [ 1.237123] ACPI: PCI: Interrupt link LNKA configured for IRQ 10478vm-test-run-nixbot-gitlab> gitlab # [ 1.242407] ACPI: PCI: Interrupt link LNKB configured for IRQ 10479vm-test-run-nixbot-gitlab> gitlab # [ 1.247438] ACPI: PCI: Interrupt link LNKC configured for IRQ 11480vm-test-run-nixbot-gitlab> gitlab # [ 1.251283] ACPI: PCI: Interrupt link LNKD configured for IRQ 11481vm-test-run-nixbot-gitlab> gitlab # [ 1.255114] ACPI: PCI: Interrupt link LNKS configured for IRQ 9482vm-test-run-nixbot-gitlab> gitlab # [ 1.261901] iommu: Default domain type: Translated483vm-test-run-nixbot-gitlab> gitlab # [ 1.264892] iommu: DMA domain TLB invalidation policy: lazy mode484vm-test-run-nixbot-gitlab> gitlab # [ 1.267349] ACPI: bus type USB registered485vm-test-run-nixbot-gitlab> gitlab # [ 1.269040] usbcore: registered new interface driver usbfs486vm-test-run-nixbot-gitlab> gitlab # [ 1.269898] usbcore: registered new interface driver hub487vm-test-run-nixbot-gitlab> gitlab # [ 1.271923] usbcore: registered new device driver usb488vm-test-run-nixbot-gitlab> gitlab # [ 1.275213] NetLabel: Initializing489vm-test-run-nixbot-gitlab> gitlab # [ 1.275879] NetLabel: domain hash size = 128490vm-test-run-nixbot-gitlab> gitlab # [ 1.276878] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO491vm-test-run-nixbot-gitlab> gitlab # [ 1.278933] NetLabel: unlabeled traffic allowed by default492vm-test-run-nixbot-gitlab> gitlab # [ 1.280893] PCI: Using ACPI for IRQ routing493vm-test-run-nixbot-gitlab> gitlab # [ 1.283002] pci 0000:00:02.0: vgaarb: setting as boot VGA device494vm-test-run-nixbot-gitlab> gitlab # [ 1.283873] pci 0000:00:02.0: vgaarb: bridge control possible495vm-test-run-nixbot-gitlab> gitlab # [ 1.283873] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none496vm-test-run-nixbot-gitlab> gitlab # [ 1.288882] vgaarb: loaded497vm-test-run-nixbot-gitlab> gitlab # [ 1.290052] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0498vm-test-run-nixbot-gitlab> gitlab # [ 1.290878] hpet0: 3 comparators, 64-bit 100.000000 MHz counter499vm-test-run-nixbot-gitlab> gitlab # [ 1.297948] clocksource: Switched to clocksource kvm-clock500vm-test-run-nixbot-gitlab> gitlab # [ 1.300318] VFS: Disk quotas dquot_6.6.0501vm-test-run-nixbot-gitlab> gitlab # [ 1.301599] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)502vm-test-run-nixbot-gitlab> gitlab # [ 1.303932] pnp: PnP ACPI init503vm-test-run-nixbot-gitlab> gitlab # [ 1.305648] pnp: PnP ACPI: found 6 devices504vm-test-run-nixbot-gitlab> gitlab # [ 1.316051] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns505vm-test-run-nixbot-gitlab> gitlab # [ 1.322744] clocksource: Switched to clocksource acpi_pm506vm-test-run-nixbot-gitlab> gitlab # [ 1.327498] NET: Registered PF_INET protocol family507vm-test-run-nixbot-gitlab> gitlab # [ 1.334650] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)508vm-test-run-nixbot-gitlab> gitlab # [ 1.368713] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)509vm-test-run-nixbot-gitlab> gitlab # [ 1.371348] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)510vm-test-run-nixbot-gitlab> gitlab # [ 1.373748] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)511vm-test-run-nixbot-gitlab> gitlab # [ 1.378654] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)512vm-test-run-nixbot-gitlab> gitlab # [ 1.380925] TCP: Hash tables configured (established 65536 bind 65536)513vm-test-run-nixbot-gitlab> gitlab # [ 1.384528] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)514vm-test-run-nixbot-gitlab> gitlab # [ 1.391282] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)515vm-test-run-nixbot-gitlab> gitlab # [ 1.397251] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)516vm-test-run-nixbot-gitlab> gitlab # [ 1.403287] NET: Registered PF_UNIX/PF_LOCAL protocol family517vm-test-run-nixbot-gitlab> gitlab # [ 1.407829] NET: Registered PF_XDP protocol family518vm-test-run-nixbot-gitlab> gitlab # [ 1.411689] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]519vm-test-run-nixbot-gitlab> gitlab # [ 1.416376] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]520vm-test-run-nixbot-gitlab> gitlab # [ 1.421176] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]521vm-test-run-nixbot-gitlab> gitlab # [ 1.426189] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]522vm-test-run-nixbot-gitlab> gitlab # [ 1.431005] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]523vm-test-run-nixbot-gitlab> gitlab # [ 1.435707] pci 0000:00:01.0: PIIX3: Enabling Passive Release524vm-test-run-nixbot-gitlab> gitlab # [ 1.439275] pci 0000:00:00.0: Limiting direct PCI/PCI transfers525vm-test-run-nixbot-gitlab> gitlab # [ 1.445892] ACPI: \_SB_.LNKD: Enabled at IRQ 11526vm-test-run-nixbot-gitlab> gitlab # [ 1.449560] PCI: CLS 0 bytes, default 64527vm-test-run-nixbot-gitlab> gitlab # [ 1.450951] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)528vm-test-run-nixbot-gitlab> gitlab # [ 1.451221] Trying to unpack rootfs image as initramfs...529vm-test-run-nixbot-gitlab> gitlab # [ 1.451311] software IO TLB: mapped [mem 0x00000000ba4e0000-0x00000000be4e0000] (64MB)530vm-test-run-nixbot-gitlab> gitlab # [ 1.459036] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns531vm-test-run-nixbot-gitlab> gitlab # [ 1.494922] Initialise system trusted keyrings532vm-test-run-nixbot-gitlab> gitlab # [ 1.496858] workingset: timestamp_bits=40 max_order=21 bucket_order=0533vm-test-run-nixbot-gitlab> gitlab # [ 1.510011] Key type asymmetric registered534vm-test-run-nixbot-gitlab> gitlab # [ 1.511390] Asymmetric key parser 'x509' registered535vm-test-run-nixbot-gitlab> gitlab # [ 1.512992] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)536vm-test-run-nixbot-gitlab> gitlab # [ 1.515832] io scheduler mq-deadline registered537vm-test-run-nixbot-gitlab> gitlab # [ 1.517280] io scheduler kyber registered538vm-test-run-nixbot-gitlab> gitlab # [ 1.520898] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled539vm-test-run-nixbot-gitlab> gitlab # [ 1.523293] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A540vm-test-run-nixbot-gitlab> gitlab # [ 1.526975] Linux agpgart interface v0.103541vm-test-run-nixbot-gitlab> gitlab # [ 1.528422] ACPI: bus type drm_connector registered542vm-test-run-nixbot-gitlab> gitlab # [ 1.533162] usbcore: registered new interface driver usbserial_generic543vm-test-run-nixbot-gitlab> gitlab # [ 1.535143] usbserial: USB Serial support registered for generic544vm-test-run-nixbot-gitlab> gitlab # [ 1.536953] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.545vm-test-run-nixbot-gitlab> gitlab # [ 1.536953] Please enable it if your BIOS has the CPPC option.546vm-test-run-nixbot-gitlab> gitlab # [ 1.541114] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled547vm-test-run-nixbot-gitlab> gitlab # [ 1.543526] drop_monitor: Initializing network drop monitor service548vm-test-run-nixbot-gitlab> gitlab # [ 1.545611] NET: Registered PF_INET6 protocol family549vm-test-run-nixbot-gitlab> gitlab # [ 1.548492] Segment Routing with IPv6550vm-test-run-nixbot-gitlab> gitlab # [ 1.549736] In-situ OAM (IOAM) with IPv6551vm-test-run-nixbot-gitlab> gitlab # [ 1.552713] IPI shorthand broadcast: enabled552vm-test-run-nixbot-gitlab> gitlab # [ 1.560962] sched_clock: Marking stable (1297030732, 263063289)->(1638862888, -78768867)553vm-test-run-nixbot-gitlab> gitlab # [ 1.564023] registered taskstats version 1554vm-test-run-nixbot-gitlab> gitlab # [ 1.565751] Loading compiled-in X.509 certificates555vm-test-run-nixbot-gitlab> gitlab # [ 1.576523] Demotion targets for Node 0: null556vm-test-run-nixbot-gitlab> gitlab # [ 1.578391] Key type .fscrypt registered557vm-test-run-nixbot-gitlab> gitlab # [ 1.579670] Key type fscrypt-provisioning registered558vm-test-run-nixbot-gitlab> gitlab # [ 1.581361] ima: No TPM chip found, activating TPM-bypass!559vm-test-run-nixbot-gitlab> gitlab # [ 1.583094] ima: Allocated hash algorithm: sha1560vm-test-run-nixbot-gitlab> gitlab # [ 1.584564] ima: No architecture policies found561vm-test-run-nixbot-gitlab> gitlab # [ 1.586401] PM: Magic number: 14:885:926562vm-test-run-nixbot-gitlab> gitlab # [ 1.588732] RAS: Correctable Errors collector initialized.563vm-test-run-nixbot-gitlab> gitlab # [ 1.594526] clk: Disabling unused clocks564vm-test-run-nixbot-gitlab> gitlab # [ 1.595817] PM: genpd: Disabling unused power domains565vm-test-run-nixbot-gitlab> gitlab # [ 1.769184] Freeing initrd memory: 27584K566vm-test-run-nixbot-gitlab> gitlab # [ 1.773701] Freeing unused decrypted memory: 2028K567vm-test-run-nixbot-gitlab> gitlab # [ 1.778888] Freeing unused kernel image (initmem) memory: 3644K568vm-test-run-nixbot-gitlab> gitlab # [ 1.783683] Write protecting the kernel read-only data: 32768k569vm-test-run-nixbot-gitlab> gitlab # [ 1.791251] Freeing unused kernel image (text/rodata gap) memory: 1332K570vm-test-run-nixbot-gitlab> gitlab # [ 1.797762] Freeing unused kernel image (rodata/data gap) memory: 816K571vm-test-run-nixbot-gitlab> gitlab # [ 1.863581] x86/mm: Checked W+X mappings: passed, no W+X pages found.572vm-test-run-nixbot-gitlab> gitlab # [ 1.865569] Run /init as init process573vm-test-run-nixbot-gitlab> gitlab # [ 1.882376] systemd[1]: Inserted module 'autofs4'574vm-test-run-nixbot-gitlab> gitlab # [ 1.911787] fuse: init (API version 7.45)575vm-test-run-nixbot-gitlab> gitlab # [ 1.921841] ACPI: \_SB_.LNKC: Enabled at IRQ 10576vm-test-run-nixbot-gitlab> gitlab # [ 1.932928] ACPI: \_SB_.LNKA: Enabled at IRQ 10577vm-test-run-nixbot-gitlab> gitlab # [ 1.949955] ACPI: \_SB_.LNKB: Enabled at IRQ 11578vm-test-run-nixbot-gitlab> gitlab # [ 2.001834] systemd[1]: Successfully made /usr/ read-only.579vm-test-run-nixbot-gitlab> gitlab # [ 2.342359] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)580vm-test-run-nixbot-gitlab> gitlab # [ 2.363941] systemd[1]: Detected virtualization kvm.581vm-test-run-nixbot-gitlab> gitlab # [ 2.367949] systemd[1]: Detected architecture x86-64.582vm-test-run-nixbot-gitlab> gitlab # [ 2.371952] systemd[1]: Running in initrd.583vm-test-run-nixbot-gitlab> gitlab # [ 2.376354] systemd[1]: Initializing machine ID from random generator.584vm-test-run-nixbot-gitlab> gitlab # [ 2.381593] systemd[1]: Hostname set to <gitlab>.585vm-test-run-nixbot-gitlab> gitlab # [ 2.458905] systemd[1]: Queued start job for default target Initrd Default Target.586vm-test-run-nixbot-gitlab> gitlab # [ 2.630379] systemd[1]: Created slice Slice /system/modprobe.587vm-test-run-nixbot-gitlab> gitlab # [ 2.632572] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.588vm-test-run-nixbot-gitlab> gitlab # [ 2.637704] systemd[1]: Expecting device /dev/disk/by-label/nix-store...589vm-test-run-nixbot-gitlab> gitlab # [ 2.642907] systemd[1]: Expecting device /dev/disk/by-label/nixos...590vm-test-run-nixbot-gitlab> gitlab # [ 2.647953] systemd[1]: Reached target Path Units.591vm-test-run-nixbot-gitlab> gitlab # [ 2.652022] systemd[1]: Reached target Slice Units.592vm-test-run-nixbot-gitlab> gitlab # [ 2.655555] systemd[1]: Reached target Swaps.593vm-test-run-nixbot-gitlab> gitlab # [ 2.658545] systemd[1]: Reached target Timer Units.594vm-test-run-nixbot-gitlab> gitlab # [ 2.662028] systemd[1]: Listening on D-Bus System Message Bus Socket.595vm-test-run-nixbot-gitlab> gitlab # [ 2.666413] systemd[1]: Listening on Journal Socket (/dev/log).596vm-test-run-nixbot-gitlab> gitlab # [ 2.670484] systemd[1]: Listening on Journal Sockets.597vm-test-run-nixbot-gitlab> gitlab # [ 2.672743] systemd[1]: Listening on udev Control Socket.598vm-test-run-nixbot-gitlab> gitlab # [ 2.674640] systemd[1]: Listening on udev Kernel Socket.599vm-test-run-nixbot-gitlab> gitlab # [ 2.676396] systemd[1]: Reached target Socket Units.600vm-test-run-nixbot-gitlab> gitlab # [ 2.682859] systemd[1]: Starting Create List of Static Device Nodes...601vm-test-run-nixbot-gitlab> gitlab # [ 2.689455] systemd[1]: Starting Load Kernel Module 9pnet_virtio...602vm-test-run-nixbot-gitlab> gitlab # [ 2.700697] systemd[1]: Starting Load Kernel Module configfs...603vm-test-run-nixbot-gitlab> gitlab # [ 2.705870] systemd[1]: Starting Journal Service...604vm-test-run-nixbot-gitlab> gitlab # [ 2.709966] systemd[1]: Starting Load Kernel Modules...605vm-test-run-nixbot-gitlab> gitlab # [ 2.711741] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki606vm-test-run-nixbot-gitlab> gitlab # [ 2.719183] systemd[1]: Starting Coldplug All udev Devices...607vm-test-run-nixbot-gitlab> gitlab # [ 2.742237] systemd[1]: Finished Create List of Static Device Nodes.608vm-test-run-nixbot-gitlab> gitlab # [ 2.746916] systemd[1]: modprobe@configfs.service: Deactivated successfully.609vm-test-run-nixbot-gitlab> gitlab # [ 2.751888] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.610vm-test-run-nixbot-gitlab> gitlab # [ 2.756796] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev611vm-test-run-nixbot-gitlab> gitlab # [ 2.760026] systemd[1]: Finished Load Kernel Module configfs.612vm-test-run-nixbot-gitlab> gitlab # [ 2.760803] systemd-journald[152]: Collecting audit messages is disabled.613vm-test-run-nixbot-gitlab> gitlab # [ 2.762025] netfs: FS-Cache loaded614vm-test-run-nixbot-gitlab> gitlab # [ 2.773981] 9pnet: Installing 9P2000 support615vm-test-run-nixbot-gitlab> gitlab # [ 2.775323] systemd[1]: Finished Load Kernel Modules.616vm-test-run-nixbot-gitlab> gitlab # [ 2.777909] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config617vm-test-run-nixbot-gitlab> gitlab # [ 2.783730] systemd[1]: Starting Apply Kernel Variables...618vm-test-run-nixbot-gitlab> gitlab # [ 2.788608] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...619vm-test-run-nixbot-gitlab> gitlab # [ 2.791485] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.620vm-test-run-nixbot-gitlab> gitlab # [ 2.807725] systemd[1]: Finished Load Kernel Module 9pnet_virtio.621vm-test-run-nixbot-gitlab> gitlab # [ 2.815088] systemd[1]: Finished Apply Kernel Variables.622vm-test-run-nixbot-gitlab> gitlab # [ 2.818986] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.623vm-test-run-nixbot-gitlab> gitlab # [ 2.824094] systemd[1]: Starting Create Static Device Nodes in /dev...624vm-test-run-nixbot-gitlab> gitlab # [ 2.833225] systemd[1]: Started Journal Service.625vm-test-run-nixbot-gitlab> gitlab # [ 2.571733] systemd-modules-load[154]: Using 4 probe threads626vm-test-run-nixbot-gitlab> gitlab # [ 2.574278] systemd-modules-load[154]: Inserted module 'dm_mod'627vm-test-run-nixbot-gitlab> gitlab # [ 2.576277] systemd-modules-load[154]: Inserted module 'virtio_gpu'628vm-test-run-nixbot-gitlab> gitlab # [ 2.578363] systemd-modules-load[154]: Inserted module 'virtio_balloon'629vm-test-run-nixbot-gitlab> gitlab # [ 2.580583] systemd[1]: Finished Create Static Device Nodes in /dev.630vm-test-run-nixbot-gitlab> gitlab # [ 2.582716] systemd[1]: Reached target Preparation for Local File Systems.631vm-test-run-nixbot-gitlab> gitlab # [ 2.584875] systemd[1]: Reached target Local File Systems.632vm-test-run-nixbot-gitlab> gitlab # [ 2.586706] systemd[1]: Starting Create System Files and Directories...633vm-test-run-nixbot-gitlab> gitlab # [ 2.588793] systemd[1]: Starting Rule-based Manager for Device Events and Files...634vm-test-run-nixbot-gitlab> gitlab # [ 2.599445] systemd[1]: Finished Create System Files and Directories.635vm-test-run-nixbot-gitlab> gitlab # [ 2.608191] systemd-udevd[188]: Using default interface naming scheme 'v260'.636vm-test-run-nixbot-gitlab> gitlab # [ 2.624531] systemd[1]: Started Rule-based Manager for Device Events and Files.637vm-test-run-nixbot-gitlab> gitlab # [ 2.651158] systemd[1]: Finished Coldplug All udev Devices.638vm-test-run-nixbot-gitlab> gitlab # [ 2.653388] systemd[1]: Reached target System Initialization.639vm-test-run-nixbot-gitlab> gitlab # [ 2.654844] systemd[1]: Reached target Basic System.640vm-test-run-nixbot-gitlab> gitlab # [ 3.084775] SCSI subsystem initialized641vm-test-run-nixbot-gitlab> gitlab # [ 3.091183] uhci_hcd 0000:00:01.2: UHCI Host Controller642vm-test-run-nixbot-gitlab> gitlab # [ 3.094641] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1643vm-test-run-nixbot-gitlab> gitlab # [ 3.096123] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12644vm-test-run-nixbot-gitlab> gitlab # [ 3.098646] uhci_hcd 0000:00:01.2: detected 2 ports645vm-test-run-nixbot-gitlab> gitlab # [ 3.100906] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140646vm-test-run-nixbot-gitlab> gitlab # [ 3.103113] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18647vm-test-run-nixbot-gitlab> gitlab # [ 3.105356] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1648vm-test-run-nixbot-gitlab> gitlab # [ 3.107242] usb usb1: Product: UHCI Host Controller649vm-test-run-nixbot-gitlab> gitlab # [ 3.108791] usb usb1: Manufacturer: Linux 6.18.34 uhci_hcd650vm-test-run-nixbot-gitlab> gitlab # [ 3.110648] usb usb1: SerialNumber: 0000:00:01.2651vm-test-run-nixbot-gitlab> gitlab # [ 3.111741] virtio_blk virtio4: 4/0/0 default/read/poll queues652vm-test-run-nixbot-gitlab> gitlab # [ 3.112609] hub 1-0:1.0: USB hub found653vm-test-run-nixbot-gitlab> gitlab # [ 3.112808] serio: i8042 KBD port at 0x60,0x64 irq 1654vm-test-run-nixbot-gitlab> gitlab # [ 3.113025] hub 1-0:1.0: 2 ports detected655vm-test-run-nixbot-gitlab> gitlab # [ 3.113393] serio: i8042 AUX port at 0x60,0x64 irq 12656vm-test-run-nixbot-gitlab> gitlab # [ 3.120052] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)657vm-test-run-nixbot-gitlab> gitlab # [ 3.125901] virtio_blk virtio5: 4/0/0 default/read/poll queues658vm-test-run-nixbot-gitlab> gitlab # [ 3.134832] scsi host0: ata_piix659vm-test-run-nixbot-gitlab> gitlab # [ 3.136331] virtio_blk virtio5: [vdb] 11498168 512-byte logical blocks (5.89 GB/5.48 GiB)660vm-test-run-nixbot-gitlab> gitlab # [ 3.137179] scsi host1: ata_piix661vm-test-run-nixbot-gitlab> gitlab # [ 3.140368] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0662vm-test-run-nixbot-gitlab> gitlab # [ 3.142544] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0663vm-test-run-nixbot-gitlab> gitlab # [ 2.913878] systemd[1]: Starting Virtual Console Setup...664vm-test-run-nixbot-gitlab> gitlab # [ 2.919781] (udev-worker)[216]: Network interface NamePolicy= disabled on kernel command line.665vm-test-run-nixbot-gitlab> gitlab # [ 2.924165] (udev-worker)[222]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.666vm-test-run-nixbot-gitlab> gitlab # [ 2.928560] (udev-worker)[222]: Network interface NamePolicy= disabled on kernel command line.667vm-test-run-nixbot-gitlab> gitlab # [ 2.939050] systemd-vconsole-setup[233]: Configuration of first virtual console was skipped, ignoring remaining ones.668vm-test-run-nixbot-gitlab> gitlab # [ 2.945233] systemd[1]: Found device /dev/disk/by-label/nixos.669vm-test-run-nixbot-gitlab> gitlab # [ 2.948657] systemd[1]: Finished Virtual Console Setup.670vm-test-run-nixbot-gitlab> gitlab # [ 2.954044] systemd[1]: Found device /dev/disk/by-label/nix-store.671vm-test-run-nixbot-gitlab> gitlab # [ 2.955873] systemd[1]: Reached target Initrd Root Device.672vm-test-run-nixbot-gitlab> gitlab # [ 2.957871] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...673vm-test-run-nixbot-gitlab> gitlab # [ 2.989436] systemd-fsck[242]: nixos: clean, 12/65536 files, 13019/262144 blocks674vm-test-run-nixbot-gitlab> gitlab # [ 2.996329] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.675vm-test-run-nixbot-gitlab> gitlab # [ 3.299331] ata2: found unknown device (class 0)676vm-test-run-nixbot-gitlab> gitlab # [ 3.301579] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100677vm-test-run-nixbot-gitlab> gitlab # [ 3.305211] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5678vm-test-run-nixbot-gitlab> gitlab # [ 3.331323] usb 1-1: new full-speed USB device number 2 using uhci_hcd679vm-test-run-nixbot-gitlab> gitlab # [ 3.347788] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0680vm-test-run-nixbot-gitlab> gitlab # [ 3.389482] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray681vm-test-run-nixbot-gitlab> gitlab # [ 3.421573] cdrom: Uniform CD-ROM driver Revision: 3.20682vm-test-run-nixbot-gitlab> gitlab # [ 3.503974] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00683vm-test-run-nixbot-gitlab> gitlab # [ 3.508903] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10684vm-test-run-nixbot-gitlab> gitlab # [ 3.513389] usb 1-1: Product: QEMU USB Tablet685vm-test-run-nixbot-gitlab> gitlab # [ 3.516307] usb 1-1: Manufacturer: QEMU686vm-test-run-nixbot-gitlab> gitlab # [ 3.518838] usb 1-1: SerialNumber: 28754-0000:00:01.2-1687vm-test-run-nixbot-gitlab> gitlab # [ 3.558823] hid: raw HID events driver (C) Jiri Kosina688vm-test-run-nixbot-gitlab> gitlab # [ 3.573647] usbcore: registered new interface driver usbhid689vm-test-run-nixbot-gitlab> gitlab # [ 3.577557] usbhid: USB HID core driver690vm-test-run-nixbot-gitlab> gitlab # [ 3.592699] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2691vm-test-run-nixbot-gitlab> gitlab # [ 3.600733] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0692vm-test-run-nixbot-gitlab> gitlab # [ 3.479610] systemd[1]: Mounting /sysroot...693vm-test-run-nixbot-gitlab> gitlab # [ 3.915838] EXT4-fs (vda): mounted filesystem 0c454625-1272-4c9e-b6bf-5ab899735482 r/w with ordered data mode. Quota mode: none.694vm-test-run-nixbot-gitlab> gitlab # [ 3.659313] systemd[1]: Mounted /sysroot.695vm-test-run-nixbot-gitlab> gitlab # [ 3.662788] systemd[1]: Reached target Initrd Root File System.696vm-test-run-nixbot-gitlab> gitlab # [ 3.666876] systemd[1]: Mounting /sysroot/nix/.ro-store...697vm-test-run-nixbot-gitlab> gitlab # [ 3.672078] systemd[1]: Mounting /sysroot/nix/.rw-store...698vm-test-run-nixbot-gitlab> gitlab # [ 3.693333] systemd[1]: Mounting /sysroot/run...699vm-test-run-nixbot-gitlab> gitlab # [ 3.698953] systemd[1]: Mounting /sysroot/tmp/shared...700vm-test-run-nixbot-gitlab> gitlab # [ 3.703384] systemd[1]: Mounting /sysroot/tmp/xchg...701vm-test-run-nixbot-gitlab> gitlab # [ 3.981228] 9p: Installing v9fs 9p2000 file system support702vm-test-run-nixbot-gitlab> gitlab # [ 3.720584] systemd[1]: Starting Mountpoints Configured in the Real Root...703vm-test-run-nixbot-gitlab> gitlab # [ 3.985029] erofs (device vdb): mounted with root inode @ nid 128.704vm-test-run-nixbot-gitlab> gitlab # [ 3.722878] systemd[1]: Mounted /sysroot/nix/.rw-store.705vm-test-run-nixbot-gitlab> gitlab # [ 3.727235] systemd[1]: Mounted /sysroot/nix/.ro-store.706vm-test-run-nixbot-gitlab> gitlab # [ 3.731981] systemd[1]: Starting rw-sysroot-nix-store.service...707vm-test-run-nixbot-gitlab> gitlab # [ 3.733784] systemd[1]: Mounted /sysroot/run.708vm-test-run-nixbot-gitlab> gitlab # [ 3.736400] systemd[1]: Mounted /sysroot/tmp/shared.709vm-test-run-nixbot-gitlab> gitlab # [ 3.737901] systemd[1]: Mounted /sysroot/tmp/xchg.710vm-test-run-nixbot-gitlab> gitlab # [ 3.741081] systemd-sysroot-fstab-check[272]: /sysroot should be mounted in the initrd, will request daemon-reload.711vm-test-run-nixbot-gitlab> gitlab # [ 3.743617] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.712vm-test-run-nixbot-gitlab> gitlab # [ 3.745942] systemd[1]: Finished rw-sysroot-nix-store.service.713vm-test-run-nixbot-gitlab> gitlab # [ 3.751669] systemd[1]: Reload requested from client PID 272 ('systemd-sysroot') (unit initrd-parse-etc.service)...714vm-test-run-nixbot-gitlab> gitlab # [ 3.754387] systemd[1]: Reloading...715vm-test-run-nixbot-gitlab> gitlab # [ 3.983376] systemd[1]: Reloading finished in 230 ms.716vm-test-run-nixbot-gitlab> gitlab # [ 4.032579] systemd-sysroot-fstab-check[272]: Requesting initrd-fs.target/start/replace...717vm-test-run-nixbot-gitlab> gitlab # [ 4.162204] systemd-sysroot-fstab-check[272]: Requesting swap.target/start/replace...718vm-test-run-nixbot-gitlab> gitlab # [ 4.167368] systemd[1]: Starting rw-sysroot-nix-store.service...719vm-test-run-nixbot-gitlab> gitlab # [ 4.171479] systemd[1]: initrd-parse-etc.service: Deactivated successfully.720vm-test-run-nixbot-gitlab> gitlab # [ 4.176321] systemd[1]: Finished Mountpoints Configured in the Real Root.721vm-test-run-nixbot-gitlab> gitlab # [ 4.180921] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.722vm-test-run-nixbot-gitlab> gitlab # [ 4.193300] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.723vm-test-run-nixbot-gitlab> gitlab # [ 4.198119] systemd[1]: Finished rw-sysroot-nix-store.service.724vm-test-run-nixbot-gitlab> gitlab # [ 4.481014] systemd[1]: Mounting /sysroot/nix/store...725vm-test-run-nixbot-gitlab> gitlab # [ 4.538146] systemd[1]: Mounted /sysroot/nix/store.726vm-test-run-nixbot-gitlab> gitlab # [ 4.542730] systemd[1]: Reached target Initrd File Systems.727vm-test-run-nixbot-gitlab> gitlab # [ 4.551677] systemd[1]: Starting Find NixOS closure...728vm-test-run-nixbot-gitlab> gitlab # [ 4.560398] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...729vm-test-run-nixbot-gitlab> gitlab # [ 4.595753] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.730vm-test-run-nixbot-gitlab> gitlab # [ 4.600594] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.731vm-test-run-nixbot-gitlab> gitlab # [ 4.620145] systemd[1]: Finished Find NixOS closure.732vm-test-run-nixbot-gitlab> gitlab # [ 4.623896] systemd[1]: Reached target Initrd Default Target.733vm-test-run-nixbot-gitlab> gitlab # [ 4.631608] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...734vm-test-run-nixbot-gitlab> gitlab # [ 4.675823] systemd[1]: Stopped target Initrd Default Target.735vm-test-run-nixbot-gitlab> gitlab # [ 4.679627] systemd[1]: Stopped target Basic System.736vm-test-run-nixbot-gitlab> gitlab # [ 4.682903] systemd[1]: Stopped target Initrd Root Device.737vm-test-run-nixbot-gitlab> gitlab # [ 4.686370] systemd[1]: Stopped target Path Units.738vm-test-run-nixbot-gitlab> gitlab # [ 4.689502] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.739vm-test-run-nixbot-gitlab> gitlab # [ 4.694219] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.740vm-test-run-nixbot-gitlab> gitlab # [ 4.698856] systemd[1]: Stopped target Slice Units.741vm-test-run-nixbot-gitlab> gitlab # [ 4.701952] systemd[1]: Stopped target Socket Units.742vm-test-run-nixbot-gitlab> gitlab # [ 4.705208] systemd[1]: Stopped target System Initialization.743vm-test-run-nixbot-gitlab> gitlab # [ 4.708783] systemd[1]: Stopped target Swaps.744vm-test-run-nixbot-gitlab> gitlab # [ 4.711642] systemd[1]: Stopped target Timer Units.745vm-test-run-nixbot-gitlab> gitlab # [ 4.714709] systemd[1]: dbus.socket: Deactivated successfully.746vm-test-run-nixbot-gitlab> gitlab # [ 4.718285] systemd[1]: Closed D-Bus System Message Bus Socket.747vm-test-run-nixbot-gitlab> gitlab # [ 4.721595] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.748vm-test-run-nixbot-gitlab> gitlab # [ 4.725216] systemd[1]: Stopped Find NixOS closure.749vm-test-run-nixbot-gitlab> gitlab # [ 4.727715] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio750vm-test-run-nixbot-gitlab> gitlab # [ 4.732926] systemd[1]: Starting rw-sysroot-nix-store.service...751vm-test-run-nixbot-gitlab> gitlab # [ 4.735997] systemd[1]: systemd-sysctl.service: Deactivated successfully.752vm-test-run-nixbot-gitlab> gitlab # [ 4.739606] systemd[1]: Stopped Apply Kernel Variables.753vm-test-run-nixbot-gitlab> gitlab # [ 4.741556] systemd[1]: systemd-modules-load.service: Deactivated successfully.754vm-test-run-nixbot-gitlab> gitlab # [ 4.743477] systemd[1]: Stopped Load Kernel Modules.755vm-test-run-nixbot-gitlab> gitlab # [ 4.744876] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.756vm-test-run-nixbot-gitlab> gitlab # [ 4.746769] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.757vm-test-run-nixbot-gitlab> gitlab # [ 4.748701] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.758vm-test-run-nixbot-gitlab> gitlab # [ 4.750501] systemd[1]: Stopped Create System Files and Directories.759vm-test-run-nixbot-gitlab> gitlab # [ 4.752081] systemd[1]: Stopped target Local File Systems.760vm-test-run-nixbot-gitlab> gitlab # [ 4.753481] systemd[1]: Stopped target Preparation for Local File Systems.761vm-test-run-nixbot-gitlab> gitlab # [ 4.755202] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.762vm-test-run-nixbot-gitlab> gitlab # [ 4.757240] systemd[1]: Stopped Coldplug All udev Devices.763vm-test-run-nixbot-gitlab> gitlab # [ 4.759599] systemd[1]: Stopping Rule-based Manager for Device Events and Files...764vm-test-run-nixbot-gitlab> gitlab # [ 4.761594] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.765vm-test-run-nixbot-gitlab> gitlab # [ 4.763679] systemd[1]: Stopped Virtual Console Setup.766vm-test-run-nixbot-gitlab> gitlab # [ 4.771648] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.767vm-test-run-nixbot-gitlab> gitlab # [ 4.775769] systemd[1]: Finished rw-sysroot-nix-store.service.768vm-test-run-nixbot-gitlab> gitlab # [ 4.780524] systemd[1]: systemd-udevd.service: Deactivated successfully.769vm-test-run-nixbot-gitlab> gitlab # [ 4.785354] systemd[1]: Stopped Rule-based Manager for Device Events and Files.770vm-test-run-nixbot-gitlab> gitlab # [ 4.787465] systemd[1]: systemd-udevd.service: Consumed 1.123s CPU time over 2.195s wall clock time, 24.9M memory peak.771vm-test-run-nixbot-gitlab> gitlab # [ 4.794664] systemd[1]: initrd-cleanup.service: Deactivated successfully.772vm-test-run-nixbot-gitlab> gitlab # [ 4.797097] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.773vm-test-run-nixbot-gitlab> gitlab # [ 4.803685] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.774vm-test-run-nixbot-gitlab> gitlab # [ 4.805747] systemd[1]: Closed udev Control Socket.775vm-test-run-nixbot-gitlab> gitlab # [ 4.810582] systemd[1]: Starting Cleanup udev Database...776vm-test-run-nixbot-gitlab> gitlab # [ 4.812255] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.777vm-test-run-nixbot-gitlab> gitlab # [ 4.814407] systemd[1]: Stopped Create Static Device Nodes in /dev.778vm-test-run-nixbot-gitlab> gitlab # [ 4.816235] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.779vm-test-run-nixbot-gitlab> gitlab # [ 4.818461] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.780vm-test-run-nixbot-gitlab> gitlab # [ 4.821306] systemd[1]: kmod-static-nodes.service: Deactivated successfully.781vm-test-run-nixbot-gitlab> gitlab # [ 4.823366] systemd[1]: Stopped Create List of Static Device Nodes.782vm-test-run-nixbot-gitlab> gitlab # [ 4.833187] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.783vm-test-run-nixbot-gitlab> gitlab # [ 4.836749] systemd[1]: Finished Cleanup udev Database.784vm-test-run-nixbot-gitlab> gitlab # [ 4.841961] systemd[1]: Reached target Switch Root.785vm-test-run-nixbot-gitlab> gitlab # [ 4.846107] systemd[1]: Starting NixOS Activation...786vm-test-run-nixbot-gitlab> gitlab # [ 4.989555] initrd-nixos-activation-start[568]: booting system configuration /nix/store/p0qj7z4r3akcvwhzgyd8sba9pfn9a0z8-nixos-system-gitlab-test787vm-test-run-nixbot-gitlab> gitlab # [ 5.045668] initrd-nixos-activation-start[568]: running activation script...788vm-test-run-nixbot-gitlab> gitlab # [ 5.281505] initrd-nixos-activation-start[591]: setting up /etc...789vm-test-run-nixbot-gitlab> gitlab # [ 5.388782] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.790vm-test-run-nixbot-gitlab> gitlab # [ 5.397136] systemd[1]: Finished NixOS Activation.791vm-test-run-nixbot-gitlab> gitlab # [ 5.409229] systemd[1]: Starting Switch Root...792vm-test-run-nixbot-gitlab> gitlab # [ 5.445531] systemd[1]: Switching root.793vm-test-run-nixbot-gitlab> gitlab # [ 6.084169] systemd-journald[152]: Received SIGTERM from PID 1 (systemd).794vm-test-run-nixbot-gitlab> gitlab # [ 6.222436] NET: Registered PF_VSOCK protocol family795vm-test-run-nixbot-gitlab> gitlab # [ 6.598926] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)796vm-test-run-nixbot-gitlab> gitlab # [ 6.615603] systemd[1]: Detected virtualization kvm.797vm-test-run-nixbot-gitlab> gitlab # [ 6.618822] systemd[1]: Detected architecture x86-64.798vm-test-run-nixbot-gitlab> gitlab # [ 6.622265] systemd[1]: Detected first boot.799vm-test-run-nixbot-gitlab> gitlab # [ 6.626448] systemd[1]: Initializing machine ID from random generator.800vm-test-run-nixbot-gitlab> gitlab # [ 6.770201] systemd[1]: bpf-restrict-fs: LSM BPF program attached801vm-test-run-nixbot-gitlab> gitlab # [ 6.843218] systemd[1]: Applying preset policy.802vm-test-run-nixbot-gitlab> gitlab # [ 7.010573] systemd[1]: Populated /etc with preset unit settings.803vm-test-run-nixbot-gitlab> gitlab # [ 7.178996] systemd[1]: initrd-switch-root.service: Deactivated successfully.804vm-test-run-nixbot-gitlab> gitlab # [ 7.181403] systemd[1]: Stopped initrd-switch-root.service.805vm-test-run-nixbot-gitlab> gitlab # [ 7.184687] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.806vm-test-run-nixbot-gitlab> gitlab # [ 7.188025] systemd[1]: Created slice Slice /system/getty.807vm-test-run-nixbot-gitlab> gitlab # [ 7.190498] systemd[1]: Created slice GitLab DevOps Platform Slice.808vm-test-run-nixbot-gitlab> gitlab # [ 7.192770] systemd[1]: Created slice User and Session Slice.809vm-test-run-nixbot-gitlab> gitlab # [ 7.194499] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.810vm-test-run-nixbot-gitlab> gitlab # [ 7.196612] systemd[1]: Started Forward Password Requests to Wall Directory Watch.811vm-test-run-nixbot-gitlab> gitlab # [ 7.198542] systemd[1]: Expecting device /dev/hvc0...812vm-test-run-nixbot-gitlab> gitlab # [ 7.199825] systemd[1]: Expecting device /dev/ttyS0...813vm-test-run-nixbot-gitlab> gitlab # [ 7.201210] systemd[1]: Reached target Local Encrypted Volumes.814vm-test-run-nixbot-gitlab> gitlab # [ 7.202682] systemd[1]: Stopped target initrd-fs.target.815vm-test-run-nixbot-gitlab> gitlab # [ 7.204126] systemd[1]: Stopped target initrd-root-fs.target.816vm-test-run-nixbot-gitlab> gitlab # [ 7.205605] systemd[1]: Stopped target initrd-switch-root.target.817vm-test-run-nixbot-gitlab> gitlab # [ 7.207164] systemd[1]: Reached target Virtual Machines and Containers.818vm-test-run-nixbot-gitlab> gitlab # [ 7.208809] systemd[1]: Reached target Path Units.819vm-test-run-nixbot-gitlab> gitlab # [ 7.210160] systemd[1]: Reached target Remote File Systems.820vm-test-run-nixbot-gitlab> gitlab # [ 7.211696] systemd[1]: Reached target Slice Units.821vm-test-run-nixbot-gitlab> gitlab # [ 7.213003] systemd[1]: Reached target Swaps.822vm-test-run-nixbot-gitlab> gitlab # [ 7.215371] systemd[1]: Listening on Process Core Dump Socket.823vm-test-run-nixbot-gitlab> gitlab # [ 7.217519] systemd[1]: Listening on Credential Encryption/Decryption.824vm-test-run-nixbot-gitlab> gitlab # [ 7.220932] systemd[1]: Starting Journal Log Access Socket...825vm-test-run-nixbot-gitlab> gitlab # [ 7.223177] systemd[1]: Listening on Journal Audit Socket.826vm-test-run-nixbot-gitlab> gitlab # [ 7.224900] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.827vm-test-run-nixbot-gitlab> gitlab # [ 7.226844] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki828vm-test-run-nixbot-gitlab> gitlab # [ 7.229396] systemd[1]: Listening on udev Control Socket.829vm-test-run-nixbot-gitlab> gitlab # [ 7.233169] systemd[1]: Mounting Huge Pages File System...830vm-test-run-nixbot-gitlab> gitlab # [ 7.236162] systemd[1]: Mounting POSIX Message Queue File System...831vm-test-run-nixbot-gitlab> gitlab # [ 7.239316] systemd[1]: Mounting Kernel Debug File System...832vm-test-run-nixbot-gitlab> gitlab # [ 7.243437] systemd[1]: Mounting Kernel Trace File System...833vm-test-run-nixbot-gitlab> gitlab # [ 7.252251] systemd[1]: Starting Create List of Static Device Nodes...834vm-test-run-nixbot-gitlab> gitlab # [ 7.253960] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio835vm-test-run-nixbot-gitlab> gitlab # [ 7.259588] systemd[1]: Starting Load Kernel Module configfs...836vm-test-run-nixbot-gitlab> gitlab # [ 7.261357] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm837vm-test-run-nixbot-gitlab> gitlab # [ 7.263798] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore838vm-test-run-nixbot-gitlab> gitlab # [ 7.263888] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse839vm-test-run-nixbot-gitlab> gitlab # [ 7.267501] systemd[1]: Mounting FUSE Control File System...840vm-test-run-nixbot-gitlab> gitlab # [ 7.278751] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67841vm-test-run-nixbot-gitlab> gitlab # [ 7.317575] systemd[1]: Starting Journal Service...842vm-test-run-nixbot-gitlab> gitlab # [ 7.324655] systemd[1]: Starting Load Kernel Modules...843vm-test-run-nixbot-gitlab> gitlab # [ 7.332884] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...844vm-test-run-nixbot-gitlab> gitlab # [ 7.340588] systemd[1]: Starting Remount Root and Kernel File Systems...845vm-test-run-nixbot-gitlab> gitlab # [ 7.343535] systemd-journald[788]: Collecting audit messages is enabled.846vm-test-run-nixbot-gitlab> gitlab # [ 7.344753] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki847vm-test-run-nixbot-gitlab> gitlab # [ 7.347020] loop: module loaded848vm-test-run-nixbot-gitlab> gitlab # [ 7.352512] systemd[1]: Starting Coldplug All udev Devices...849vm-test-run-nixbot-gitlab> gitlab # [ 7.361582] systemd[1]: Listening on Journal Log Access Socket.850vm-test-run-nixbot-gitlab> gitlab # [ 7.100582] systemd[1]: Queued start job for [ 7.363710] systemd[1]: Started Journal Service.851vm-test-run-nixbot-gitlab> gitlab # default target Multi-User System.852vm-test-run-nixbot-gitlab> gitlab # [ 7.104480] systemd[1]: Unnecessary job was removed for /dev/vdb.853vm-test-run-nixbot-gitlab> gitlab # [ 7.108690] systemd[1]: systemd-journald.service: Deactivated successfully.854vm-test-run-nixbot-gitlab> gitlab # [ 7.110996] systemd-modules-load[790]: Using 3 probe threads855vm-test-run-nixbot-gitlab> gitlab # [ 7.113168] systemd-modules-load[790]: Inserted module 'loop'856vm-test-run-nixbot-gitlab> gitlab # [ 7.377550] EXT4-fs (vda): re-mounted 0c454625-1272-4c9e-b6bf-5ab899735482.857vm-test-run-nixbot-gitlab> gitlab # [ 7.114925] systemd-modules-load[790]: Inserted module 'tls'858vm-test-run-nixbot-gitlab> gitlab # [ 7.119906] systemd[1]: Mounted Huge Pages File System.859vm-test-run-nixbot-gitlab> gitlab # [ 7.121831] systemd[1]: Mounted POSIX Message Queue File System.860vm-test-run-nixbot-gitlab> gitlab # [ 7.123784] systemd[1]: Mounted Kernel Debug File System.861vm-test-run-nixbot-gitlab> gitlab # [ 7.125716] systemd[1]: Mounted Kernel Trace File System.862vm-test-run-nixbot-gitlab> gitlab # [ 7.127470] systemd[1]: Finished Create List of Static Device Nodes.863vm-test-run-nixbot-gitlab> gitlab # [ 7.129638] systemd[1]: modprobe@configfs.service: Deactivated successfully.864vm-test-run-nixbot-gitlab> gitlab # [ 7.131879] systemd[1]: Finished Load Kernel Module configfs.865vm-test-run-nixbot-gitlab> gitlab # [ 7.133821] systemd[1]: Mounted FUSE Control File System.866vm-test-run-nixbot-gitlab> gitlab # [ 7.135668] systemd[1]: Finished Load Kernel Modules.867vm-test-run-nixbot-gitlab> gitlab # [ 7.138097] systemd[1]: Mounting Kernel Configuration File System...868vm-test-run-nixbot-gitlab> gitlab # [ 7.141801] systemd[1]: Starting Firewall...869vm-test-run-nixbot-gitlab> gitlab # [ 7.143956] systemd[1]: Starting Apply Kernel Variables...870vm-test-run-nixbot-gitlab> gitlab # [ 7.146927] systemd-oomd[791]: No swap; memory pressure usage will be degraded871vm-test-run-nixbot-gitlab> gitlab # [ 7.149797] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...872vm-test-run-nixbot-gitlab> gitlab # [ 7.151826] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.873vm-test-run-nixbot-gitlab> gitlab # [ 7.154536] systemd[1]: Finished Remount Root and Kernel File Systems.874vm-test-run-nixbot-gitlab> gitlab # [ 7.156627] systemd[1]: Mounted Kernel Configuration File System.875vm-test-run-nixbot-gitlab> gitlab # [ 7.158708] systemd[1]: Starting Flush Journal to Persistent Storage...876vm-test-run-nixbot-gitlab> gitlab # [ 7.160769] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore877vm-test-run-nixbot-gitlab> gitlab # [ 7.164729] systemd[1]: Starting Load/Save OS Random Seed...878vm-test-run-nixbot-gitlab> gitlab # [ 7.166438] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki879vm-test-run-nixbot-gitlab> gitlab # [ 7.168889] systemd[1]: Finished Apply Kernel Variables.880vm-test-run-nixbot-gitlab> gitlab # [ 7.170789] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.881vm-test-run-nixbot-gitlab> gitlab # [ 7.173329] systemd[1]: Starting Create Static Device Nodes in /dev...882vm-test-run-nixbot-gitlab> gitlab # [ 7.445198] systemd-journald[788]: Received client request to flush runtime journal.883vm-test-run-nixbot-gitlab> gitlab # [ 7.252164] systemd[1]: Finished Load/Save OS Random Seed.884vm-test-run-nixbot-gitlab> gitlab # [ 7.253935] systemd[1]: Reached target First Boot Complete.885vm-test-run-nixbot-gitlab> gitlab # [ 7.255351] systemd[1]: Finished Create Static Device Nodes in /dev.886vm-test-run-nixbot-gitlab> gitlab # [ 7.256936] systemd[1]: Reached target Preparation for Local File Systems.887vm-test-run-nixbot-gitlab> gitlab # [ 7.258641] systemd[1]: Starting Rule-based Manager for Device Events and Files...888vm-test-run-nixbot-gitlab> gitlab # [ 7.260858] systemd-udevd[827]: Using default interface naming scheme 'v260'.889vm-test-run-nixbot-gitlab> gitlab # [ 7.262779] systemd[1]: Finished Flush Journal to Persistent Storage.890vm-test-run-nixbot-gitlab> gitlab # [ 7.283758] systemd[1]: Started Rule-based Manager for Device Events and Files.891vm-test-run-nixbot-gitlab> gitlab # [ 7.318864] systemd[1]: Finished Coldplug All udev Devices.892vm-test-run-nixbot-gitlab> gitlab # [ 7.408060] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse893vm-test-run-nixbot-gitlab> gitlab # [ 7.426204] systemd[1]: Finished Firewall.894vm-test-run-nixbot-gitlab> gitlab # [ 7.433544] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.895vm-test-run-nixbot-gitlab> gitlab # [ 7.447283] (udev-worker)[901]: Network interface NamePolicy= disabled on kernel command line.896vm-test-run-nixbot-gitlab> gitlab # [ 7.452984] (udev-worker)[904]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.897vm-test-run-nixbot-gitlab> gitlab # [ 7.456928] (udev-worker)[904]: Network interface NamePolicy= disabled on kernel command line.898vm-test-run-nixbot-gitlab> gitlab # [ 7.459039] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.899vm-test-run-nixbot-gitlab> gitlab # [ 7.469942] systemd[1]: Condition check resulted in Virtio network device being skipped.900vm-test-run-nixbot-gitlab> gitlab # [ 7.472095] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore901vm-test-run-nixbot-gitlab> gitlab # [ 7.475069] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67902vm-test-run-nixbot-gitlab> gitlab # [ 7.479370] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore903vm-test-run-nixbot-gitlab> gitlab # [ 7.482121] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki904vm-test-run-nixbot-gitlab> gitlab # [ 7.484518] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki905vm-test-run-nixbot-gitlab> gitlab # [ 7.792801] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3906vm-test-run-nixbot-gitlab> gitlab # [ 7.810377] ACPI: button: Power Button [PWRF]907vm-test-run-nixbot-gitlab> gitlab # [ 7.813355] rtc_cmos 00:05: RTC can wake from S4908vm-test-run-nixbot-gitlab> gitlab # [ 7.814511] Floppy drive(s): fd0 is 2.88M AMI BIOS909vm-test-run-nixbot-gitlab> gitlab # [ 7.821787] rtc_cmos 00:05: registered as rtc0910vm-test-run-nixbot-gitlab> gitlab # [ 7.823290] rtc_cmos 00:05: setting system clock to 2026-06-30T07:54:54 UTC (1782806094)911vm-test-run-nixbot-gitlab> gitlab # [ 7.825646] systemd-journald[788]: Time jumped backwards, rotating.912vm-test-run-nixbot-gitlab> gitlab # [ 7.827550] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs913vm-test-run-nixbot-gitlab> gitlab # [ 7.830997] FDC 0 is a S82078B914vm-test-run-nixbot-gitlab> gitlab # [ 7.843129] mousedev: PS/2 mouse device common for all mice915vm-test-run-nixbot-gitlab> gitlab # [ 7.844213] parport_pc 00:03: reported by Plug and Play ACPI916vm-test-run-nixbot-gitlab> gitlab # [ 7.846279] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]917vm-test-run-nixbot-gitlab> gitlab # [ 7.859566] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console918vm-test-run-nixbot-gitlab> gitlab # [ 7.874684] Console: switching to colour dummy device 80x25919vm-test-run-nixbot-gitlab> gitlab # [ 7.876186] [drm] Found bochs VGA, ID 0xb0c5.920vm-test-run-nixbot-gitlab> gitlab # [ 7.877003] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.921vm-test-run-nixbot-gitlab> gitlab # [ 7.878620] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic922vm-test-run-nixbot-gitlab> gitlab # [ 7.880722] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0923vm-test-run-nixbot-gitlab> gitlab # [ 7.887351] fbcon: bochs-drmdrmfb (fb0) is primary device924vm-test-run-nixbot-gitlab> gitlab # [ 7.893867] Console: switching to colour frame buffer device 160x50925vm-test-run-nixbot-gitlab> gitlab # [ 7.897305] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device926vm-test-run-nixbot-gitlab> gitlab # [ 7.898975] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4927vm-test-run-nixbot-gitlab> gitlab # [ 7.902841] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0928vm-test-run-nixbot-gitlab> gitlab # [ 7.904517] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD929vm-test-run-nixbot-gitlab> gitlab # [ 7.917812] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6930vm-test-run-nixbot-gitlab> gitlab # [ 7.928923] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5931vm-test-run-nixbot-gitlab> gitlab # [ 7.711338] systemd[1]: Starting Virtual Console Setup...932vm-test-run-nixbot-gitlab> gitlab # [ 7.737105] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.933vm-test-run-nixbot-gitlab> gitlab # [ 7.739328] systemd[1]: Stopped Virtual Console Setup.934vm-test-run-nixbot-gitlab> gitlab # [ 7.760322] systemd[1]: Starting Virtual Console Setup...935vm-test-run-nixbot-gitlab> gitlab # [ 8.029328] ppdev: user-space parallel port driver936vm-test-run-nixbot-gitlab> gitlab # [ 7.767131] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.937vm-test-run-nixbot-gitlab> gitlab # [ 7.772075] systemd[1]: Stopped Virtual Console Setup.938vm-test-run-nixbot-gitlab> gitlab # [ 7.780736] systemd[1]: Starting Virtual Console Setup...939vm-test-run-nixbot-gitlab> gitlab # [ 8.078017] kvm_amd: TSC scaling supported940vm-test-run-nixbot-gitlab> gitlab # [ 8.079154] kvm_amd: Nested Virtualization enabled941vm-test-run-nixbot-gitlab> gitlab # [ 8.080382] kvm_amd: Nested Paging enabled942vm-test-run-nixbot-gitlab> gitlab # [ 8.081299] kvm_amd: LBR virtualization supported943vm-test-run-nixbot-gitlab> gitlab # [ 8.082526] kvm_amd: Virtual VMLOAD VMSAVE supported944vm-test-run-nixbot-gitlab> gitlab # [ 8.083815] kvm_amd: Virtual GIF supported945vm-test-run-nixbot-gitlab> gitlab # [ 8.084881] kvm_amd: Virtual NMI enabled946vm-test-run-nixbot-gitlab> gitlab # [ 8.135129] EDAC MC: Ver: 3.0.0947vm-test-run-nixbot-gitlab> gitlab # [ 7.881588] systemd-vconsole-setup[963]: Configuration of first virtual console was skipped, ignoring remaining ones.948vm-test-run-nixbot-gitlab> gitlab # [ 7.885646] systemd[1]: Finished Virtual Console Setup.949vm-test-run-nixbot-gitlab> gitlab # [ 7.917777] systemd[1]: Mounting /run/wrappers...950vm-test-run-nixbot-gitlab> gitlab # [ 7.937749] systemd[1]: Mounted /run/wrappers.951vm-test-run-nixbot-gitlab> gitlab # [ 7.939397] systemd[1]: Reached target Local File Systems.952vm-test-run-nixbot-gitlab> gitlab # [ 7.941155] systemd[1]: Listening on Boot Loader Control Service Socket.953vm-test-run-nixbot-gitlab> gitlab # [ 7.943239] systemd[1]: Starting register-nix-paths.service...954vm-test-run-nixbot-gitlab> gitlab # [ 7.945197] systemd[1]: Starting Create SUID/SGID Wrappers...955vm-test-run-nixbot-gitlab> gitlab # [ 7.947202] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.956vm-test-run-nixbot-gitlab> gitlab # [ 7.949658] systemd[1]: Starting Save Transient machine-id to Disk...957vm-test-run-nixbot-gitlab> gitlab # [ 7.951833] systemd[1]: Starting Create System Files and Directories...958vm-test-run-nixbot-gitlab> gitlab # [ 7.982972] systemd[1]: Finished Create System Files and Directories.959vm-test-run-nixbot-gitlab> gitlab # [ 7.987213] systemd[1]: Starting Rebuild Journal Catalog...960vm-test-run-nixbot-gitlab> gitlab # [ 7.989726] systemd[1]: Starting Record System Boot/Shutdown in UTMP...961vm-test-run-nixbot-gitlab> gitlab # [ 7.991441] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.962vm-test-run-nixbot-gitlab> gitlab # [ 7.993548] systemd[1]: Finished Save Transient machine-id to Disk.963vm-test-run-nixbot-gitlab> gitlab # [ 8.007488] systemd[1]: Finished Record System Boot/Shutdown in UTMP.964vm-test-run-nixbot-gitlab> gitlab # [ 8.024788] systemd[1]: Finished Rebuild Journal Catalog.965vm-test-run-nixbot-gitlab> gitlab # [ 8.027505] systemd[1]: Starting Update is Completed...966vm-test-run-nixbot-gitlab> gitlab # [ 8.045444] systemd[1]: Finished Update is Completed.967vm-test-run-nixbot-gitlab> gitlab # [ 8.093439] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.968vm-test-run-nixbot-gitlab> gitlab # [ 8.095361] systemd[1]: Finished Create SUID/SGID Wrappers.969vm-test-run-nixbot-gitlab> gitlab # [ 8.096846] systemd[1]: suid-sgid-wrappers.service: Consumed 115ms CPU time over 150ms wall clock time, 5M memory peak, 1.1M read from disk.970vm-test-run-nixbot-gitlab> gitlab # [ 8.339569] systemd[1]: Finished register-nix-paths.service.971vm-test-run-nixbot-gitlab> gitlab # [ 8.343713] systemd[1]: Reached target System Initialization.972vm-test-run-nixbot-gitlab> gitlab # [ 8.347877] systemd[1]: Started Discard unused filesystem blocks once a week.973vm-test-run-nixbot-gitlab> gitlab # [ 8.352751] systemd[1]: Started logrotate.timer.974vm-test-run-nixbot-gitlab> gitlab # [ 8.356239] systemd[1]: Started Daily Cleanup of Temporary Directories.975vm-test-run-nixbot-gitlab> gitlab # [ 8.360708] systemd[1]: Reached target Timer Units.976vm-test-run-nixbot-gitlab> gitlab # [ 8.364475] systemd[1]: Listening on D-Bus System Message Bus Socket.977vm-test-run-nixbot-gitlab> gitlab # [ 8.368804] systemd[1]: Listening on Nix Daemon Socket.978vm-test-run-nixbot-gitlab> gitlab # [ 8.372659] systemd[1]: Starting nixbot CI service socket...979vm-test-run-nixbot-gitlab> gitlab # [ 8.376647] systemd[1]: Listening on Hostname Service Socket.980vm-test-run-nixbot-gitlab> gitlab # [ 8.380945] systemd[1]: Listening on nixbot CI service socket.981vm-test-run-nixbot-gitlab> gitlab # [ 8.385526] systemd[1]: Reached target Socket Units.982vm-test-run-nixbot-gitlab> gitlab # [ 8.388401] systemd[1]: Starting D-Bus System Message Bus...983vm-test-run-nixbot-gitlab> gitlab # [ 8.412867] dbus-broker-launch[1053]: Looking up NSS user entry for 'systemd-timesync'...984vm-test-run-nixbot-gitlab> gitlab # [ 8.418376] dbus-broker-launch[1053]: NSS returned no entry for 'systemd-timesync'985vm-test-run-nixbot-gitlab> gitlab # [ 8.422810] dbus-broker-launch[1053]: Invalid user-name in /nix/store/89zj9nmrajvcy9c3c08wv0ir9ww7lgmq-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"986vm-test-run-nixbot-gitlab> gitlab # [ 8.432208] systemd[1]: Started D-Bus System Message Bus.987vm-test-run-nixbot-gitlab> gitlab # [ 8.451570] dbus-broker-launch[1053]: Ready988vm-test-run-nixbot-gitlab> gitlab # [ 8.457709] systemd[1]: Reached target Basic System.989vm-test-run-nixbot-gitlab> gitlab # [ 8.460898] systemd[1]: Started backdoor.service.990vm-test-run-nixbot-gitlab> gitlab # [ 8.464274] systemd[1]: Starting gitlab-config.service...991vm-test-run-nixbot-gitlab> gitlab # [ 8.474348] systemd[1]: Starting Import lastlog data into lastlog2 database...992vm-test-run-nixbot-gitlab> gitlab # [ 8.484395] systemd[1]: Starting Logrotate configuration check...993vm-test-run-nixbot-gitlab> gitlab # connecting to host...994vm-test-run-nixbot-gitlab> gitlab # [ 8.497525] systemd[1]: Starting Name Service Cache Daemon (nsncd)...995vm-test-run-nixbot-gitlab> gitlab # [ 8.501833] logrotate[1060]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.996vm-test-run-nixbot-gitlab> gitlab # [ 8.502709] logrotate[1060]: reading config file /nix/store/sn4bd2nqi3yg4r51djm9i2rmfgbwvmhb-logrotate.conf997vm-test-run-nixbot-gitlab> gitlab # [ 8.507114] logrotate[1060]: note: 'monthly' overrides previously specified 'weekly'998vm-test-run-nixbot-gitlab> gitlab # [ 8.509501] logrotate[1060]: Reading state from file: /var/lib/logrotate.status999vm-test-run-nixbot-gitlab> gitlab: Guest shell says: b'Spawning backdoor root shell...\n'1000vm-test-run-nixbot-gitlab> gitlab: connected to guest root shell1001vm-test-run-nixbot-gitlab> gitlab: (connecting took 9.39 seconds)1002vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for the VM to finish booting, in 9.39 seconds)1003vm-test-run-nixbot-gitlab> gitlab # [ 8.511746] logrotate[1060]: state file /var/lib/logrotate.status does not exist1004vm-test-run-nixbot-gitlab> gitlab # [ 8.514564] logrotate[1060]: Allocating hash table for state file, size 64 entries1005vm-test-run-nixbot-gitlab> gitlab # [ 8.515941] logrotate[1060]: Handling 4 logs1006vm-test-run-nixbot-gitlab> gitlab # [ 8.517046] logrotate[1060]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed1007vm-test-run-nixbot-gitlab> gitlab # [ 8.517875] logrotate[1060]: considering log /var/log/btmp1008vm-test-run-nixbot-gitlab> gitlab # [ 8.519136] logrotate[1060]: Creating new state1009vm-test-run-nixbot-gitlab> gitlab # [ 8.519916] logrotate[1060]: Now: 2026-06-30 07:541010vm-test-run-nixbot-gitlab> gitlab # [ 8.521005] logrotate[1060]: Last rotated at 2026-06-30 07:001011vm-test-run-nixbot-gitlab> gitlab # [ 8.521840] logrotate[1060]: log does not need rotating (log has already been rotated)1012vm-test-run-nixbot-gitlab> gitlab # [ 8.522958] logrotate[1060]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed1013vm-test-run-nixbot-gitlab> gitlab # [ 8.524163] logrotate[1060]: considering log /var/log/wtmp1014vm-test-run-nixbot-gitlab> gitlab # [ 8.524900] logrotate[1060]: Creating new state1015vm-test-run-nixbot-gitlab> gitlab # [ 8.526046] logrotate[1060]: Now: 2026-06-30 07:541016vm-test-run-nixbot-gitlab> gitlab # [ 8.526849] logrotate[1060]: Last rotated at 2026-06-30 07:001017vm-test-run-nixbot-gitlab> gitlab # [ 8.527968] logrotate[1060]: log does not need rotating (log has already been rotated)1018vm-test-run-nixbot-gitlab> gitlab # [ 8.529402] logrotate[1060]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed1019vm-test-run-nixbot-gitlab> gitlab # [ 8.529902] logrotate[1060]: switching euid from 0 to 165 and egid from 0 to 165 (pid 1060)1020vm-test-run-nixbot-gitlab> gitlab # [ 8.531104] logrotate[1060]: considering log /var/gitlab/state/log/*.log1021vm-test-run-nixbot-gitlab> gitlab # [ 8.531932] logrotate[1060]: log /var/gitlab/state/log/*.log does not exist -- skipping1022vm-test-run-nixbot-gitlab> gitlab # [ 8.534521] logrotate[1060]: Creating new state1023vm-test-run-nixbot-gitlab> gitlab # [ 8.537948] logrotate[1060]: switching euid from 165 to 0 and egid from 165 to 0 (pid 1060)1024vm-test-run-nixbot-gitlab> gitlab # [ 8.539179] logrotate[1060]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed1025vm-test-run-nixbot-gitlab> gitlab # [ 8.540052] logrotate[1060]: switching euid from 0 to 60 and egid from 0 to 60 (pid 1060)1026vm-test-run-nixbot-gitlab> gitlab # [ 8.541051] logrotate[1060]: considering log /var/log/nginx/*.log1027vm-test-run-nixbot-gitlab> gitlab # [ 8.543923] logrotate[1060]: log /var/log/nginx/*.log does not exist -- skipping1028vm-test-run-nixbot-gitlab> gitlab # [ 8.545083] logrotate[1060]: Creating new state1029vm-test-run-nixbot-gitlab> gitlab # [ 8.545909] logrotate[1060]: switching euid from 60 to 0 and egid from 60 to 0 (pid 1060)1030vm-test-run-nixbot-gitlab> gitlab # [ 8.547296] systemd[1]: Starting Post-Boot Actions...1031vm-test-run-nixbot-gitlab> gitlab # [ 8.548544] systemd[1]: Started Reset console on configuration changes.1032vm-test-run-nixbot-gitlab> gitlab # [ 8.550202] systemd[1]: Starting resolvconf update...1033vm-test-run-nixbot-gitlab> gitlab # [ 8.551106] systemd[1]: Finished Logrotate configuration check.1034vm-test-run-nixbot-gitlab> gitlab # [ 8.552314] systemd[1]: Finished Post-Boot Actions.1035vm-test-run-nixbot-gitlab> gitlab # [ 8.569607] systemd[1]: Finished Import lastlog data into lastlog2 database.1036vm-test-run-nixbot-gitlab> gitlab # [ 8.593365] systemd[1]: Started Name Service Cache Daemon (nsncd).1037vm-test-run-nixbot-gitlab> gitlab # [ 8.596692] systemd[1]: Reached target Host and Network Name Lookups.1038vm-test-run-nixbot-gitlab> gitlab # [ 8.599173] systemd[1]: Reached target User and Group Name Lookups.1039vm-test-run-nixbot-gitlab> gitlab # [ 8.601331] nsncd[1063]: Jun 30 07:54:55.539 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"1040vm-test-run-nixbot-gitlab> gitlab # [ 8.607204] systemd[1]: Starting User Login Management...1041vm-test-run-nixbot-gitlab> gitlab # [ 8.610387] systemd[1]: Stopped target Host and Network Name Lookups.1042vm-test-run-nixbot-gitlab> gitlab # [ 8.611581] systemd[1]: Stopping Host and Network Name Lookups...1043vm-test-run-nixbot-gitlab> gitlab # [ 8.612454] systemd[1]: Stopped target User and Group Name Lookups.1044vm-test-run-nixbot-gitlab> gitlab # [ 8.613950] systemd[1]: Stopping User and Group Name Lookups...1045vm-test-run-nixbot-gitlab> gitlab # [ 8.615178] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...1046vm-test-run-nixbot-gitlab> gitlab # [ 8.619912] systemd[1]: nscd.service: Deactivated successfully.1047vm-test-run-nixbot-gitlab> gitlab # [ 8.624587] systemd[1]: Stopped Name Service Cache Daemon (nsncd).1048vm-test-run-nixbot-gitlab> gitlab # [ 8.625485] systemd[1]: nscd.service: Consumed 70ms CPU time over 123ms wall clock time, 7.8M memory peak, 5.7M read from disk.1049vm-test-run-nixbot-gitlab> gitlab # [ 8.634104] systemd[1]: Starting Name Service Cache Daemon (nsncd)...1050vm-test-run-nixbot-gitlab> gitlab # [ 8.647225] systemd[1]: Finished resolvconf update.1051vm-test-run-nixbot-gitlab> gitlab # [ 8.648101] systemd[1]: Reached target Preparation for Network.1052vm-test-run-nixbot-gitlab> gitlab # [ 8.651900] systemd[1]: Starting DHCP Client...1053vm-test-run-nixbot-gitlab> gitlab # [ 8.657834] systemd[1]: Starting Address configuration of eth1...1054vm-test-run-nixbot-gitlab> gitlab # [ 8.660547] nsncd[1149]: Jun 30 07:54:55.598 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"1055vm-test-run-nixbot-gitlab> gitlab # [ 8.668508] systemd-logind[1131]: New seat seat0.1056vm-test-run-nixbot-gitlab> gitlab # [ 8.672960] systemd[1]: Starting Extra networking commands....1057vm-test-run-nixbot-gitlab> gitlab # [ 8.673804] systemd[1]: Started Name Service Cache Daemon (nsncd).1058vm-test-run-nixbot-gitlab> gitlab # [ 8.674919] systemd[1]: Reached target Host and Network Name Lookups.1059vm-test-run-nixbot-gitlab> gitlab # [ 8.676146] systemd-logind[1131]: Watching system buttons on /dev/input/event2 (Power Button)1060vm-test-run-nixbot-gitlab> gitlab # [ 8.677695] systemd-logind[1131]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)1061vm-test-run-nixbot-gitlab> gitlab # [ 8.678401] systemd-logind[1131]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)1062vm-test-run-nixbot-gitlab> gitlab # [ 8.684108] systemd[1]: Reached target User and Group Name Lookups.1063vm-test-run-nixbot-gitlab> gitlab # [ 8.685810] systemd[1]: Started User Login Management.1064vm-test-run-nixbot-gitlab> gitlab # [ 8.689375] systemd[1]: Starting linger-users.service...1065vm-test-run-nixbot-gitlab> gitlab # [ 8.703882] network-addresses-eth1-start[1158]: adding address 192.168.1.1/24... done1066vm-test-run-nixbot-gitlab> gitlab # [ 8.707712] systemd[1]: linger-users.service: Deactivated successfully.1067vm-test-run-nixbot-gitlab> gitlab # [ 8.708348] systemd[1]: Finished linger-users.service.1068vm-test-run-nixbot-gitlab> gitlab # [ 8.710812] network-addresses-eth1-start[1158]: adding address 2001:db8:1::1/64... done1069vm-test-run-nixbot-gitlab> gitlab # [ 8.718432] systemd[1]: Finished Address configuration of eth1.1070vm-test-run-nixbot-gitlab> gitlab # [ 8.746077] systemd[1]: Finished Extra networking commands..1071vm-test-run-nixbot-gitlab> gitlab # [ 8.748949] dhcpcd[1178]: dhcpcd-10.3.2 starting1072vm-test-run-nixbot-gitlab> gitlab # [ 8.750583] systemd[1]: Reached target Network.1073vm-test-run-nixbot-gitlab> gitlab # [ 8.751976] systemd[1]: Starting gitlab-workhorse.service...1074vm-test-run-nixbot-gitlab> gitlab # [ 8.754154] dhcpcd[1231]: dev: loaded udev1075vm-test-run-nixbot-gitlab> gitlab # [ 8.755495] systemd[1]: Starting Nginx Web Server...1076vm-test-run-nixbot-gitlab> gitlab # [ 8.759792] systemd[1]: Starting PostgreSQL Server...1077vm-test-run-nixbot-gitlab> gitlab # [ 9.025499] 8021q: 802.1Q VLAN Support v1.81078vm-test-run-nixbot-gitlab> gitlab # [ 9.026499] 8021q: adding VLAN 0 to HW filter on device eth11079vm-test-run-nixbot-gitlab> gitlab # [ 8.765511] systemd[1]: Starting Redis Server - redis-gitlab...1080vm-test-run-nixbot-gitlab> gitlab # [ 8.769059] systemd[1]: Starting Permit User Sessions...1081vm-test-run-nixbot-gitlab> gitlab # [ 8.784883] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.1082vm-test-run-nixbot-gitlab> gitlab # [ 8.794333] systemd[1]: Finished Permit User Sessions.1083vm-test-run-nixbot-gitlab> gitlab # [ 8.799754] systemd[1]: Started Getty on tty1.1084vm-test-run-nixbot-gitlab> gitlab # [ 8.801885] systemd[1]: Reached target Login Prompts.1085vm-test-run-nixbot-gitlab> gitlab # [ 9.122936] cfg80211: Loading compiled-in X.509 certificates for regulatory database1086vm-test-run-nixbot-gitlab> gitlab # [ 9.128773] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'1087vm-test-run-nixbot-gitlab> gitlab # [ 9.130295] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'1088vm-test-run-nixbot-gitlab> gitlab # [ 9.132849] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -21089vm-test-run-nixbot-gitlab> gitlab # [ 9.135734] cfg80211: failed to load regulatory.db1090vm-test-run-nixbot-gitlab> gitlab # [ 9.160359] 8021q: adding VLAN 0 to HW filter on device eth01091vm-test-run-nixbot-gitlab> gitlab # [ 8.899867] dhcpcd[1231]: eth0: waiting for carrier1092vm-test-run-nixbot-gitlab> gitlab # [ 8.902183] dhcpcd[1231]: eth0: carrier acquired1093vm-test-run-nixbot-gitlab> gitlab # [ 8.909105] dhcpcd[1231]: DUID 00:01:00:01:31:d6:32:cf:52:54:00:12:34:561094vm-test-run-nixbot-gitlab> gitlab # [ 8.909664] dhcpcd[1231]: eth0: IAID 00:12:34:561095vm-test-run-nixbot-gitlab> gitlab # [ 8.911081] dhcpcd[1231]: eth0: adding address fe80::5054:ff:fe12:34561096vm-test-run-nixbot-gitlab> gitlab # [ 8.927233] nginx-pre-start[1255]: nginx: the configuration file /nix/store/nlpb2pnbsk0921apkv5yml2qxbm30d7w-nginx.conf syntax is ok1097vm-test-run-nixbot-gitlab> gitlab # [ 8.930595] nginx-pre-start[1255]: nginx: configuration file /nix/store/nlpb2pnbsk0921apkv5yml2qxbm30d7w-nginx.conf test is successful1098vm-test-run-nixbot-gitlab> gitlab # [ 8.933942] redis-server[1253]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.1099vm-test-run-nixbot-gitlab> gitlab # [ 8.938389] systemd[1]: Started Redis Server - redis-gitlab.1100vm-test-run-nixbot-gitlab> gitlab # [ 8.940052] redis-server[1253]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1101vm-test-run-nixbot-gitlab> gitlab # [ 8.942257] systemd[1]: Started Nginx Web Server.1102vm-test-run-nixbot-gitlab> gitlab # [ 8.944221] redis-server[1253]: Redis version=8.8.0, bits=64, commit=00000000, modified=0, pid=1253, just started1103vm-test-run-nixbot-gitlab> gitlab # [ 8.947194] redis-server[1253]: Configuration loaded1104vm-test-run-nixbot-gitlab> gitlab # [ 8.949308] redis[1253]: monotonic clock: POSIX clock_gettime1105vm-test-run-nixbot-gitlab> gitlab # [ 8.951835] postgresql-pre-start[1264]: The files belonging to this database system will be owned by user "postgres".1106vm-test-run-nixbot-gitlab> gitlab # [ 8.954422] postgresql-pre-start[1264]: This user must also own the server process.1107vm-test-run-nixbot-gitlab> gitlab # [ 8.956746] postgresql-pre-start[1264]: The database cluster will be initialized with locale "en_US.UTF-8".1108vm-test-run-nixbot-gitlab> gitlab # [ 8.959248] postgresql-pre-start[1264]: The default database encoding has accordingly been set to "UTF8".1109vm-test-run-nixbot-gitlab> gitlab # [ 8.961702] postgresql-pre-start[1264]: The default text search configuration will be set to "english".1110vm-test-run-nixbot-gitlab> gitlab # [ 8.964321] postgresql-pre-start[1264]: Data page checksums are disabled.1111vm-test-run-nixbot-gitlab> gitlab # [ 8.966283] postgresql-pre-start[1264]: fixing permissions on existing directory /var/lib/postgresql/17 ... ok1112vm-test-run-nixbot-gitlab> gitlab # [ 8.968647] postgresql-pre-start[1264]: creating subdirectories ... ok1113vm-test-run-nixbot-gitlab> gitlab # [ 8.970378] postgresql-pre-start[1264]: selecting dynamic shared memory implementation ... posix1114vm-test-run-nixbot-gitlab> gitlab # [ 8.972822] redis[1253]: Running mode=standalone, port=0.1115vm-test-run-nixbot-gitlab> gitlab # [ 8.974993] redis[1253]: Server initialized1116vm-test-run-nixbot-gitlab> gitlab # [ 8.976905] redis[1253]: Ready to accept connections unix1117vm-test-run-nixbot-gitlab> gitlab # [ 8.978947] redis[1253]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1118vm-test-run-nixbot-gitlab> gitlab # [ 8.985084] postgresql-pre-start[1264]: selecting default "max_connections" ... 1001119vm-test-run-nixbot-gitlab> gitlab # [ 9.017425] postgresql-pre-start[1264]: selecting default "shared_buffers" ... 128MB1120vm-test-run-nixbot-gitlab> gitlab # [ 9.218518] systemd[1]: Started gitlab-workhorse.service.1121vm-test-run-nixbot-gitlab> gitlab # [ 9.406264] postgresql-pre-start[1264]: selecting default time zone ... UTC1122vm-test-run-nixbot-gitlab> gitlab # [ 9.408972] postgresql-pre-start[1264]: creating configuration files ... ok1123vm-test-run-nixbot-gitlab> gitlab # [ 9.498901] gitlab-workhorse[1290]: time="2026-06-30T07:54:56Z" level=info msg=Starting build_time=19700101.000000 version=18.11.41124vm-test-run-nixbot-gitlab> gitlab # [ 9.499840] gitlab-workhorse[1290]: time="2026-06-30T07:54:56Z" level=info msg="Using redis/go-redis"1125vm-test-run-nixbot-gitlab> gitlab # [ 9.502165] gitlab-workhorse[1290]: time="2026-06-30T07:54:56Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1126vm-test-run-nixbot-gitlab> gitlab # [ 9.591123] postgresql-pre-start[1264]: running bootstrap script ... ok1127vm-test-run-nixbot-gitlab> gitlab # [ 10.066284] postgresql-pre-start[1264]: performing post-bootstrap initialization ... ok1128vm-test-run-nixbot-gitlab> gitlab # [ 10.442737] postgresql-pre-start[1264]: syncing data to disk ... ok1129vm-test-run-nixbot-gitlab> gitlab # [ 10.444176] postgresql-pre-start[1264]: initdb: warning: enabling "trust" authentication for local connections1130vm-test-run-nixbot-gitlab> gitlab # [ 10.446874] postgresql-pre-start[1264]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1131vm-test-run-nixbot-gitlab> gitlab # [ 10.451449] postgresql-pre-start[1264]: Success. You can now start the database server using:1132vm-test-run-nixbot-gitlab> gitlab # [ 10.454399] postgresql-pre-start[1264]: pg_ctl -D /var/lib/postgresql/17 -l logfile start1133vm-test-run-nixbot-gitlab> gitlab # [ 10.487270] dhcpcd[1231]: eth0: soliciting a DHCP lease1134vm-test-run-nixbot-gitlab> gitlab # [ 10.763238] NET: Registered PF_PACKET protocol family1135vm-test-run-nixbot-gitlab> gitlab # [ 10.515503] dhcpcd[1231]: eth0: offered 10.0.2.15 from 10.0.2.21136vm-test-run-nixbot-gitlab> gitlab # [ 10.519571] dhcpcd[1231]: eth0: probing address 10.0.2.15/241137vm-test-run-nixbot-gitlab> gitlab # [ 10.593803] postgres[1314]: [1314] LOG: starting PostgreSQL 17.10 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1138vm-test-run-nixbot-gitlab> gitlab # [ 10.601575] postgres[1314]: [1314] LOG: listening on IPv6 address "::1", port 54321139vm-test-run-nixbot-gitlab> gitlab # [ 10.606715] postgres[1314]: [1314] LOG: listening on IPv4 address "127.0.0.1", port 54321140vm-test-run-nixbot-gitlab> gitlab # [ 10.611820] postgres[1314]: [1314] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1141vm-test-run-nixbot-gitlab> gitlab # [ 10.617756] postgres[1323]: [1323] LOG: database system was shut down at 2026-06-30 07:54:56 GMT1142vm-test-run-nixbot-gitlab> gitlab # [ 10.622279] postgres[1314]: [1314] LOG: database system is ready to accept connections1143vm-test-run-nixbot-gitlab> gitlab # [ 10.626857] systemd[1]: Started PostgreSQL Server.1144vm-test-run-nixbot-gitlab> gitlab # [ 10.633708] systemd[1]: Starting PostgreSQL Setup Scripts...1145vm-test-run-nixbot-gitlab> gitlab # [ 10.794334] postgresql-setup-start[1343]: CREATE DATABASE1146vm-test-run-nixbot-gitlab> gitlab # [ 10.831511] postgresql-setup-start[1351]: CREATE ROLE1147vm-test-run-nixbot-gitlab> gitlab # [ 10.853729] postgresql-setup-start[1354]: ALTER DATABASE1148vm-test-run-nixbot-gitlab> gitlab # [ 10.886279] postgresql-setup-start[1360]: CREATE ROLE1149vm-test-run-nixbot-gitlab> gitlab # [ 10.891344] systemd[1]: Finished PostgreSQL Setup Scripts.1150vm-test-run-nixbot-gitlab> gitlab # [ 10.892707] systemd[1]: Reached target PostgreSQL.1151vm-test-run-nixbot-gitlab> gitlab # [ 10.894620] systemd[1]: Starting gitlab-postgresql.service...1152vm-test-run-nixbot-gitlab> gitlab # [ 10.972824] 119c5p75zqwmpdrsjsd5cszxwrq2hgfq-gitlab-config[1352]: mkdir -p /var/gitlab/state/home/.ssh: OK1153vm-test-run-nixbot-gitlab> gitlab # [ 10.975458] 119c5p75zqwmpdrsjsd5cszxwrq2hgfq-gitlab-config[1352]: chmod 700 /var/gitlab/state/home/.ssh: OK1154vm-test-run-nixbot-gitlab> gitlab # [ 11.016639] gitlab-postgresql-start[1368]: CREATE DATABASE1155vm-test-run-nixbot-gitlab> gitlab # [ 11.033918] systemd[1]: Finished gitlab-config.service.1156vm-test-run-nixbot-gitlab> gitlab # [ 11.036668] systemd[1]: Started gitaly.service.1157vm-test-run-nixbot-gitlab> gitlab # [ 11.039463] systemd[1]: Starting gitlab-db-config.service...1158vm-test-run-nixbot-gitlab> gitlab # [ 11.053912] gitlab-postgresql-start[1383]: CREATE EXTENSION1159vm-test-run-nixbot-gitlab> gitlab # [ 11.093949] gitlab-postgresql-start[1389]: CREATE EXTENSION1160vm-test-run-nixbot-gitlab> gitlab # [ 11.097368] systemd[1]: Finished gitlab-postgresql.service.1161vm-test-run-nixbot-gitlab> gitlab # [ 11.207351] dhcpcd[1231]: eth0: soliciting an IPv6 router1162vm-test-run-nixbot-gitlab> gitlab # [ 11.209411] dhcpcd[1231]: eth0: Router Advertisement from fe80::21163vm-test-run-nixbot-gitlab> gitlab # [ 11.210748] dhcpcd[1231]: eth0: adding address fec0::5054:ff:fe12:3456/641164vm-test-run-nixbot-gitlab> gitlab # [ 11.212861] dhcpcd[1231]: eth0: adding route to fec0::/641165vm-test-run-nixbot-gitlab> gitlab # [ 11.214237] dhcpcd[1231]: eth0: adding default route via fe80::21166vm-test-run-nixbot-gitlab> gitlab # [ 11.610802] gitaly[1385]: time="2026-06-30T07:54:58.550Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/2wcq0nlg508fs5wq7jnpg1lw2pib950g-gitaly.toml' and fix the errors that are printed." pid=13851167vm-test-run-nixbot-gitlab> gitlab # [ 11.611234] gitaly[1385]: time="2026-06-30T07:54:58.550Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=13851168vm-test-run-nixbot-gitlab> gitlab # [ 11.630699] gitaly[1385]: time="2026-06-30T07:54:58.570Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=13851169vm-test-run-nixbot-gitlab> gitlab # [ 11.631673] gitaly[1385]: time="2026-06-30T07:54:58.570Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=13851170vm-test-run-nixbot-gitlab> gitlab # [ 11.632983] gitaly[1385]: time="2026-06-30T07:54:58.570Z" level=info msg="Starting Gitaly" pid=1385 version=18.11.41171vm-test-run-nixbot-gitlab> gitlab # [ 11.833329] gitaly[1385]: time="2026-06-30T07:54:58.772Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=191 pid=13851172vm-test-run-nixbot-gitlab> gitlab # [ 11.833897] gitaly[1385]: time="2026-06-30T07:54:58.773Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=13851173vm-test-run-nixbot-gitlab> gitlab # [ 11.835771] gitaly[1385]: time="2026-06-30T07:54:58.775Z" level=info msg="finished initializing command factory" duration_ms=0 pid=13851174vm-test-run-nixbot-gitlab> gitlab # [ 11.837387] gitaly[1385]: time="2026-06-30T07:54:58.776Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-1385/git-exec-3959249306.d/git pid=13851175vm-test-run-nixbot-gitlab> gitlab # [ 11.842074] gitaly[1385]: time="2026-06-30T07:54:58.781Z" level=info msg="finished detecting git version" duration_ms=4 pid=13851176vm-test-run-nixbot-gitlab> gitlab # [ 11.842913] gitaly[1385]: time="2026-06-30T07:54:58.781Z" level=info msg="using Git version" pid=1385 version=2.53.g1177vm-test-run-nixbot-gitlab> gitlab # [ 11.843982] gitaly[1385]: time="2026-06-30T07:54:58.782Z" level=info msg="clearing disk cache object folder" pid=1385 storage=default1178vm-test-run-nixbot-gitlab> gitlab # [ 11.845369] gitaly[1385]: time="2026-06-30T07:54:58.782Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1727550457 pid=1385 storage=default1179vm-test-run-nixbot-gitlab> gitlab # [ 11.846428] gitaly[1385]: time="2026-06-30T07:54:58.782Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1727550457 pid=1385 storage=default1180vm-test-run-nixbot-gitlab> gitlab # [ 11.847942] gitaly[1385]: time="2026-06-30T07:54:58.782Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=13851181vm-test-run-nixbot-gitlab> gitlab # [ 11.849309] gitaly[1385]: time="2026-06-30T07:54:58.782Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=13851182vm-test-run-nixbot-gitlab> gitlab # [ 11.850370] gitaly[1385]: time="2026-06-30T07:54:58.783Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1727550457 clear_duration_ms=0 pid=1385 storage=default1183vm-test-run-nixbot-gitlab> gitlab # [ 11.933935] gitaly[1385]: time="2026-06-30T07:54:58.873Z" level=info msg="counting repositories" pid=13851184vm-test-run-nixbot-gitlab> gitlab # [ 11.936777] gitaly[1385]: time="2026-06-30T07:54:58.873Z" level=info msg="starting to count repositories" pid=1385 storage_path=/var/gitlab/state/repositories1185vm-test-run-nixbot-gitlab> gitlab # [ 11.937866] gitaly[1385]: time="2026-06-30T07:54:58.873Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=1385 storage_path=/var/gitlab/state/repositories1186vm-test-run-nixbot-gitlab> gitlab # [ 11.938837] gitaly[1385]: time="2026-06-30T07:54:58.874Z" level=info msg="completed counting all repositories" counting_duration=0 pid=13851187vm-test-run-nixbot-gitlab> gitlab # [ 11.940929] gitaly[1385]: time="2026-06-30T07:54:58.873Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=13851188vm-test-run-nixbot-gitlab> gitlab # [ 11.942203] gitaly[1385]: time="2026-06-30T07:54:58.874Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=1385 schema=unix1189vm-test-run-nixbot-gitlab> gitlab # [ 11.943195] gitaly[1385]: time="2026-06-30T07:54:58.873Z" level=info msg="finished tempdir cleaner walk" pid=1385 storage=default time_ms=01190vm-test-run-nixbot-gitlab> gitlab # [ 11.944191] gitaly[1385]: time="2026-06-30T07:54:58.874Z" level=info msg="listening at address" address=/run/gitaly/gitaly-1385/sock.d/intern pid=1385 schema=unix1191vm-test-run-nixbot-gitlab> gitlab # [ 11.961807] gitaly[1385]: time="2026-06-30T07:54:58.901Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=13851192vm-test-run-nixbot-gitlab> gitlab # [ 11.962139] gitaly[1385]: time="2026-06-30T07:54:58.901Z" level=info msg="Started Gitaly" duration_ms=321 pid=13851193vm-test-run-nixbot-gitlab> gitlab # [ 11.964228] gitaly[1385]: time="2026-06-30T07:54:58.903Z" level=info msg="maintenance: daily scheduled" pid=1385 scheduled="2026-06-30 12:00:00 +0000 UTC"1194vm-test-run-nixbot-gitlab> gitlab # [ 12.400684] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1390]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1195vm-test-run-nixbot-gitlab> gitlab # [ 12.402565] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1390]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1196vm-test-run-nixbot-gitlab> gitlab # [ 12.427172] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1390]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1197vm-test-run-nixbot-gitlab> gitlab # [ 13.842143] gitaly[1385]: time="2026-06-30T07:55:00.780Z" level=info msg="License database preloaded" duration_ms=2209 pid=13851198vm-test-run-nixbot-gitlab> gitlab # [ 15.754139] dhcpcd[1231]: eth0: leased 10.0.2.15 for 86400 seconds1199vm-test-run-nixbot-gitlab> gitlab # [ 15.755594] dhcpcd[1231]: eth0: adding route to 10.0.2.0/241200vm-test-run-nixbot-gitlab> gitlab # [ 15.758966] dhcpcd[1231]: eth0: adding default route via 10.0.2.21201vm-test-run-nixbot-gitlab> gitlab # [ 15.891182] systemd[1]: Started DHCP Client.1202vm-test-run-nixbot-gitlab> gitlab # [ 15.896224] systemd[1]: Reached target Network is Online.1203vm-test-run-nixbot-gitlab> gitlab # [ 43.815820] postgres[1758]: [1758] ERROR: relation "feature_gates" does not exist at character 5231204vm-test-run-nixbot-gitlab> gitlab # [ 43.819239] postgres[1758]: [1758] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1205vm-test-run-nixbot-gitlab> gitlab # [ 43.822269] postgres[1758]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1206vm-test-run-nixbot-gitlab> gitlab # [ 43.825704] postgres[1758]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1207vm-test-run-nixbot-gitlab> gitlab # [ 43.831233] postgres[1758]: attidentity AS identity,1208vm-test-run-nixbot-gitlab> gitlab # [ 43.835358] postgres[1758]: attgenerated as attgenerated1209vm-test-run-nixbot-gitlab> gitlab # [ 43.840472] postgres[1758]: FROM pg_attribute a1210vm-test-run-nixbot-gitlab> gitlab # [ 43.843536] postgres[1758]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1211vm-test-run-nixbot-gitlab> gitlab # [ 43.846750] postgres[1758]: LEFT JOIN pg_type t ON a.atttypid = t.oid1212vm-test-run-nixbot-gitlab> gitlab # [ 43.849539] postgres[1758]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1213vm-test-run-nixbot-gitlab> gitlab # [ 43.852259] postgres[1758]: WHERE a.attrelid = '"feature_gates"'::regclass1214vm-test-run-nixbot-gitlab> gitlab # [ 43.855587] postgres[1758]: AND a.attnum > 0 AND NOT a.attisdropped1215vm-test-run-nixbot-gitlab> gitlab # [ 43.858659] postgres[1758]: ORDER BY a.attnum1216vm-test-run-nixbot-gitlab> gitlab # [ 43.861144] postgres[1758]:1217vm-test-run-nixbot-gitlab> gitlab # [ 44.046657] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1390]: W, [2026-06-30T07:55:30.985169 #1390] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1218vm-test-run-nixbot-gitlab> gitlab # [ 49.567274] gitlab-workhorse[1290]: time="2026-06-30T07:55:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1219vm-test-run-nixbot-gitlab> gitlab # [ 49.985114] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1814]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1220vm-test-run-nixbot-gitlab> gitlab # [ 49.986517] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1814]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1221vm-test-run-nixbot-gitlab> gitlab # [ 59.577670] gitlab-workhorse[1290]: time="2026-06-30T07:55:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1222vm-test-run-nixbot-gitlab> gitlab # [ 67.324580] postgres[1898]: [1898] ERROR: relation "table_without_models" does not exist1223vm-test-run-nixbot-gitlab> gitlab # [ 67.325977] postgres[1898]: [1898] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1224vm-test-run-nixbot-gitlab> gitlab # [ 69.588373] gitlab-workhorse[1290]: time="2026-06-30T07:55:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1225vm-test-run-nixbot-gitlab> gitlab # [ 79.590484] gitlab-workhorse[1290]: time="2026-06-30T07:56:06Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1226vm-test-run-nixbot-gitlab> gitlab # [ 82.448653] systemd[1]: Finished gitlab-db-config.service.1227vm-test-run-nixbot-gitlab> gitlab # [ 82.456314] systemd[1]: Started gitlab-sidekiq.service.1228vm-test-run-nixbot-gitlab> gitlab # [ 82.462248] systemd[1]: Starting gitlab.service...1229vm-test-run-nixbot-gitlab> gitlab # [ 82.851481] bundle[2101]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1230vm-test-run-nixbot-gitlab> gitlab # [ 82.859984] bundle[2101]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1231vm-test-run-nixbot-gitlab> gitlab # [ 82.869614] bundle[2101]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1232vm-test-run-nixbot-gitlab> gitlab # [ 85.794770] sidekiq-cluster[2100]: {"severity":"INFO","time":"2026-06-30T07:56:12.715Z","message":"Starting cluster with 1 processes"}1233vm-test-run-nixbot-gitlab> gitlab # [ 85.861587] bundle[2101]: {"timestamp":"2026-06-30T07:56:12.778Z","pid":2101,"message":"* Enabling systemd notification integration"}1234vm-test-run-nixbot-gitlab> gitlab # [ 85.868401] bundle[2101]: {"timestamp":"2026-06-30T07:56:12.800Z","pid":2101,"message":"Puma starting in cluster mode..."}1235vm-test-run-nixbot-gitlab> gitlab # [ 85.874832] bundle[2101]: {"timestamp":"2026-06-30T07:56:12.800Z","pid":2101,"message":"* Puma version: 7.2.0 (\"On The Corner\")"}1236vm-test-run-nixbot-gitlab> gitlab # [ 85.882521] bundle[2101]: {"timestamp":"2026-06-30T07:56:12.800Z","pid":2101,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1237vm-test-run-nixbot-gitlab> gitlab # [ 85.891761] bundle[2101]: {"timestamp":"2026-06-30T07:56:12.800Z","pid":2101,"message":"* Min threads: 0"}1238vm-test-run-nixbot-gitlab> gitlab # [ 85.897782] bundle[2101]: {"timestamp":"2026-06-30T07:56:12.800Z","pid":2101,"message":"* Max threads: 4"}1239vm-test-run-nixbot-gitlab> gitlab # [ 85.903741] bundle[2101]: {"timestamp":"2026-06-30T07:56:12.800Z","pid":2101,"message":"* Environment: production"}1240vm-test-run-nixbot-gitlab> gitlab # [ 85.910394] bundle[2101]: {"timestamp":"2026-06-30T07:56:12.800Z","pid":2101,"message":"* Master PID: 2101"}1241vm-test-run-nixbot-gitlab> gitlab # [ 85.915942] bundle[2101]: {"timestamp":"2026-06-30T07:56:12.800Z","pid":2101,"message":"* Workers: 2"}1242vm-test-run-nixbot-gitlab> gitlab # [ 85.920459] bundle[2101]: {"timestamp":"2026-06-30T07:56:12.800Z","pid":2101,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1243vm-test-run-nixbot-gitlab> gitlab # [ 85.926396] bundle[2101]: {"timestamp":"2026-06-30T07:56:12.800Z","pid":2101,"message":"* Preloading application"}1244vm-test-run-nixbot-gitlab> gitlab # [ 89.600497] gitlab-workhorse[1290]: time="2026-06-30T07:56:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1245vm-test-run-nixbot-gitlab> gitlab # [ 99.602386] gitlab-workhorse[1290]: time="2026-06-30T07:56:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1246vm-test-run-nixbot-gitlab> gitlab # [ 109.611786] gitlab-workhorse[1290]: time="2026-06-30T07:56:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1247vm-test-run-nixbot-gitlab> gitlab # [ 110.146775] bundle[2101]: W, [2026-06-30T07:56:37.085632 #2101] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1248vm-test-run-nixbot-gitlab> gitlab # [ 113.420533] sidekiq-cluster[2131]: 2026-06-30T07:56:40.359Z pid=2131 tid=tzv INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2131, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>428830720}1249vm-test-run-nixbot-gitlab> gitlab # [ 113.605673] sidekiq-cluster[2131]: W, [2026-06-30T07:56:40.544920 #2131] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1250vm-test-run-nixbot-gitlab> gitlab # [ 113.646210] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:40.585Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1251vm-test-run-nixbot-gitlab> gitlab # [ 115.621539] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.560Z","message":"GitLab reliable fetch activated!"}1252vm-test-run-nixbot-gitlab> gitlab # [ 115.622626] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.560Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1253vm-test-run-nixbot-gitlab> gitlab # [ 115.646599] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.586Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1254vm-test-run-nixbot-gitlab> gitlab # [ 115.650574] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.590Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1255vm-test-run-nixbot-gitlab> gitlab # [ 115.654176] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.593Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1256vm-test-run-nixbot-gitlab> gitlab # [ 115.658176] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.597Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1257vm-test-run-nixbot-gitlab> gitlab # [ 115.662521] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.602Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1258vm-test-run-nixbot-gitlab> gitlab # [ 115.670099] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.609Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1259vm-test-run-nixbot-gitlab> gitlab # [ 115.679502] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.619Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1260vm-test-run-nixbot-gitlab> gitlab # [ 115.684481] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.624Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1261vm-test-run-nixbot-gitlab> gitlab # [ 115.689473] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.629Z","message":"Cron Jobs - added job with name expire_build_artifacts_worker in the namespace default"}1262vm-test-run-nixbot-gitlab> gitlab # [ 115.694819] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.634Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1263vm-test-run-nixbot-gitlab> gitlab # [ 115.699479] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.639Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1264vm-test-run-nixbot-gitlab> gitlab # [ 115.705733] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.645Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1265vm-test-run-nixbot-gitlab> gitlab # [ 115.709951] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.649Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1266vm-test-run-nixbot-gitlab> gitlab # [ 115.714370] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.653Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1267vm-test-run-nixbot-gitlab> gitlab # [ 115.719049] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.658Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1268vm-test-run-nixbot-gitlab> gitlab # [ 115.723707] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.663Z","message":"Cron Jobs - added job with name environments_auto_delete_cron_worker in the namespace default"}1269vm-test-run-nixbot-gitlab> gitlab # [ 115.727130] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.666Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1270vm-test-run-nixbot-gitlab> gitlab # [ 115.730462] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.670Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1271vm-test-run-nixbot-gitlab> gitlab # [ 115.733405] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.673Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1272vm-test-run-nixbot-gitlab> gitlab # [ 115.737072] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.676Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1273vm-test-run-nixbot-gitlab> gitlab # [ 115.740097] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.679Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1274vm-test-run-nixbot-gitlab> gitlab # [ 115.743462] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.683Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1275vm-test-run-nixbot-gitlab> gitlab # [ 115.747271] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.686Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1276vm-test-run-nixbot-gitlab> gitlab # [ 115.750672] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.690Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1277vm-test-run-nixbot-gitlab> gitlab # [ 115.754096] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.693Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1278vm-test-run-nixbot-gitlab> gitlab # [ 115.757308] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.696Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1279vm-test-run-nixbot-gitlab> gitlab # [ 115.760906] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.700Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1280vm-test-run-nixbot-gitlab> gitlab # [ 115.764561] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.704Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1281vm-test-run-nixbot-gitlab> gitlab # [ 115.767973] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.707Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1282vm-test-run-nixbot-gitlab> gitlab # [ 115.771675] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.711Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1283vm-test-run-nixbot-gitlab> gitlab # [ 115.775043] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.714Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1284vm-test-run-nixbot-gitlab> gitlab # [ 115.778315] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.717Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1285vm-test-run-nixbot-gitlab> gitlab # [ 115.781736] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.721Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1286vm-test-run-nixbot-gitlab> gitlab # [ 115.785685] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.725Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1287vm-test-run-nixbot-gitlab> gitlab # [ 115.789508] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.729Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1288vm-test-run-nixbot-gitlab> gitlab # [ 115.792591] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.732Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1289vm-test-run-nixbot-gitlab> gitlab # [ 115.795924] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.735Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1290vm-test-run-nixbot-gitlab> gitlab # [ 115.799456] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.739Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1291vm-test-run-nixbot-gitlab> gitlab # [ 115.802646] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.742Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1292vm-test-run-nixbot-gitlab> gitlab # [ 115.806087] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.745Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1293vm-test-run-nixbot-gitlab> gitlab # [ 115.809142] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.748Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1294vm-test-run-nixbot-gitlab> gitlab # [ 115.812304] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.751Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1295vm-test-run-nixbot-gitlab> gitlab # [ 115.815317] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.754Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1296vm-test-run-nixbot-gitlab> gitlab # [ 115.818426] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.758Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1297vm-test-run-nixbot-gitlab> gitlab # [ 115.821726] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.761Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1298vm-test-run-nixbot-gitlab> gitlab # [ 115.825518] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.765Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1299vm-test-run-nixbot-gitlab> gitlab # [ 115.828540] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.768Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1300vm-test-run-nixbot-gitlab> gitlab # [ 115.831630] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.771Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1301vm-test-run-nixbot-gitlab> gitlab # [ 115.835074] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.774Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1302vm-test-run-nixbot-gitlab> gitlab # [ 115.838599] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.778Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1303vm-test-run-nixbot-gitlab> gitlab # [ 115.841872] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.781Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1304vm-test-run-nixbot-gitlab> gitlab # [ 115.845428] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.785Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1305vm-test-run-nixbot-gitlab> gitlab # [ 115.849149] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.788Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1306vm-test-run-nixbot-gitlab> gitlab # [ 115.860618] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.800Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1307vm-test-run-nixbot-gitlab> gitlab # [ 115.863646] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.803Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1308vm-test-run-nixbot-gitlab> gitlab # [ 115.867309] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.806Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1309vm-test-run-nixbot-gitlab> gitlab # [ 115.870668] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.810Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1310vm-test-run-nixbot-gitlab> gitlab # [ 115.874105] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.813Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1311vm-test-run-nixbot-gitlab> gitlab # [ 115.877545] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.817Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1312vm-test-run-nixbot-gitlab> gitlab # [ 115.880886] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.820Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1313vm-test-run-nixbot-gitlab> gitlab # [ 115.884783] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.824Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1314vm-test-run-nixbot-gitlab> gitlab # [ 115.888594] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.828Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1315vm-test-run-nixbot-gitlab> gitlab # [ 115.891600] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.831Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1316vm-test-run-nixbot-gitlab> gitlab # [ 115.895550] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.835Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1317vm-test-run-nixbot-gitlab> gitlab # [ 115.898720] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.838Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1318vm-test-run-nixbot-gitlab> gitlab # [ 115.902215] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.841Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1319vm-test-run-nixbot-gitlab> gitlab # [ 115.905912] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.845Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1320vm-test-run-nixbot-gitlab> gitlab # [ 115.930144] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.869Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1321vm-test-run-nixbot-gitlab> gitlab # [ 115.937124] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.875Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1322vm-test-run-nixbot-gitlab> gitlab # [ 115.938628] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.878Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1323vm-test-run-nixbot-gitlab> gitlab # [ 115.942226] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.881Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1324vm-test-run-nixbot-gitlab> gitlab # [ 115.946072] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.885Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1325vm-test-run-nixbot-gitlab> gitlab # [ 115.948926] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.888Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1326vm-test-run-nixbot-gitlab> gitlab # [ 115.951978] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.891Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1327vm-test-run-nixbot-gitlab> gitlab # [ 115.956073] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.895Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1328vm-test-run-nixbot-gitlab> gitlab # [ 115.958402] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.898Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1329vm-test-run-nixbot-gitlab> gitlab # [ 115.961580] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.901Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1330vm-test-run-nixbot-gitlab> gitlab # [ 115.963879] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.903Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1331vm-test-run-nixbot-gitlab> gitlab # [ 115.967187] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.906Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1332vm-test-run-nixbot-gitlab> gitlab # [ 115.969598] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.909Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1333vm-test-run-nixbot-gitlab> gitlab # [ 115.972558] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.912Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1334vm-test-run-nixbot-gitlab> gitlab # [ 115.974801] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.914Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1335vm-test-run-nixbot-gitlab> gitlab # [ 115.977830] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.917Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1336vm-test-run-nixbot-gitlab> gitlab # [ 115.980590] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.920Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1337vm-test-run-nixbot-gitlab> gitlab # [ 115.983661] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.923Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1338vm-test-run-nixbot-gitlab> gitlab # [ 115.986073] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.925Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1339vm-test-run-nixbot-gitlab> gitlab # [ 115.989267] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.928Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1340vm-test-run-nixbot-gitlab> gitlab # [ 115.991841] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.931Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1341vm-test-run-nixbot-gitlab> gitlab # [ 115.994788] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.934Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1342vm-test-run-nixbot-gitlab> gitlab # [ 115.997081] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.936Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1343vm-test-run-nixbot-gitlab> gitlab # [ 115.999887] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.939Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1344vm-test-run-nixbot-gitlab> gitlab # [ 116.002219] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.941Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1345vm-test-run-nixbot-gitlab> gitlab # [ 116.004496] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.944Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1346vm-test-run-nixbot-gitlab> gitlab # [ 116.007204] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.946Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1347vm-test-run-nixbot-gitlab> gitlab # [ 116.009534] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.949Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1348vm-test-run-nixbot-gitlab> gitlab # [ 116.012598] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.952Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1349vm-test-run-nixbot-gitlab> gitlab # [ 116.016063] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.955Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1350vm-test-run-nixbot-gitlab> gitlab # [ 116.019744] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.959Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1351vm-test-run-nixbot-gitlab> gitlab # [ 116.023081] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.962Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1352vm-test-run-nixbot-gitlab> gitlab # [ 116.034479] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.973Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1353vm-test-run-nixbot-gitlab> gitlab # [ 116.037874] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.977Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1354vm-test-run-nixbot-gitlab> gitlab # [ 116.041599] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.980Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1355vm-test-run-nixbot-gitlab> gitlab # [ 116.045668] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.985Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1356vm-test-run-nixbot-gitlab> gitlab # [ 116.049790] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.989Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1357vm-test-run-nixbot-gitlab> gitlab # [ 116.053488] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.993Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1358vm-test-run-nixbot-gitlab> gitlab # [ 116.057318] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.996Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1359vm-test-run-nixbot-gitlab> gitlab # [ 116.060446] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:42.999Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1360vm-test-run-nixbot-gitlab> gitlab # [ 116.063839] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:43.003Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1361vm-test-run-nixbot-gitlab> gitlab # [ 116.068117] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:43.007Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1362vm-test-run-nixbot-gitlab> gitlab # [ 116.073096] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:56:43.010Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1363vm-test-run-nixbot-gitlab> gitlab # [ 119.623110] gitlab-workhorse[1290]: time="2026-06-30T07:56:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1364vm-test-run-nixbot-gitlab> gitlab # [ 129.625775] gitlab-workhorse[1290]: time="2026-06-30T07:56:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1365vm-test-run-nixbot-gitlab> gitlab # [ 137.564773] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:04.503Z","message":"Booted Rails 7.2.3 application in production environment"}1366vm-test-run-nixbot-gitlab> gitlab # [ 137.572650] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:04.503Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1367vm-test-run-nixbot-gitlab> gitlab # [ 137.580997] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:04.503Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1368vm-test-run-nixbot-gitlab> gitlab # [ 137.588834] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:04.503Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1369vm-test-run-nixbot-gitlab> gitlab # [ 137.597465] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:04.505Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1370vm-test-run-nixbot-gitlab> gitlab # [ 138.888756] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:05.827Z","message":"Cleaning working queues"}1371vm-test-run-nixbot-gitlab> gitlab # [ 138.895378] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:05.831Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"4658c44d36f3a8804a1a4309","created_at":"2026-06-30T07:56:08.797Z","trace_propagation_headers":{"sentry-trace":"00b4746617dd456db122dba675b67462-5225f8db4d2b418a","baggage":"sentry-trace_id=00b4746617dd456db122dba675b67462,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"f451e8cc8777a59031984b8f91a5ed40","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-06-30T07:56:08.807Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-4658c44d36f3a8804a1a4309: start","job_status":"start","queue_duration_s":57.023518,"scheduling_latency_s":57.02361}1372vm-test-run-nixbot-gitlab> gitlab # [ 139.131973] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:06.071Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"4658c44d36f3a8804a1a4309","created_at":"2026-06-30T07:56:08.797Z","trace_propagation_headers":{"sentry-trace":"00b4746617dd456db122dba675b67462-5225f8db4d2b418a","baggage":"sentry-trace_id=00b4746617dd456db122dba675b67462,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"f451e8cc8777a59031984b8f91a5ed40","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-06-30T07:56:08.807Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-4658c44d36f3a8804a1a4309: done: 0.240304 sec","job_status":"done","queue_duration_s":57.023518,"scheduling_latency_s":57.02361,"redis_calls":31,"redis_duration_s":0.014006000000000001,"redis_read_bytes":284,"redis_write_bytes":3897,"redis_feature_flag_calls":20,"redis_feature_flag_duration_s":0.009178,"redis_feature_flag_read_bytes":274,"redis_feature_flag_write_bytes":2650,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002817,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002011,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":16,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.081602,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.10226914299999999,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.240304,"completed_at":"2026-06-30T07:57:06.070Z","load_balancing_strategy":"primary","db_duration_s":0.08613,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1373vm-test-run-nixbot-gitlab> gitlab # [ 139.557192] bundle[2101]: {"timestamp":"2026-06-30T07:57:06.495Z","pid":2101,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1374vm-test-run-nixbot-gitlab> gitlab # [ 139.564932] bundle[2101]: {"timestamp":"2026-06-30T07:57:06.495Z","pid":2101,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1375vm-test-run-nixbot-gitlab> gitlab # [ 139.572271] bundle[2101]: {"timestamp":"2026-06-30T07:57:06.496Z","pid":2101,"message":"! #\u003cThread:0x000070cd4b734cc0 /nix/store/g5qraa51hgg5fl7n3da89ygf00qfv95x-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/g5qraa51hgg5fl7n3da89ygf00qfv95x-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1376vm-test-run-nixbot-gitlab> gitlab # [ 139.592552] bundle[2101]: {"timestamp":"2026-06-30T07:57:06.496Z","pid":2101,"message":"! #\u003cThread:0x000070cd4b95dba0 /nix/store/wg5r0zmy3rh1kga7z4z7mbs298p0wxli-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/wg5r0zmy3rh1kga7z4z7mbs298p0wxli-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1377vm-test-run-nixbot-gitlab> gitlab # [ 139.608804] bundle[2101]: {"timestamp":"2026-06-30T07:57:06.496Z","pid":2101,"message":"Use Ctrl-C to stop"}1378vm-test-run-nixbot-gitlab> gitlab # [ 139.611390] bundle[2101]: {"timestamp":"2026-06-30T07:57:06.496Z","pid":2101,"message":"Sending status to systemd every 1.0 sec"}1379vm-test-run-nixbot-gitlab> gitlab # [ 139.893573] bundle[2101]: {"timestamp":"2026-06-30T07:57:06.832Z","pid":2101,"message":"- Worker 0 (PID: 2658) booted in 0.3s, phase: 0"}1380vm-test-run-nixbot-gitlab> gitlab # [ 139.954144] bundle[2101]: {"timestamp":"2026-06-30T07:57:06.893Z","pid":2101,"message":"- Worker 1 (PID: 2662) booted in 0.34s, phase: 0"}1381vm-test-run-nixbot-gitlab> gitlab # [ 139.961700] systemd[1]: Started gitlab.service.1382vm-test-run-nixbot-gitlab> gitlab # [ 139.965135] systemd[1]: Reached target Common target for all GitLab services..1383vm-test-run-nixbot-gitlab> gitlab # [ 139.969782] systemd[1]: Starting setup-gitlab.service...1384vm-test-run-nixbot-gitlab> gitlab # [ 139.996378] setup-gitlab-start[2689]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1385vm-test-run-nixbot-gitlab> gitlab # [ 142.446807] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:57:09 +0000] "GET /users/sign_in HTTP/1.1" 200 10624 "" "curl/8.20.0" 24191386vm-test-run-nixbot-gitlab> gitlab # [ 142.452397] setup-gitlab-start[2709]: ++ curl -fs -X POST -H 'Content-Type: application/json' -d '{"grant_type":"password","username":"root","password":"notproduction"}' http://gitlab/oauth/token1387vm-test-run-nixbot-gitlab> gitlab # [ 142.455722] setup-gitlab-start[2710]: ++ jq -r .access_token1388vm-test-run-nixbot-gitlab> gitlab # [ 143.233281] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:57:10 +0000] "POST /oauth/token HTTP/1.1" 200 244 "" "curl/8.20.0" 7581389vm-test-run-nixbot-gitlab> gitlab # [ 143.244586] setup-gitlab-start[2689]: + BEARER=ead79277080d02e9e15186409b0689ea2d61ad16876faa81625817b6fd7b8b411390vm-test-run-nixbot-gitlab> gitlab # [ 143.247186] setup-gitlab-start[2689]: + AUTH='Authorization: Bearer ead79277080d02e9e15186409b0689ea2d61ad16876faa81625817b6fd7b8b41'1391vm-test-run-nixbot-gitlab> gitlab # [ 143.249857] setup-gitlab-start[2689]: + curl -fs -X PUT -H 'Authorization: Bearer ead79277080d02e9e15186409b0689ea2d61ad16876faa81625817b6fd7b8b41' 'http://gitlab/api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true'1392vm-test-run-nixbot-gitlab> gitlab # [ 144.003688] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:57:10 +0000] "PUT /api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true HTTP/1.1" 200 17133 "" "curl/8.20.0" 7181393vm-test-run-nixbot-gitlab> gitlab # [ 144.008449] setup-gitlab-start[2689]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner Rails.cache.clear1394vm-test-run-nixbot-gitlab> gitlab # [ 144.025377] runuser[2728]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1395vm-test-run-nixbot-gitlab> gitlab # [ 144.405816] setup-gitlab-start[2729]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1396vm-test-run-nixbot-gitlab> gitlab # [ 144.407201] setup-gitlab-start[2729]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1397vm-test-run-nixbot-gitlab> gitlab # [ 144.409954] setup-gitlab-start[2729]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1398vm-test-run-nixbot-gitlab> gitlab # [ 144.982841] setup-gitlab-start[2729]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1399vm-test-run-nixbot-gitlab> gitlab # [ 144.984970] setup-gitlab-start[2729]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1400vm-test-run-nixbot-gitlab> gitlab # [ 144.988386] setup-gitlab-start[2729]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1401vm-test-run-nixbot-gitlab> gitlab # [ 151.126813] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:18.065Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"75ab3b49934f9f9566a12cd7","created_at":"2026-06-30T07:57:18.036Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"74fabc1a82a6e1492a7d92b535fe9f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-06-30T07:57:18.062Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-75ab3b49934f9f9566a12cd7: start","job_status":"start","queue_duration_s":0.002919,"scheduling_latency_s":0.002969}1402vm-test-run-nixbot-gitlab> gitlab # [ 151.214771] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:18.154Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1403vm-test-run-nixbot-gitlab> gitlab # [ 151.252177] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:18.190Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"75ab3b49934f9f9566a12cd7","created_at":"2026-06-30T07:57:18.036Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"74fabc1a82a6e1492a7d92b535fe9f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-06-30T07:57:18.062Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-75ab3b49934f9f9566a12cd7: done: 0.125986 sec","job_status":"done","queue_duration_s":0.002919,"scheduling_latency_s":0.002969,"redis_calls":10,"redis_duration_s":0.019372,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002892,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013185,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003295,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001431746,"duration_s":0.125986,"completed_at":"2026-06-30T07:57:18.190Z","load_balancing_strategy":"primary","db_duration_s":0.003016,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404vm-test-run-nixbot-gitlab> gitlab # [ 151.264408] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:18.203Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"04dfa46c9f997220dab38ee3","created_at":"2026-06-30T07:57:18.133Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"00e50b55c793c71919d663cd25199145","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:18.163Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-04dfa46c9f997220dab38ee3: start","job_status":"start","queue_duration_s":0.039212,"scheduling_latency_s":0.039268}1405vm-test-run-nixbot-gitlab> gitlab # [ 151.311590] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:18.251Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1406vm-test-run-nixbot-gitlab> gitlab # [ 151.323091] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:18.262Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"04dfa46c9f997220dab38ee3","created_at":"2026-06-30T07:57:18.133Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"00e50b55c793c71919d663cd25199145","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:18.163Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-04dfa46c9f997220dab38ee3: done: 0.05971 sec","job_status":"done","queue_duration_s":0.039212,"scheduling_latency_s":0.039268,"redis_calls":10,"redis_duration_s":0.005896,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001024,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003693,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001179,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00077887,"duration_s":0.05971,"completed_at":"2026-06-30T07:57:18.262Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003994,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407vm-test-run-nixbot-gitlab> gitlab # [ 151.434880] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:18.374Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"817ed492986c04ac429e241c","created_at":"2026-06-30T07:57:18.192Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bf8f8d3fd6918d63374f04bd87425996","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:18.372Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-817ed492986c04ac429e241c: start","job_status":"start","queue_duration_s":0.001656,"scheduling_latency_s":0.001702}1408vm-test-run-nixbot-gitlab> gitlab # [ 151.498493] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:18.438Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1409vm-test-run-nixbot-gitlab> gitlab # [ 151.519302] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:18.458Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"817ed492986c04ac429e241c","created_at":"2026-06-30T07:57:18.192Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bf8f8d3fd6918d63374f04bd87425996","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:18.372Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-817ed492986c04ac429e241c: done: 0.084534 sec","job_status":"done","queue_duration_s":0.001656,"scheduling_latency_s":0.001702,"redis_calls":10,"redis_duration_s":0.014245,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003702,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007423,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00312,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002924394,"duration_s":0.084534,"completed_at":"2026-06-30T07:57:18.458Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002971,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410vm-test-run-nixbot-gitlab> gitlab # [ 151.593304] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:18.532Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"0099a8adb31e0d0b9fd22644","created_at":"2026-06-30T07:57:18.419Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f57835876995d72ade7e2860dfedd83c","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:18.436Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-0099a8adb31e0d0b9fd22644: start","job_status":"start","queue_duration_s":0.095502,"scheduling_latency_s":0.095571}1411vm-test-run-nixbot-gitlab> gitlab # [ 151.699483] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:18.637Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"0099a8adb31e0d0b9fd22644","created_at":"2026-06-30T07:57:18.419Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f57835876995d72ade7e2860dfedd83c","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:18.436Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-0099a8adb31e0d0b9fd22644: done: 0.105601 sec","job_status":"done","queue_duration_s":0.095502,"scheduling_latency_s":0.095571,"redis_calls":10,"redis_duration_s":0.015674999999999998,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004005,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008891,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002779,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001653283,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.105601,"completed_at":"2026-06-30T07:57:18.637Z","load_balancing_strategy":"primary","db_duration_s":0.031439,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412vm-test-run-nixbot-gitlab> gitlab # [ 151.744469] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:18.645Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"4844c911f787e97f71375c61","created_at":"2026-06-30T07:57:18.448Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ae79cd387f3b5899eac5b1fe4c1cf29","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:18.529Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-4844c911f787e97f71375c61: start","job_status":"start","queue_duration_s":0.115281,"scheduling_latency_s":0.115341}1413vm-test-run-nixbot-gitlab> gitlab # [ 151.746321] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:18.678Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1414vm-test-run-nixbot-gitlab> gitlab # [ 151.841940] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:18.780Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"4844c911f787e97f71375c61","created_at":"2026-06-30T07:57:18.448Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ae79cd387f3b5899eac5b1fe4c1cf29","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:18.529Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-4844c911f787e97f71375c61: done: 0.135506 sec","job_status":"done","queue_duration_s":0.115281,"scheduling_latency_s":0.115341,"redis_calls":10,"redis_duration_s":0.068502,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001081,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00419,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.063231,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001784305,"duration_s":0.135506,"completed_at":"2026-06-30T07:57:18.780Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005276,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415vm-test-run-nixbot-gitlab> gitlab # [ 151.914762] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:18.853Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"892cfa5c5d6f1e93676a6de8","created_at":"2026-06-30T07:57:18.572Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3fde7e9c0da8b1e382edd88522376d89","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-06-30T07:57:18.590Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-892cfa5c5d6f1e93676a6de8: start","job_status":"start","queue_duration_s":0.262974,"scheduling_latency_s":0.26304}1416vm-test-run-nixbot-gitlab> gitlab # [ 152.021749] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:18.961Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1417vm-test-run-nixbot-gitlab> gitlab # [ 152.049256] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:18.988Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"892cfa5c5d6f1e93676a6de8","created_at":"2026-06-30T07:57:18.572Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3fde7e9c0da8b1e382edd88522376d89","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-06-30T07:57:18.590Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-892cfa5c5d6f1e93676a6de8: done: 0.134478 sec","job_status":"done","queue_duration_s":0.262974,"scheduling_latency_s":0.26304,"redis_calls":10,"redis_duration_s":0.012046000000000001,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004057,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005793,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002196,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024893,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001132546,"duration_s":0.134478,"completed_at":"2026-06-30T07:57:18.987Z","load_balancing_strategy":"primary","db_duration_s":0.00234,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418vm-test-run-nixbot-gitlab> gitlab # [ 152.130935] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:19.069Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"ed622340ae60b7009817e02e","created_at":"2026-06-30T07:57:18.597Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c6d166256ad1b461e9561cf4a3ee8d1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:18.615Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-ed622340ae60b7009817e02e: start","job_status":"start","queue_duration_s":0.453378,"scheduling_latency_s":0.453449}1419vm-test-run-nixbot-gitlab> gitlab # [ 152.204775] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:19.143Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1420vm-test-run-nixbot-gitlab> gitlab # [ 152.239063] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:19.178Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"ed622340ae60b7009817e02e","created_at":"2026-06-30T07:57:18.597Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c6d166256ad1b461e9561cf4a3ee8d1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:18.615Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-ed622340ae60b7009817e02e: done: 0.109305 sec","job_status":"done","queue_duration_s":0.453378,"scheduling_latency_s":0.453449,"redis_calls":10,"redis_duration_s":0.048096,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004722,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.040579,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002795,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021184,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000870222,"duration_s":0.109305,"completed_at":"2026-06-30T07:57:19.178Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000848,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421vm-test-run-nixbot-gitlab> gitlab # [ 152.321688] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:19.260Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c2b129c6b4b50f66c5ee9c47","created_at":"2026-06-30T07:57:18.624Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dce09f97d5b93c4e385eea8a716686f8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-06-30T07:57:18.640Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c2b129c6b4b50f66c5ee9c47: start","job_status":"start","queue_duration_s":0.620571,"scheduling_latency_s":0.620615}1422vm-test-run-nixbot-gitlab> gitlab # [ 152.416551] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:19.355Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c2b129c6b4b50f66c5ee9c47","created_at":"2026-06-30T07:57:18.624Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dce09f97d5b93c4e385eea8a716686f8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-06-30T07:57:18.640Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c2b129c6b4b50f66c5ee9c47: done: 0.095232 sec","job_status":"done","queue_duration_s":0.620571,"scheduling_latency_s":0.620615,"redis_calls":10,"redis_duration_s":0.015719999999999998,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00341,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007788,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004522,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000894248,"duration_s":0.095232,"completed_at":"2026-06-30T07:57:19.355Z","load_balancing_strategy":"primary","db_duration_s":0.023461,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423vm-test-run-nixbot-gitlab> gitlab # [ 152.497208] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:19.435Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"700637e9a7e59b3a4386f42b","created_at":"2026-06-30T07:57:18.670Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eff170b1e7331de4648906d9e1b1ba4b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:18.746Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-700637e9a7e59b3a4386f42b: start","job_status":"start","queue_duration_s":0.689175,"scheduling_latency_s":0.689244}1424vm-test-run-nixbot-gitlab> gitlab # [ 153.075267] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:20.014Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"700637e9a7e59b3a4386f42b","created_at":"2026-06-30T07:57:18.670Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eff170b1e7331de4648906d9e1b1ba4b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:18.746Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-700637e9a7e59b3a4386f42b: done: 0.579129 sec","job_status":"done","queue_duration_s":0.689175,"scheduling_latency_s":0.689244,"redis_calls":14,"redis_duration_s":0.018368,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.005015,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008223,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00513,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":125,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":125,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.074,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":123,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":80,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.053,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.343822,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001806095,"exclusive_lock_hold_duration_s":0.481502259,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.579129,"completed_at":"2026-06-30T07:57:20.014Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.110813,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425vm-test-run-nixbot-gitlab> gitlab # [ 153.177779] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:20.115Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"f9b22f024179be05f4787f1b","created_at":"2026-06-30T07:57:18.782Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d7ac59c63a5832e5c7b7b2fdbceabb8","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:18.888Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-f9b22f024179be05f4787f1b: start","job_status":"start","queue_duration_s":1.227323,"scheduling_latency_s":1.227463}1426vm-test-run-nixbot-gitlab> gitlab # [ 153.241609] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:20.180Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"f9b22f024179be05f4787f1b","created_at":"2026-06-30T07:57:18.782Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d7ac59c63a5832e5c7b7b2fdbceabb8","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:18.888Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-f9b22f024179be05f4787f1b: done: 0.064829 sec","job_status":"done","queue_duration_s":1.227323,"scheduling_latency_s":1.227463,"redis_calls":13,"redis_duration_s":0.007624000000000001,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001232,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003712,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00268,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.019052701,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.064829,"completed_at":"2026-06-30T07:57:20.180Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007404,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1427vm-test-run-nixbot-gitlab> gitlab # [ 153.315826] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:20.254Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"0cb3f0a57580e3fb91c5f12c","created_at":"2026-06-30T07:57:18.943Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f1c82342e429cc4c2204a13041f9276f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:18.963Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-0cb3f0a57580e3fb91c5f12c: start","job_status":"start","queue_duration_s":1.29075,"scheduling_latency_s":1.290818}1428vm-test-run-nixbot-gitlab> gitlab # [ 153.370828] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:20.309Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"0cb3f0a57580e3fb91c5f12c","created_at":"2026-06-30T07:57:18.943Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f1c82342e429cc4c2204a13041f9276f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:18.963Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-0cb3f0a57580e3fb91c5f12c: done: 0.054889 sec","job_status":"done","queue_duration_s":1.29075,"scheduling_latency_s":1.290818,"redis_calls":12,"redis_duration_s":0.00738,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001168,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003617,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002595,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029961,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001222502,"exclusive_lock_hold_duration_s":0.011285513,"duration_s":0.054889,"completed_at":"2026-06-30T07:57:20.309Z","load_balancing_strategy":"primary","db_duration_s":0.005972,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429vm-test-run-nixbot-gitlab> gitlab # [ 153.440237] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:20.379Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"14ee30bc6aa81e3031ce92c6","created_at":"2026-06-30T07:57:18.983Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4e4b05ed3348c6f69fba11dbb17adab","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:19.072Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-14ee30bc6aa81e3031ce92c6: start","job_status":"start","queue_duration_s":1.306634,"scheduling_latency_s":1.306701}1430vm-test-run-nixbot-gitlab> gitlab # [ 153.520221] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:20.459Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"14ee30bc6aa81e3031ce92c6","created_at":"2026-06-30T07:57:18.983Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4e4b05ed3348c6f69fba11dbb17adab","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:19.072Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-14ee30bc6aa81e3031ce92c6: done: 0.080263 sec","job_status":"done","queue_duration_s":1.306634,"scheduling_latency_s":1.306701,"redis_calls":16,"redis_duration_s":0.010625,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.005004,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004375,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001246,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000949842,"duration_s":0.080263,"completed_at":"2026-06-30T07:57:20.459Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015911,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431vm-test-run-nixbot-gitlab> gitlab # [ 153.522735] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:20.462Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"e70fe47307e40d57db5f4658","created_at":"2026-06-30T07:57:19.130Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:19.157Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-e70fe47307e40d57db5f4658: start","job_status":"start","queue_duration_s":1.304795,"scheduling_latency_s":1.304835}1432vm-test-run-nixbot-gitlab> gitlab # [ 153.634279] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:20.573Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"e70fe47307e40d57db5f4658","created_at":"2026-06-30T07:57:19.130Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:19.157Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-e70fe47307e40d57db5f4658: done: 0.111225 sec","job_status":"done","queue_duration_s":1.304795,"scheduling_latency_s":1.304835,"redis_calls":71,"redis_duration_s":0.030198,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.004252,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001512,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.022794,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00164,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.075683,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000544203,"duration_s":0.111225,"completed_at":"2026-06-30T07:57:20.573Z","load_balancing_strategy":"primary","db_duration_s":0.003086,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433vm-test-run-nixbot-gitlab> gitlab # [ 153.636554] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:20.574Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"541c25642b4e4ca6be02f6d2","created_at":"2026-06-30T07:57:19.180Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd8147796dfb1806e337aa34105e44d7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:19.293Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-541c25642b4e4ca6be02f6d2: start","job_status":"start","queue_duration_s":1.281253,"scheduling_latency_s":1.281275}1434vm-test-run-nixbot-gitlab> gitlab # [ 153.670545] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:20.609Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"541c25642b4e4ca6be02f6d2","created_at":"2026-06-30T07:57:19.180Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd8147796dfb1806e337aa34105e44d7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:19.293Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-541c25642b4e4ca6be02f6d2: done: 0.034855 sec","job_status":"done","queue_duration_s":1.281253,"scheduling_latency_s":1.281275,"redis_calls":19,"redis_duration_s":0.006215,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00119,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000587,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.0035,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019392,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000499226,"duration_s":0.034855,"completed_at":"2026-06-30T07:57:20.609Z","load_balancing_strategy":"primary","db_duration_s":0.00492,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435vm-test-run-nixbot-gitlab> gitlab # [ 153.754663] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:20.611Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"851b2c3f9a6ca44a79f5517e","created_at":"2026-06-30T07:57:19.325Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0fbc13d0ff472c2914329019ea8e0448","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:19.347Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-851b2c3f9a6ca44a79f5517e: start","job_status":"start","queue_duration_s":1.263845,"scheduling_latency_s":1.263866}1436vm-test-run-nixbot-gitlab> gitlab # [ 153.760255] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:20.631Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"851b2c3f9a6ca44a79f5517e","created_at":"2026-06-30T07:57:19.325Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0fbc13d0ff472c2914329019ea8e0448","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:19.347Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-851b2c3f9a6ca44a79f5517e: done: 0.020825 sec","job_status":"done","queue_duration_s":1.263845,"scheduling_latency_s":1.263866,"redis_calls":12,"redis_duration_s":0.003505,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000924,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002012,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000569,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000587784,"duration_s":0.020825,"completed_at":"2026-06-30T07:57:20.631Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001706,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437vm-test-run-nixbot-gitlab> gitlab # [ 153.848343] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:20.634Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"d5661f922328db6062453034","created_at":"2026-06-30T07:57:19.431Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4dc7e4e93ef9e36ad86a7722e8a2e96","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:19.480Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-d5661f922328db6062453034: start","job_status":"start","queue_duration_s":1.15384,"scheduling_latency_s":1.15386}1438vm-test-run-nixbot-gitlab> gitlab # [ 153.849604] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:20.653Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"d5661f922328db6062453034","created_at":"2026-06-30T07:57:19.431Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4dc7e4e93ef9e36ad86a7722e8a2e96","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:19.480Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-d5661f922328db6062453034: done: 0.019319 sec","job_status":"done","queue_duration_s":1.15384,"scheduling_latency_s":1.15386,"redis_calls":10,"redis_duration_s":0.004152,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000938,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002398,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000816,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000498946,"duration_s":0.019319,"completed_at":"2026-06-30T07:57:20.653Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000584,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439vm-test-run-nixbot-gitlab> gitlab # [ 153.920428] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:20.655Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"70afde1cbb2a925cb0e0e202","created_at":"2026-06-30T07:57:19.507Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"500970cd928113109879311849487a64","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:19.522Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-70afde1cbb2a925cb0e0e202: start","job_status":"start","queue_duration_s":1.132824,"scheduling_latency_s":1.132844}1440vm-test-run-nixbot-gitlab> gitlab # [ 153.922429] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:20.679Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"70afde1cbb2a925cb0e0e202","created_at":"2026-06-30T07:57:19.507Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"500970cd928113109879311849487a64","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:19.522Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-70afde1cbb2a925cb0e0e202: done: 0.024198 sec","job_status":"done","queue_duration_s":1.132824,"scheduling_latency_s":1.132844,"redis_calls":10,"redis_duration_s":0.004462,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000872,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002753,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000837,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000499784,"duration_s":0.024198,"completed_at":"2026-06-30T07:57:20.679Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003621,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441vm-test-run-nixbot-gitlab> gitlab # [ 153.990322] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:20.681Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"2e3bf47075cc71618a7ce244","created_at":"2026-06-30T07:57:19.557Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cc18e08e4a85e676899ec4aac1deebc9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:19.571Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-2e3bf47075cc71618a7ce244: start","job_status":"start","queue_duration_s":1.110132,"scheduling_latency_s":1.110151}1442vm-test-run-nixbot-gitlab> gitlab # [ 154.065337] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:20.727Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"2e3bf47075cc71618a7ce244","created_at":"2026-06-30T07:57:19.557Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cc18e08e4a85e676899ec4aac1deebc9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:19.571Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-2e3bf47075cc71618a7ce244: done: 0.045836 sec","job_status":"done","queue_duration_s":1.110132,"scheduling_latency_s":1.110151,"redis_calls":12,"redis_duration_s":0.00428,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000738,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002135,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001407,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000687796,"exclusive_lock_hold_duration_s":0.026499177,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.045836,"completed_at":"2026-06-30T07:57:20.727Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019568,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443vm-test-run-nixbot-gitlab> gitlab # [ 154.134397] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:20.728Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"745a6bfa6cf79abd7ccb22c0","created_at":"2026-06-30T07:57:19.580Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"920368dd39544cf22712da6339a2e931","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:19.591Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-745a6bfa6cf79abd7ccb22c0: start","job_status":"start","queue_duration_s":1.137514,"scheduling_latency_s":1.137536}1444vm-test-run-nixbot-gitlab> gitlab # [ 154.297836] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.236Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"745a6bfa6cf79abd7ccb22c0","created_at":"2026-06-30T07:57:19.580Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"920368dd39544cf22712da6339a2e931","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:19.591Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-745a6bfa6cf79abd7ccb22c0: done: 0.507433 sec","job_status":"done","queue_duration_s":1.137514,"scheduling_latency_s":1.137536,"redis_calls":574,"redis_duration_s":0.219679,"redis_read_bytes":573,"redis_write_bytes":49866,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000754,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001829,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.217096,"redis_shared_state_read_bytes":567,"redis_shared_state_write_bytes":49017,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.307564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038748,"duration_s":0.507433,"completed_at":"2026-06-30T07:57:21.236Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000625,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445vm-test-run-nixbot-gitlab> gitlab # [ 154.299890] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.237Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"bcc4d08cb792d90c858a934c","created_at":"2026-06-30T07:57:19.598Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"802516d16b2dbde30c0d1c625273d8d2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:19.607Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-bcc4d08cb792d90c858a934c: start","job_status":"start","queue_duration_s":1.63059,"scheduling_latency_s":1.630612}1446vm-test-run-nixbot-gitlab> gitlab # [ 154.450755] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.389Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"bcc4d08cb792d90c858a934c","created_at":"2026-06-30T07:57:19.598Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"802516d16b2dbde30c0d1c625273d8d2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:19.607Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-bcc4d08cb792d90c858a934c: done: 0.151724 sec","job_status":"done","queue_duration_s":1.63059,"scheduling_latency_s":1.630612,"redis_calls":12,"redis_duration_s":0.004762,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000796,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002273,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001693,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001282565,"exclusive_lock_hold_duration_s":0.018395356,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.151724,"completed_at":"2026-06-30T07:57:21.389Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016884,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447vm-test-run-nixbot-gitlab> gitlab # [ 154.522849] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.461Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"0e8b74483b1bbb042e54ab37","created_at":"2026-06-30T07:57:19.631Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e759d70de2858e701c66f73b101dd9f","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:19.637Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-0e8b74483b1bbb042e54ab37: start","job_status":"start","queue_duration_s":1.823884,"scheduling_latency_s":1.823927}1448vm-test-run-nixbot-gitlab> gitlab # [ 154.598786] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.537Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"0e8b74483b1bbb042e54ab37","created_at":"2026-06-30T07:57:19.631Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e759d70de2858e701c66f73b101dd9f","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-06-30T07:57:19.637Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-0e8b74483b1bbb042e54ab37: done: 0.075759 sec","job_status":"done","queue_duration_s":1.823884,"scheduling_latency_s":1.823927,"redis_calls":12,"redis_duration_s":0.006133,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000839,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002791,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002503,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001080304,"exclusive_lock_hold_duration_s":0.008071975,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.075759,"completed_at":"2026-06-30T07:57:21.537Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003987,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449vm-test-run-nixbot-gitlab> gitlab # [ 154.668848] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b2213bd832aa2cdb28ae0b2","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b2213bd832aa2cdb28ae0b2: start","job_status":"start","queue_duration_s":1.044548,"scheduling_latency_s":1.044591}1450vm-test-run-nixbot-gitlab> gitlab # [ 154.739543] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b2213bd832aa2cdb28ae0b2","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b2213bd832aa2cdb28ae0b2: done: 0.070227 sec","job_status":"done","queue_duration_s":1.044548,"scheduling_latency_s":1.044591,"redis_calls":16,"redis_duration_s":0.006557,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001007,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003462,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001140089,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.070227,"completed_at":"2026-06-30T07:57:21.678Z","load_balancing_strategy":"primary","db_duration_s":0.001064,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451vm-test-run-nixbot-gitlab> gitlab # [ 154.806822] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.745Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13cfc9e9082e7a2a27c2ec22","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13cfc9e9082e7a2a27c2ec22: start","job_status":"start","queue_duration_s":1.182255,"scheduling_latency_s":1.182326}1452vm-test-run-nixbot-gitlab> gitlab # [ 154.849402] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.787Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13cfc9e9082e7a2a27c2ec22","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13cfc9e9082e7a2a27c2ec22: done: 0.042295 sec","job_status":"done","queue_duration_s":1.182255,"scheduling_latency_s":1.182326,"redis_calls":13,"redis_duration_s":0.007969,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005402,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.042295,"completed_at":"2026-06-30T07:57:21.787Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453vm-test-run-nixbot-gitlab> gitlab # [ 154.852616] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c5affb408440508cc8fc140","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c5affb408440508cc8fc140: start","job_status":"start","queue_duration_s":1.228307,"scheduling_latency_s":1.22836}1454vm-test-run-nixbot-gitlab> gitlab # [ 154.882121] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.821Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c5affb408440508cc8fc140","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c5affb408440508cc8fc140: done: 0.029699 sec","job_status":"done","queue_duration_s":1.228307,"scheduling_latency_s":1.22836,"redis_calls":13,"redis_duration_s":0.006750000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001944,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004806,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029699,"completed_at":"2026-06-30T07:57:21.821Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455vm-test-run-nixbot-gitlab> gitlab # [ 154.969976] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.822Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0228280a74e42895dcea6a17","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0228280a74e42895dcea6a17: start","job_status":"start","queue_duration_s":1.259343,"scheduling_latency_s":1.259366}1456vm-test-run-nixbot-gitlab> gitlab # [ 154.971295] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0228280a74e42895dcea6a17","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0228280a74e42895dcea6a17: done: 0.015079 sec","job_status":"done","queue_duration_s":1.259343,"scheduling_latency_s":1.259366,"redis_calls":13,"redis_duration_s":0.0030819999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002139,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009519,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015079,"completed_at":"2026-06-30T07:57:21.837Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457vm-test-run-nixbot-gitlab> gitlab # [ 155.063262] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.839Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"138f177cef3c327bce66aa4e","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-138f177cef3c327bce66aa4e: start","job_status":"start","queue_duration_s":1.275714,"scheduling_latency_s":1.275734}1458vm-test-run-nixbot-gitlab> gitlab # [ 155.064838] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.856Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"138f177cef3c327bce66aa4e","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-138f177cef3c327bce66aa4e: done: 0.017345 sec","job_status":"done","queue_duration_s":1.275714,"scheduling_latency_s":1.275734,"redis_calls":13,"redis_duration_s":0.005334,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001666,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003668,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017345,"completed_at":"2026-06-30T07:57:21.856Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459vm-test-run-nixbot-gitlab> gitlab # [ 155.142950] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"505f80ddd9c9673ab02889e2","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-505f80ddd9c9673ab02889e2: start","job_status":"start","queue_duration_s":1.29491,"scheduling_latency_s":1.294931}1460vm-test-run-nixbot-gitlab> gitlab # [ 155.144339] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.876Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"505f80ddd9c9673ab02889e2","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-505f80ddd9c9673ab02889e2: done: 0.018331 sec","job_status":"done","queue_duration_s":1.29491,"scheduling_latency_s":1.294931,"redis_calls":13,"redis_duration_s":0.005688,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001774,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018331,"completed_at":"2026-06-30T07:57:21.876Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461vm-test-run-nixbot-gitlab> gitlab # [ 155.168395] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0565dcfc4cc2569d6cf2eded","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0565dcfc4cc2569d6cf2eded: start","job_status":"start","queue_duration_s":1.315118,"scheduling_latency_s":1.31514}1462vm-test-run-nixbot-gitlab> gitlab # [ 155.188789] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.896Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0565dcfc4cc2569d6cf2eded","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0565dcfc4cc2569d6cf2eded: done: 0.018073 sec","job_status":"done","queue_duration_s":1.315118,"scheduling_latency_s":1.31514,"redis_calls":13,"redis_duration_s":0.005408,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001652,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003756,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018073,"completed_at":"2026-06-30T07:57:21.896Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463vm-test-run-nixbot-gitlab> gitlab # [ 155.251917] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.899Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"922c2d35d16f9a2114d9b40d","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-922c2d35d16f9a2114d9b40d: start","job_status":"start","queue_duration_s":1.336013,"scheduling_latency_s":1.336088}1464vm-test-run-nixbot-gitlab> gitlab # [ 155.274294] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.925Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"922c2d35d16f9a2114d9b40d","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-922c2d35d16f9a2114d9b40d: done: 0.0264 sec","job_status":"done","queue_duration_s":1.336013,"scheduling_latency_s":1.336088,"redis_calls":13,"redis_duration_s":0.003912,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001606,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002306,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0264,"completed_at":"2026-06-30T07:57:21.925Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465vm-test-run-nixbot-gitlab> gitlab # [ 155.349642] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5a926877badadd0ef1f880c","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5a926877badadd0ef1f880c: start","job_status":"start","queue_duration_s":1.36379,"scheduling_latency_s":1.363819}1466vm-test-run-nixbot-gitlab> gitlab # [ 155.352910] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5a926877badadd0ef1f880c","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5a926877badadd0ef1f880c: done: 0.01549 sec","job_status":"done","queue_duration_s":1.36379,"scheduling_latency_s":1.363819,"redis_calls":13,"redis_duration_s":0.003043,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002124,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009683,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01549,"completed_at":"2026-06-30T07:57:21.942Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467vm-test-run-nixbot-gitlab> gitlab # [ 155.416050] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc966b1b16cdce44be1303b2","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc966b1b16cdce44be1303b2: start","job_status":"start","queue_duration_s":1.380639,"scheduling_latency_s":1.38066}1468vm-test-run-nixbot-gitlab> gitlab # [ 155.497300] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc966b1b16cdce44be1303b2","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc966b1b16cdce44be1303b2: done: 0.017398 sec","job_status":"done","queue_duration_s":1.380639,"scheduling_latency_s":1.38066,"redis_calls":13,"redis_duration_s":0.0030600000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002131,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017398,"completed_at":"2026-06-30T07:57:21.961Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469vm-test-run-nixbot-gitlab> gitlab # [ 155.499066] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.963Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6b5cd4ac5702fd758f074db","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6b5cd4ac5702fd758f074db: start","job_status":"start","queue_duration_s":1.399606,"scheduling_latency_s":1.399634}1470vm-test-run-nixbot-gitlab> gitlab # [ 155.570841] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.978Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6b5cd4ac5702fd758f074db","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6b5cd4ac5702fd758f074db: done: 0.015688 sec","job_status":"done","queue_duration_s":1.399606,"scheduling_latency_s":1.399634,"redis_calls":13,"redis_duration_s":0.002786,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000862,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001924,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015688,"completed_at":"2026-06-30T07:57:21.978Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471vm-test-run-nixbot-gitlab> gitlab # [ 155.639842] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f598396a15011af81ec79fd","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f598396a15011af81ec79fd: start","job_status":"start","queue_duration_s":1.416726,"scheduling_latency_s":1.416747}1472vm-test-run-nixbot-gitlab> gitlab # [ 155.641616] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.995Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f598396a15011af81ec79fd","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f598396a15011af81ec79fd: done: 0.015102 sec","job_status":"done","queue_duration_s":1.416726,"scheduling_latency_s":1.416747,"redis_calls":13,"redis_duration_s":0.002809,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000861,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015102,"completed_at":"2026-06-30T07:57:21.995Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473vm-test-run-nixbot-gitlab> gitlab # [ 155.658860] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:21.996Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d4d405e39bf6558532c63f08","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d4d405e39bf6558532c63f08: start","job_status":"start","queue_duration_s":1.433203,"scheduling_latency_s":1.433224}1474vm-test-run-nixbot-gitlab> gitlab # [ 155.678926] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d4d405e39bf6558532c63f08","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d4d405e39bf6558532c63f08: done: 0.015378 sec","job_status":"done","queue_duration_s":1.433203,"scheduling_latency_s":1.433224,"redis_calls":13,"redis_duration_s":0.0030759999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000989,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002087,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015378,"completed_at":"2026-06-30T07:57:22.011Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475vm-test-run-nixbot-gitlab> gitlab # [ 155.784166] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08bae7e7ec51224e88aefa66","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08bae7e7ec51224e88aefa66: start","job_status":"start","queue_duration_s":1.450064,"scheduling_latency_s":1.450085}1476vm-test-run-nixbot-gitlab> gitlab # [ 155.785762] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08bae7e7ec51224e88aefa66","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08bae7e7ec51224e88aefa66: done: 0.015114 sec","job_status":"done","queue_duration_s":1.450064,"scheduling_latency_s":1.450085,"redis_calls":13,"redis_duration_s":0.002737,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001854,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015114,"completed_at":"2026-06-30T07:57:22.028Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477vm-test-run-nixbot-gitlab> gitlab # [ 155.822857] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e6a72d5612966de0bb969c7","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e6a72d5612966de0bb969c7: start","job_status":"start","queue_duration_s":1.466609,"scheduling_latency_s":1.466629}1478vm-test-run-nixbot-gitlab> gitlab # [ 155.842955] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e6a72d5612966de0bb969c7","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e6a72d5612966de0bb969c7: done: 0.015032 sec","job_status":"done","queue_duration_s":1.466609,"scheduling_latency_s":1.466629,"redis_calls":13,"redis_duration_s":0.0029370000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001028,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015032,"completed_at":"2026-06-30T07:57:22.045Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479vm-test-run-nixbot-gitlab> gitlab # [ 155.928893] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5345ffa9256dc0c657ae5949","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5345ffa9256dc0c657ae5949: start","job_status":"start","queue_duration_s":1.483173,"scheduling_latency_s":1.483195}1480vm-test-run-nixbot-gitlab> gitlab # [ 155.929452] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5345ffa9256dc0c657ae5949","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5345ffa9256dc0c657ae5949: done: 0.015106 sec","job_status":"done","queue_duration_s":1.483173,"scheduling_latency_s":1.483195,"redis_calls":13,"redis_duration_s":0.002793,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015106,"completed_at":"2026-06-30T07:57:22.061Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481vm-test-run-nixbot-gitlab> gitlab # [ 155.999182] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"386f0be3acc0cd94da3ccb6f","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-386f0be3acc0cd94da3ccb6f: start","job_status":"start","queue_duration_s":1.49954,"scheduling_latency_s":1.499561}1482vm-test-run-nixbot-gitlab> gitlab # [ 156.070515] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"386f0be3acc0cd94da3ccb6f","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-386f0be3acc0cd94da3ccb6f: done: 0.015148 sec","job_status":"done","queue_duration_s":1.49954,"scheduling_latency_s":1.499561,"redis_calls":13,"redis_duration_s":0.002927,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002061,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010293,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015148,"completed_at":"2026-06-30T07:57:22.078Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483vm-test-run-nixbot-gitlab> gitlab # [ 156.072300] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.079Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdf842fc537e98f6fad64b55","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdf842fc537e98f6fad64b55: start","job_status":"start","queue_duration_s":1.515937,"scheduling_latency_s":1.515958}1484vm-test-run-nixbot-gitlab> gitlab # [ 156.085252] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdf842fc537e98f6fad64b55","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdf842fc537e98f6fad64b55: done: 0.02265 sec","job_status":"done","queue_duration_s":1.515937,"scheduling_latency_s":1.515958,"redis_calls":13,"redis_duration_s":0.010284,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002599,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007685,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02265,"completed_at":"2026-06-30T07:57:22.101Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485vm-test-run-nixbot-gitlab> gitlab # [ 156.214778] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ca2d873c451c33d3ca9206c","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ca2d873c451c33d3ca9206c: start","job_status":"start","queue_duration_s":1.541732,"scheduling_latency_s":1.541753}1486vm-test-run-nixbot-gitlab> gitlab # [ 156.216230] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ca2d873c451c33d3ca9206c","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ca2d873c451c33d3ca9206c: done: 0.018775 sec","job_status":"done","queue_duration_s":1.541732,"scheduling_latency_s":1.541753,"redis_calls":13,"redis_duration_s":0.005606,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002063,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003543,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018775,"completed_at":"2026-06-30T07:57:22.123Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487vm-test-run-nixbot-gitlab> gitlab # [ 156.229089] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d14b98379b64052bb9eb7df","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d14b98379b64052bb9eb7df: start","job_status":"start","queue_duration_s":1.561916,"scheduling_latency_s":1.561937}1488vm-test-run-nixbot-gitlab> gitlab # [ 156.297896] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d14b98379b64052bb9eb7df","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d14b98379b64052bb9eb7df: done: 0.015348 sec","job_status":"done","queue_duration_s":1.561916,"scheduling_latency_s":1.561937,"redis_calls":13,"redis_duration_s":0.003012,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000988,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015348,"completed_at":"2026-06-30T07:57:22.140Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489vm-test-run-nixbot-gitlab> gitlab # [ 156.311440] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d70a1418cd2e6f8aa90aec89","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d70a1418cd2e6f8aa90aec89: start","job_status":"start","queue_duration_s":1.578742,"scheduling_latency_s":1.578763}1490vm-test-run-nixbot-gitlab> gitlab # [ 156.332190] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.158Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d70a1418cd2e6f8aa90aec89","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d70a1418cd2e6f8aa90aec89: done: 0.015868 sec","job_status":"done","queue_duration_s":1.578742,"scheduling_latency_s":1.578763,"redis_calls":13,"redis_duration_s":0.002915,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015868,"completed_at":"2026-06-30T07:57:22.157Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491vm-test-run-nixbot-gitlab> gitlab # [ 156.439436] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72caec25588c3c1d29243127","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72caec25588c3c1d29243127: start","job_status":"start","queue_duration_s":1.596191,"scheduling_latency_s":1.596213}1492vm-test-run-nixbot-gitlab> gitlab # [ 156.441489] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72caec25588c3c1d29243127","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72caec25588c3c1d29243127: done: 0.015527 sec","job_status":"done","queue_duration_s":1.596191,"scheduling_latency_s":1.596213,"redis_calls":13,"redis_duration_s":0.003013,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000895,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015527,"completed_at":"2026-06-30T07:57:22.175Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493vm-test-run-nixbot-gitlab> gitlab # [ 156.477247] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49e31cd538cc40afa8872900","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49e31cd538cc40afa8872900: start","job_status":"start","queue_duration_s":1.613136,"scheduling_latency_s":1.613156}1494vm-test-run-nixbot-gitlab> gitlab # [ 156.497244] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49e31cd538cc40afa8872900","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49e31cd538cc40afa8872900: done: 0.017802 sec","job_status":"done","queue_duration_s":1.613136,"scheduling_latency_s":1.613156,"redis_calls":13,"redis_duration_s":0.005163,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000973,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00419,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017802,"completed_at":"2026-06-30T07:57:22.194Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495vm-test-run-nixbot-gitlab> gitlab # [ 156.600126] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b8cb089f0053040682f41c0","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b8cb089f0053040682f41c0: start","job_status":"start","queue_duration_s":1.632239,"scheduling_latency_s":1.632259}1496vm-test-run-nixbot-gitlab> gitlab # [ 156.601366] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b8cb089f0053040682f41c0","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b8cb089f0053040682f41c0: done: 0.016821 sec","job_status":"done","queue_duration_s":1.632239,"scheduling_latency_s":1.632259,"redis_calls":13,"redis_duration_s":0.003826,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001784,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016821,"completed_at":"2026-06-30T07:57:22.212Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497vm-test-run-nixbot-gitlab> gitlab # [ 156.641220] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f86e00422867efb2c66cd7c","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f86e00422867efb2c66cd7c: start","job_status":"start","queue_duration_s":1.650681,"scheduling_latency_s":1.650703}1498vm-test-run-nixbot-gitlab> gitlab # [ 156.714447] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f86e00422867efb2c66cd7c","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f86e00422867efb2c66cd7c: done: 0.015385 sec","job_status":"done","queue_duration_s":1.650681,"scheduling_latency_s":1.650703,"redis_calls":13,"redis_duration_s":0.0029089999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015385,"completed_at":"2026-06-30T07:57:22.229Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499vm-test-run-nixbot-gitlab> gitlab # [ 156.721995] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85c6d72fce74f67a207a5944","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85c6d72fce74f67a207a5944: start","job_status":"start","queue_duration_s":1.667639,"scheduling_latency_s":1.667662}1500vm-test-run-nixbot-gitlab> gitlab # [ 156.793202] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85c6d72fce74f67a207a5944","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85c6d72fce74f67a207a5944: done: 0.015479 sec","job_status":"done","queue_duration_s":1.667639,"scheduling_latency_s":1.667662,"redis_calls":13,"redis_duration_s":0.003079,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000957,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002122,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015479,"completed_at":"2026-06-30T07:57:22.246Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501vm-test-run-nixbot-gitlab> gitlab # [ 156.802220] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.248Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa42537bf298bb9a7bf8c12c","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa42537bf298bb9a7bf8c12c: start","job_status":"start","queue_duration_s":1.684916,"scheduling_latency_s":1.684937}1502vm-test-run-nixbot-gitlab> gitlab # [ 156.881950] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa42537bf298bb9a7bf8c12c","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa42537bf298bb9a7bf8c12c: done: 0.015591 sec","job_status":"done","queue_duration_s":1.684916,"scheduling_latency_s":1.684937,"redis_calls":13,"redis_duration_s":0.003025,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000947,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002078,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015591,"completed_at":"2026-06-30T07:57:22.263Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503vm-test-run-nixbot-gitlab> gitlab # [ 156.883977] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81722dade125f7b5803585d1","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81722dade125f7b5803585d1: start","job_status":"start","queue_duration_s":1.701949,"scheduling_latency_s":1.701969}1504vm-test-run-nixbot-gitlab> gitlab # [ 156.904985] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81722dade125f7b5803585d1","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81722dade125f7b5803585d1: done: 0.015375 sec","job_status":"done","queue_duration_s":1.701949,"scheduling_latency_s":1.701969,"redis_calls":13,"redis_duration_s":0.002871,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00195,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015375,"completed_at":"2026-06-30T07:57:22.280Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505vm-test-run-nixbot-gitlab> gitlab # [ 157.000477] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9115a09311c7013976748adb","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9115a09311c7013976748adb: start","job_status":"start","queue_duration_s":1.718902,"scheduling_latency_s":1.718922}1506vm-test-run-nixbot-gitlab> gitlab # [ 157.002259] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9115a09311c7013976748adb","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9115a09311c7013976748adb: done: 0.015443 sec","job_status":"done","queue_duration_s":1.718902,"scheduling_latency_s":1.718922,"redis_calls":13,"redis_duration_s":0.002946,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015443,"completed_at":"2026-06-30T07:57:22.297Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507vm-test-run-nixbot-gitlab> gitlab # [ 157.095476] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f9201ade804b4fe9f2dc8c6","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f9201ade804b4fe9f2dc8c6: start","job_status":"start","queue_duration_s":1.735697,"scheduling_latency_s":1.735718}1508vm-test-run-nixbot-gitlab> gitlab # [ 157.097467] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f9201ade804b4fe9f2dc8c6","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f9201ade804b4fe9f2dc8c6: done: 0.015524 sec","job_status":"done","queue_duration_s":1.735697,"scheduling_latency_s":1.735718,"redis_calls":13,"redis_duration_s":0.0029820000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015524,"completed_at":"2026-06-30T07:57:22.314Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509vm-test-run-nixbot-gitlab> gitlab # [ 157.133823] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a24d30d27af5c8f2d6ed06f0","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a24d30d27af5c8f2d6ed06f0: start","job_status":"start","queue_duration_s":1.752625,"scheduling_latency_s":1.752646}1510vm-test-run-nixbot-gitlab> gitlab # [ 157.201380] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a24d30d27af5c8f2d6ed06f0","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a24d30d27af5c8f2d6ed06f0: done: 0.015758 sec","job_status":"done","queue_duration_s":1.752625,"scheduling_latency_s":1.752646,"redis_calls":13,"redis_duration_s":0.002997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00202,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015758,"completed_at":"2026-06-30T07:57:22.331Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511vm-test-run-nixbot-gitlab> gitlab # [ 157.214052] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f17f5e1d0fa297dc0aa15090","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f17f5e1d0fa297dc0aa15090: start","job_status":"start","queue_duration_s":1.769731,"scheduling_latency_s":1.769752}1512vm-test-run-nixbot-gitlab> gitlab # [ 157.234089] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f17f5e1d0fa297dc0aa15090","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f17f5e1d0fa297dc0aa15090: done: 0.016011 sec","job_status":"done","queue_duration_s":1.769731,"scheduling_latency_s":1.769752,"redis_calls":13,"redis_duration_s":0.0030289999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00104,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001989,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016011,"completed_at":"2026-06-30T07:57:22.349Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513vm-test-run-nixbot-gitlab> gitlab # [ 157.354161] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.350Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5acff963f887d3a8203a808c","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5acff963f887d3a8203a808c: start","job_status":"start","queue_duration_s":1.787062,"scheduling_latency_s":1.787082}1514vm-test-run-nixbot-gitlab> gitlab # [ 157.355329] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5acff963f887d3a8203a808c","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5acff963f887d3a8203a808c: done: 0.166603 sec","job_status":"done","queue_duration_s":1.787062,"scheduling_latency_s":1.787082,"redis_calls":13,"redis_duration_s":0.003203,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001232,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.166603,"completed_at":"2026-06-30T07:57:22.517Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515vm-test-run-nixbot-gitlab> gitlab # [ 157.377978] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.518Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c45c2b2870639d151cd91e90","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c45c2b2870639d151cd91e90: start","job_status":"start","queue_duration_s":1.955165,"scheduling_latency_s":1.955194}1516vm-test-run-nixbot-gitlab> gitlab # [ 157.398322] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c45c2b2870639d151cd91e90","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c45c2b2870639d151cd91e90: done: 0.016167 sec","job_status":"done","queue_duration_s":1.955165,"scheduling_latency_s":1.955194,"redis_calls":13,"redis_duration_s":0.002895,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000879,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016167,"completed_at":"2026-06-30T07:57:22.534Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517vm-test-run-nixbot-gitlab> gitlab # [ 157.461452] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.536Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50c2cde4156f6caf4a97a693","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50c2cde4156f6caf4a97a693: start","job_status":"start","queue_duration_s":1.972735,"scheduling_latency_s":1.972755}1518vm-test-run-nixbot-gitlab> gitlab # [ 157.481137] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50c2cde4156f6caf4a97a693","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50c2cde4156f6caf4a97a693: done: 0.015282 sec","job_status":"done","queue_duration_s":1.972735,"scheduling_latency_s":1.972755,"redis_calls":13,"redis_duration_s":0.00317,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001218,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015282,"completed_at":"2026-06-30T07:57:22.551Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519vm-test-run-nixbot-gitlab> gitlab # [ 157.544386] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b61cad66a99388493c03a9a9","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b61cad66a99388493c03a9a9: start","job_status":"start","queue_duration_s":1.989425,"scheduling_latency_s":1.989447}1520vm-test-run-nixbot-gitlab> gitlab # [ 157.564406] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b61cad66a99388493c03a9a9","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b61cad66a99388493c03a9a9: done: 0.015141 sec","job_status":"done","queue_duration_s":1.989425,"scheduling_latency_s":1.989447,"redis_calls":13,"redis_duration_s":0.002815,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000836,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015141,"completed_at":"2026-06-30T07:57:22.567Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521vm-test-run-nixbot-gitlab> gitlab # [ 157.651193] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2ee9304c2fbd1cd41e03d53","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2ee9304c2fbd1cd41e03d53: start","job_status":"start","queue_duration_s":2.005902,"scheduling_latency_s":2.005924}1522vm-test-run-nixbot-gitlab> gitlab # [ 157.652804] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2ee9304c2fbd1cd41e03d53","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2ee9304c2fbd1cd41e03d53: done: 0.019354 sec","job_status":"done","queue_duration_s":2.005902,"scheduling_latency_s":2.005924,"redis_calls":13,"redis_duration_s":0.006883,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005312,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019354,"completed_at":"2026-06-30T07:57:22.588Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523vm-test-run-nixbot-gitlab> gitlab # [ 157.708215] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa4cad2566d3c9b5a8058707","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa4cad2566d3c9b5a8058707: start","job_status":"start","queue_duration_s":2.028867,"scheduling_latency_s":2.028889}1524vm-test-run-nixbot-gitlab> gitlab # [ 157.728226] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa4cad2566d3c9b5a8058707","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa4cad2566d3c9b5a8058707: done: 0.023771 sec","job_status":"done","queue_duration_s":2.028867,"scheduling_latency_s":2.028889,"redis_calls":13,"redis_duration_s":0.010776,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003704,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007072,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023771,"completed_at":"2026-06-30T07:57:22.616Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525vm-test-run-nixbot-gitlab> gitlab # [ 157.791407] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e943f7109ece063cea49c8d","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e943f7109ece063cea49c8d: start","job_status":"start","queue_duration_s":2.054881,"scheduling_latency_s":2.054902}1526vm-test-run-nixbot-gitlab> gitlab # [ 157.811457] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e943f7109ece063cea49c8d","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e943f7109ece063cea49c8d: done: 0.023606 sec","job_status":"done","queue_duration_s":2.054881,"scheduling_latency_s":2.054902,"redis_calls":13,"redis_duration_s":0.010558999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003354,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007205,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023606,"completed_at":"2026-06-30T07:57:22.641Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527vm-test-run-nixbot-gitlab> gitlab # [ 157.906318] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.645Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"021a3d13e4dd01366d679cb6","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-021a3d13e4dd01366d679cb6: start","job_status":"start","queue_duration_s":2.081719,"scheduling_latency_s":2.081742}1528vm-test-run-nixbot-gitlab> gitlab # [ 157.908141] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.663Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"021a3d13e4dd01366d679cb6","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-021a3d13e4dd01366d679cb6: done: 0.017997 sec","job_status":"done","queue_duration_s":2.081719,"scheduling_latency_s":2.081742,"redis_calls":13,"redis_duration_s":0.005102,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001932,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00317,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017997,"completed_at":"2026-06-30T07:57:22.663Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529vm-test-run-nixbot-gitlab> gitlab # [ 157.979574] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.664Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0520d2b81b76febeca82c0d","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0520d2b81b76febeca82c0d: start","job_status":"start","queue_duration_s":2.100989,"scheduling_latency_s":2.101011}1530vm-test-run-nixbot-gitlab> gitlab # [ 157.981621] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0520d2b81b76febeca82c0d","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0520d2b81b76febeca82c0d: done: 0.015406 sec","job_status":"done","queue_duration_s":2.100989,"scheduling_latency_s":2.101011,"redis_calls":13,"redis_duration_s":0.0029649999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000871,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010204,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015406,"completed_at":"2026-06-30T07:57:22.679Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531vm-test-run-nixbot-gitlab> gitlab # [ 158.038780] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.681Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db009c1890cdd77d6d720529","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db009c1890cdd77d6d720529: start","job_status":"start","queue_duration_s":2.117672,"scheduling_latency_s":2.117693}1532vm-test-run-nixbot-gitlab> gitlab # [ 158.058548] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db009c1890cdd77d6d720529","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db009c1890cdd77d6d720529: done: 0.015443 sec","job_status":"done","queue_duration_s":2.117672,"scheduling_latency_s":2.117693,"redis_calls":13,"redis_duration_s":0.002751,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000869,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015443,"completed_at":"2026-06-30T07:57:22.696Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533vm-test-run-nixbot-gitlab> gitlab # [ 158.132504] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c1594ba6c50567a352d692a","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c1594ba6c50567a352d692a: start","job_status":"start","queue_duration_s":2.134374,"scheduling_latency_s":2.134435}1534vm-test-run-nixbot-gitlab> gitlab # [ 158.139861] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.714Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c1594ba6c50567a352d692a","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c1594ba6c50567a352d692a: done: 0.016449 sec","job_status":"done","queue_duration_s":2.134374,"scheduling_latency_s":2.134435,"redis_calls":13,"redis_duration_s":0.004089,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000972,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016449,"completed_at":"2026-06-30T07:57:22.714Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535vm-test-run-nixbot-gitlab> gitlab # [ 158.204122] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.715Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e0e2d2f664840701fa4a72d","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e0e2d2f664840701fa4a72d: start","job_status":"start","queue_duration_s":2.152096,"scheduling_latency_s":2.152118}1536vm-test-run-nixbot-gitlab> gitlab # [ 158.290881] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.736Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e0e2d2f664840701fa4a72d","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e0e2d2f664840701fa4a72d: done: 0.020548 sec","job_status":"done","queue_duration_s":2.152096,"scheduling_latency_s":2.152118,"redis_calls":13,"redis_duration_s":0.008021,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020548,"completed_at":"2026-06-30T07:57:22.736Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537vm-test-run-nixbot-gitlab> gitlab # [ 158.292590] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.739Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb37ccd042bd4bbced305722","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb37ccd042bd4bbced305722: start","job_status":"start","queue_duration_s":2.175718,"scheduling_latency_s":2.175741}1538vm-test-run-nixbot-gitlab> gitlab # [ 158.306556] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb37ccd042bd4bbced305722","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb37ccd042bd4bbced305722: done: 0.020439 sec","job_status":"done","queue_duration_s":2.175718,"scheduling_latency_s":2.175741,"redis_calls":13,"redis_duration_s":0.007401,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005449,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020439,"completed_at":"2026-06-30T07:57:22.759Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539vm-test-run-nixbot-gitlab> gitlab # [ 158.382696] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86e93585a8ef959c929237d7","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86e93585a8ef959c929237d7: start","job_status":"start","queue_duration_s":2.197505,"scheduling_latency_s":2.197526}1540vm-test-run-nixbot-gitlab> gitlab # [ 158.387742] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86e93585a8ef959c929237d7","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86e93585a8ef959c929237d7: done: 0.015534 sec","job_status":"done","queue_duration_s":2.197505,"scheduling_latency_s":2.197526,"redis_calls":13,"redis_duration_s":0.0029890000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000965,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015534,"completed_at":"2026-06-30T07:57:22.776Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541vm-test-run-nixbot-gitlab> gitlab # [ 158.453222] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b1ad5b8ef023c52f80d5f4c","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b1ad5b8ef023c52f80d5f4c: start","job_status":"start","queue_duration_s":2.21449,"scheduling_latency_s":2.21451}1542vm-test-run-nixbot-gitlab> gitlab # [ 158.524952] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b1ad5b8ef023c52f80d5f4c","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b1ad5b8ef023c52f80d5f4c: done: 0.015608 sec","job_status":"done","queue_duration_s":2.21449,"scheduling_latency_s":2.21451,"redis_calls":13,"redis_duration_s":0.0031400000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000979,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002161,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015608,"completed_at":"2026-06-30T07:57:22.793Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543vm-test-run-nixbot-gitlab> gitlab # [ 158.534052] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.795Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40b700dfa8c131a623be6998","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40b700dfa8c131a623be6998: start","job_status":"start","queue_duration_s":2.231705,"scheduling_latency_s":2.231727}1544vm-test-run-nixbot-gitlab> gitlab # [ 158.554136] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40b700dfa8c131a623be6998","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40b700dfa8c131a623be6998: done: 0.015496 sec","job_status":"done","queue_duration_s":2.231705,"scheduling_latency_s":2.231727,"redis_calls":13,"redis_duration_s":0.0030080000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000968,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00204,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015496,"completed_at":"2026-06-30T07:57:22.810Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545vm-test-run-nixbot-gitlab> gitlab # [ 158.683176] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f069a4ef4ad9ab9f42eb0715","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f069a4ef4ad9ab9f42eb0715: start","job_status":"start","queue_duration_s":2.248689,"scheduling_latency_s":2.248711}1546vm-test-run-nixbot-gitlab> gitlab # [ 158.684760] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f069a4ef4ad9ab9f42eb0715","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f069a4ef4ad9ab9f42eb0715: done: 0.015442 sec","job_status":"done","queue_duration_s":2.248689,"scheduling_latency_s":2.248711,"redis_calls":13,"redis_duration_s":0.003052,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000967,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015442,"completed_at":"2026-06-30T07:57:22.827Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547vm-test-run-nixbot-gitlab> gitlab # [ 158.698173] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52459e6a3de9464fcba87af8","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52459e6a3de9464fcba87af8: start","job_status":"start","queue_duration_s":2.265589,"scheduling_latency_s":2.26561}1548vm-test-run-nixbot-gitlab> gitlab # [ 158.718284] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52459e6a3de9464fcba87af8","created_at":"2026-06-30T07:57:20.487Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-87c042d197e84b88","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2761b060e2a1d0bc6515c63673c6ef25","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.563Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52459e6a3de9464fcba87af8: done: 0.015292 sec","job_status":"done","queue_duration_s":2.265589,"scheduling_latency_s":2.26561,"redis_calls":13,"redis_duration_s":0.0030570000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002151,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015292,"completed_at":"2026-06-30T07:57:22.844Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549vm-test-run-nixbot-gitlab> gitlab # [ 158.827198] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.845Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cbb7f2f56f66c183de0bd1a6","created_at":"2026-06-30T07:57:20.592Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-61ce4188714b41fb","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cd8147796dfb1806e337aa34105e44d7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.602Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cbb7f2f56f66c183de0bd1a6: start","job_status":"start","queue_duration_s":2.243338,"scheduling_latency_s":2.243358}1550vm-test-run-nixbot-gitlab> gitlab # [ 158.828724] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.860Z","message":"No existing merge request to be cleaned up."}1551vm-test-run-nixbot-gitlab> gitlab # [ 158.829991] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.870Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cbb7f2f56f66c183de0bd1a6","created_at":"2026-06-30T07:57:20.592Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-61ce4188714b41fb","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cd8147796dfb1806e337aa34105e44d7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.602Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cbb7f2f56f66c183de0bd1a6: done: 0.02444 sec","job_status":"done","queue_duration_s":2.243338,"scheduling_latency_s":2.243358,"redis_calls":13,"redis_duration_s":0.003281,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000593,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001348,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000350044,"duration_s":0.02444,"completed_at":"2026-06-30T07:57:22.870Z","load_balancing_strategy":"primary","db_duration_s":0.003113,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1552vm-test-run-nixbot-gitlab> gitlab # [ 158.866219] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.871Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"75b648a139cd02d3f8992df8","created_at":"2026-06-30T07:57:20.592Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-61ce4188714b41fb","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cd8147796dfb1806e337aa34105e44d7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.602Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-75b648a139cd02d3f8992df8: start","job_status":"start","queue_duration_s":2.26928,"scheduling_latency_s":2.269299}1553vm-test-run-nixbot-gitlab> gitlab # [ 158.886210] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.881Z","message":"No existing merge request to be cleaned up."}1554vm-test-run-nixbot-gitlab> gitlab # [ 158.889052] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.887Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"75b648a139cd02d3f8992df8","created_at":"2026-06-30T07:57:20.592Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-61ce4188714b41fb","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cd8147796dfb1806e337aa34105e44d7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.602Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-75b648a139cd02d3f8992df8: done: 0.015642 sec","job_status":"done","queue_duration_s":2.26928,"scheduling_latency_s":2.269299,"redis_calls":10,"redis_duration_s":0.002167,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000853,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001314,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010276,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015642,"completed_at":"2026-06-30T07:57:22.887Z","load_balancing_strategy":"primary","db_duration_s":0.001471,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555vm-test-run-nixbot-gitlab> gitlab # [ 158.951135] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.888Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2d1adef48d4f665b7968248d","created_at":"2026-06-30T07:57:20.592Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-61ce4188714b41fb","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cd8147796dfb1806e337aa34105e44d7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.602Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2d1adef48d4f665b7968248d: start","job_status":"start","queue_duration_s":2.286339,"scheduling_latency_s":2.28636}1556vm-test-run-nixbot-gitlab> gitlab # [ 158.970985] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.898Z","message":"No existing merge request to be cleaned up."}1557vm-test-run-nixbot-gitlab> gitlab # [ 158.973887] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.904Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2d1adef48d4f665b7968248d","created_at":"2026-06-30T07:57:20.592Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-61ce4188714b41fb","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cd8147796dfb1806e337aa34105e44d7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.602Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2d1adef48d4f665b7968248d: done: 0.015791 sec","job_status":"done","queue_duration_s":2.286339,"scheduling_latency_s":2.28636,"redis_calls":10,"redis_duration_s":0.002441,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001044,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001397,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015791,"completed_at":"2026-06-30T07:57:22.904Z","load_balancing_strategy":"primary","db_duration_s":0.001496,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1558vm-test-run-nixbot-gitlab> gitlab # [ 159.076476] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.905Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"86d4cdde2e7aad29fd40281a","created_at":"2026-06-30T07:57:20.592Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-61ce4188714b41fb","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cd8147796dfb1806e337aa34105e44d7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.602Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-86d4cdde2e7aad29fd40281a: start","job_status":"start","queue_duration_s":2.303549,"scheduling_latency_s":2.303571}1559vm-test-run-nixbot-gitlab> gitlab # [ 159.077976] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.915Z","message":"No existing merge request to be cleaned up."}1560vm-test-run-nixbot-gitlab> gitlab # [ 159.079392] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:57:22.921Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"86d4cdde2e7aad29fd40281a","created_at":"2026-06-30T07:57:20.592Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-61ce4188714b41fb","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cd8147796dfb1806e337aa34105e44d7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:57:20.602Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-86d4cdde2e7aad29fd40281a: done: 0.015418 sec","job_status":"done","queue_duration_s":2.303549,"scheduling_latency_s":2.303571,"redis_calls":10,"redis_duration_s":0.002137,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000829,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001308,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010183,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015418,"completed_at":"2026-06-30T07:57:22.921Z","load_balancing_strategy":"primary","db_duration_s":0.001503,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561vm-test-run-nixbot-gitlab> gitlab # [ 159.451511] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2912995484 wd_nsec: 29129940691562vm-test-run-nixbot-gitlab> gitlab # [ 171.692849] setup-gitlab-start[2729]: W, [2026-06-30T07:57:38.631538 #2729] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1563vm-test-run-nixbot-gitlab> gitlab # [ 194.063701] runuser[2728]: pam_unix(runuser:session): session closed for user gitlab1564vm-test-run-nixbot-gitlab> gitlab # [ 194.070935] setup-gitlab-start[2948]: ++ jq -r .token1565vm-test-run-nixbot-gitlab> gitlab # [ 194.074843] setup-gitlab-start[2949]: +++ date -d '+7 days' +%F1566vm-test-run-nixbot-gitlab> gitlab # [ 194.079380] setup-gitlab-start[2947]: ++ curl -fs -X POST -H 'Authorization: Bearer ead79277080d02e9e15186409b0689ea2d61ad16876faa81625817b6fd7b8b41' -H 'Content-Type: application/json' -d '{"name":"nixbot","scopes":["api"],"expires_at":"2026-07-07"}' http://gitlab/api/v4/users/1/personal_access_tokens1567vm-test-run-nixbot-gitlab> gitlab # [ 194.268184] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:01.206Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"753050e6cb41dc32e6f3eebf","created_at":"2026-06-30T07:58:01.196Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"03bbf3623d2aa09af993a08039cd02b5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-06-30T07:58:01.203Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-753050e6cb41dc32e6f3eebf: start","job_status":"start","queue_duration_s":0.002839,"scheduling_latency_s":0.00288}1568vm-test-run-nixbot-gitlab> gitlab # [ 194.321776] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:01.231Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1569vm-test-run-nixbot-gitlab> gitlab # [ 194.332974] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:01.256Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"753050e6cb41dc32e6f3eebf","created_at":"2026-06-30T07:58:01.196Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"03bbf3623d2aa09af993a08039cd02b5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-06-30T07:58:01.203Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-753050e6cb41dc32e6f3eebf: done: 0.050059 sec","job_status":"done","queue_duration_s":0.002839,"scheduling_latency_s":0.00288,"redis_calls":7,"redis_duration_s":0.008759,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002786,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005973,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014391,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.050059,"completed_at":"2026-06-30T07:58:01.256Z","load_balancing_strategy":"primary","db_duration_s":0.002554,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1570vm-test-run-nixbot-gitlab> gitlab # [ 194.394890] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:01.257Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"5a1117bdf9c8acac9c534a7a","created_at":"2026-06-30T07:58:01.178Z","trace_propagation_headers":{"sentry-trace":"1e49b21144464ce9b5e93fc201cb2fa1-21242deae55e464f","baggage":"sentry-trace_id=1e49b21144464ce9b5e93fc201cb2fa1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRHYSZPVV54A5M7J8J2GGZ","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:9278bac34cea775dd37617311ce20fcfb1bcc16105f19768bca7d24b578973d3","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.223Z","job_size_bytes":451,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-5a1117bdf9c8acac9c534a7a: start","job_status":"start","queue_duration_s":0.033916,"scheduling_latency_s":0.033942}1571vm-test-run-nixbot-gitlab> gitlab # [ 194.421735] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:01 +0000] "POST /api/v4/users/1/personal_access_tokens HTTP/1.1" 201 267 "" "curl/8.20.0" 2371572vm-test-run-nixbot-gitlab> gitlab # [ 194.422510] setup-gitlab-start[2689]: + TOKEN=glpat-LkEfa6bgQK70lL3Pp8hpwm86MQp1OjEH.01.0w0zs84ho1573vm-test-run-nixbot-gitlab> gitlab # [ 194.423109] setup-gitlab-start[2689]: + test -n glpat-LkEfa6bgQK70lL3Pp8hpwm86MQp1OjEH.01.0w0zs84ho1574vm-test-run-nixbot-gitlab> gitlab # [ 194.423880] setup-gitlab-start[2689]: + test glpat-LkEfa6bgQK70lL3Pp8hpwm86MQp1OjEH.01.0w0zs84ho '!=' null1575vm-test-run-nixbot-gitlab> gitlab # [ 194.425053] setup-gitlab-start[2689]: + mkdir -p /var/lib/secrets1576vm-test-run-nixbot-gitlab> gitlab # [ 194.425871] setup-gitlab-start[2689]: + echo glpat-LkEfa6bgQK70lL3Pp8hpwm86MQp1OjEH.01.0w0zs84ho1577vm-test-run-nixbot-gitlab> gitlab # [ 194.427041] setup-gitlab-start[2689]: + chmod 644 /var/lib/secrets/gitlab-token1578vm-test-run-nixbot-gitlab> gitlab # [ 194.427864] setup-gitlab-start[2689]: + curl -fs -X POST -H 'PRIVATE-TOKEN: glpat-LkEfa6bgQK70lL3Pp8hpwm86MQp1OjEH.01.0w0zs84ho' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1579vm-test-run-nixbot-gitlab> gitlab # [ 194.510322] sidekiq-cluster[2131]: {"severity":"WARN","time":"2026-06-30T07:58:01.449Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"5a1117bdf9c8acac9c534a7a","created_at":"2026-06-30T07:58:01.178Z","trace_propagation_headers":{"sentry-trace":"1e49b21144464ce9b5e93fc201cb2fa1-21242deae55e464f","baggage":"sentry-trace_id=1e49b21144464ce9b5e93fc201cb2fa1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRHYSZPVV54A5M7J8J2GGZ","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:9278bac34cea775dd37617311ce20fcfb1bcc16105f19768bca7d24b578973d3","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.223Z","job_size_bytes":451,"pid":2131,"sidekiq_tid":"lyn7","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-5a1117bdf9c8acac9c534a7a: fail: 0.190481 sec","job_status":"fail","queue_duration_s":0.033916,"scheduling_latency_s":0.033942,"redis_calls":11,"redis_duration_s":0.0038090000000000003,"redis_read_bytes":137,"redis_write_bytes":1317,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.0009,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002256,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000653,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068871,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000881397,"duration_s":0.190481,"completed_at":"2026-06-30T07:58:01.448Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/profile.rb:99:in `access_token_created_email'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/abbaw4w9gll6p923md75p3h3rrmhrdqn-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/bqz31s23z0jk4464lbybyz83ikl0gmyd-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/wp2rnxa243q2gn2f8h04d48hnvfr0387-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/85h4805ad7n5qn7wq2m6icypga7rnk80-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.106036,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1580vm-test-run-nixbot-gitlab> gitlab # [ 195.086754] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:01.894Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"2dbe85d0a01be80ea8baa315","created_at":"2026-06-30T07:58:01.214Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"49d6d23f04101861a7523032f6e01b63","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.284Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-2dbe85d0a01be80ea8baa315: start","job_status":"start","queue_duration_s":0.609928,"scheduling_latency_s":0.609968}1581vm-test-run-nixbot-gitlab> gitlab # [ 195.088058] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:01.913Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1582vm-test-run-nixbot-gitlab> gitlab # [ 195.088864] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:01.924Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"2dbe85d0a01be80ea8baa315","created_at":"2026-06-30T07:58:01.214Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"49d6d23f04101861a7523032f6e01b63","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.284Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-2dbe85d0a01be80ea8baa315: done: 0.030378 sec","job_status":"done","queue_duration_s":0.609928,"scheduling_latency_s":0.609968,"redis_calls":7,"redis_duration_s":0.007875,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005218,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002657,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030378,"completed_at":"2026-06-30T07:58:01.924Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583vm-test-run-nixbot-gitlab> gitlab # [ 195.135239] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:01.927Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f68451bce41379a61776c4db","created_at":"2026-06-30T07:58:01.326Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b62b53d7d962c548ae3f317e0993c0f6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.328Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f68451bce41379a61776c4db: start","job_status":"start","queue_duration_s":0.599444,"scheduling_latency_s":0.599466}1584vm-test-run-nixbot-gitlab> gitlab # [ 195.208192] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:01.949Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1585vm-test-run-nixbot-gitlab> gitlab # [ 195.209709] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:01.966Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f68451bce41379a61776c4db","created_at":"2026-06-30T07:58:01.326Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b62b53d7d962c548ae3f317e0993c0f6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.328Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f68451bce41379a61776c4db: done: 0.038257 sec","job_status":"done","queue_duration_s":0.599444,"scheduling_latency_s":0.599466,"redis_calls":7,"redis_duration_s":0.0069889999999999996,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006449,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00054,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038257,"completed_at":"2026-06-30T07:58:01.966Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1586vm-test-run-nixbot-gitlab> gitlab # [ 195.226308] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:01.979Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"142cc9d6c5e21a73ce4851fa","created_at":"2026-06-30T07:58:01.346Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"de7104f30ea65810022ea9b39f890097","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.349Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-142cc9d6c5e21a73ce4851fa: start","job_status":"start","queue_duration_s":0.630606,"scheduling_latency_s":0.630632}1587vm-test-run-nixbot-gitlab> gitlab # [ 195.295446] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.019Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"142cc9d6c5e21a73ce4851fa","created_at":"2026-06-30T07:58:01.346Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"de7104f30ea65810022ea9b39f890097","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.349Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-142cc9d6c5e21a73ce4851fa: done: 0.040017 sec","job_status":"done","queue_duration_s":0.630606,"scheduling_latency_s":0.630632,"redis_calls":7,"redis_duration_s":0.005518,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003533,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001985,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010232,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.040017,"completed_at":"2026-06-30T07:58:02.019Z","load_balancing_strategy":"primary","db_duration_s":0.007951,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1588vm-test-run-nixbot-gitlab> gitlab # [ 195.365208] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.023Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"6a5101788df19d9f0ef706b1","created_at":"2026-06-30T07:58:01.353Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b55963498dc7f7862e509e2789950580","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.355Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-6a5101788df19d9f0ef706b1: start","job_status":"start","queue_duration_s":0.667874,"scheduling_latency_s":0.6679}1589vm-test-run-nixbot-gitlab> gitlab # [ 195.366859] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.040Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1590vm-test-run-nixbot-gitlab> gitlab # [ 195.368150] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.051Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"6a5101788df19d9f0ef706b1","created_at":"2026-06-30T07:58:01.353Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b55963498dc7f7862e509e2789950580","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.355Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-6a5101788df19d9f0ef706b1: done: 0.028699 sec","job_status":"done","queue_duration_s":0.667874,"scheduling_latency_s":0.6679,"redis_calls":7,"redis_duration_s":0.0079,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005432,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002468,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028699,"completed_at":"2026-06-30T07:58:02.051Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591vm-test-run-nixbot-gitlab> gitlab # [ 195.437057] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.054Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"b558cc54004726ad1ae83a24","created_at":"2026-06-30T07:58:01.406Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"216e87b7281e5ee2a59b7673e2331a17","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-06-30T07:58:01.420Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-b558cc54004726ad1ae83a24: start","job_status":"start","queue_duration_s":0.634007,"scheduling_latency_s":0.634031}1592vm-test-run-nixbot-gitlab> gitlab # [ 195.438347] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.069Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1593vm-test-run-nixbot-gitlab> gitlab # [ 195.439233] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.079Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"b558cc54004726ad1ae83a24","created_at":"2026-06-30T07:58:01.406Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"216e87b7281e5ee2a59b7673e2331a17","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-06-30T07:58:01.420Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-b558cc54004726ad1ae83a24: done: 0.025273 sec","job_status":"done","queue_duration_s":0.634007,"scheduling_latency_s":0.634031,"redis_calls":7,"redis_duration_s":0.006125,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003477,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002648,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008307,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025273,"completed_at":"2026-06-30T07:58:02.079Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1594vm-test-run-nixbot-gitlab> gitlab # [ 195.520911] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.081Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"5b7135560fe347774024d37e","created_at":"2026-06-30T07:58:01.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7ecce0d1e41ab01bee71ce05e882101a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.426Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-5b7135560fe347774024d37e: start","job_status":"start","queue_duration_s":0.654753,"scheduling_latency_s":0.654777}1595vm-test-run-nixbot-gitlab> gitlab # [ 195.522256] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.112Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1596vm-test-run-nixbot-gitlab> gitlab # [ 195.523132] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.124Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"5b7135560fe347774024d37e","created_at":"2026-06-30T07:58:01.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7ecce0d1e41ab01bee71ce05e882101a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.426Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-5b7135560fe347774024d37e: done: 0.042429 sec","job_status":"done","queue_duration_s":0.654753,"scheduling_latency_s":0.654777,"redis_calls":7,"redis_duration_s":0.021114,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003444,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.01767,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042429,"completed_at":"2026-06-30T07:58:02.124Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1597vm-test-run-nixbot-gitlab> gitlab # [ 195.638339] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.125Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"438306ac96a4190608d25f11","created_at":"2026-06-30T07:58:01.429Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c5639debff77d995e3a5f89312637b29","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-06-30T07:58:01.431Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-438306ac96a4190608d25f11: start","job_status":"start","queue_duration_s":0.694454,"scheduling_latency_s":0.694478}1598vm-test-run-nixbot-gitlab> gitlab # [ 195.639863] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.145Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"438306ac96a4190608d25f11","created_at":"2026-06-30T07:58:01.429Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c5639debff77d995e3a5f89312637b29","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-06-30T07:58:01.431Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-438306ac96a4190608d25f11: done: 0.020196 sec","job_status":"done","queue_duration_s":0.694454,"scheduling_latency_s":0.694478,"redis_calls":9,"redis_duration_s":0.0020020000000000003,"redis_read_bytes":7,"redis_write_bytes":1018,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000452,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":277,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001128,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000422,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020196,"completed_at":"2026-06-30T07:58:02.145Z","load_balancing_strategy":"primary","db_duration_s":0.001705,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1599vm-test-run-nixbot-gitlab> gitlab # [ 195.722480] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.146Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"aec37823e77fdd0c4ad37290","created_at":"2026-06-30T07:58:01.442Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2eb8f34edf68786acaa416d1e0e38093","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.446Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-aec37823e77fdd0c4ad37290: start","job_status":"start","queue_duration_s":0.700056,"scheduling_latency_s":0.700079}1600vm-test-run-nixbot-gitlab> gitlab # [ 195.723705] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.300Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"aec37823e77fdd0c4ad37290","created_at":"2026-06-30T07:58:01.442Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2eb8f34edf68786acaa416d1e0e38093","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.446Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-aec37823e77fdd0c4ad37290: done: 0.153717 sec","job_status":"done","queue_duration_s":0.700056,"scheduling_latency_s":0.700079,"redis_calls":11,"redis_duration_s":0.002537,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000413,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001136,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":124,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":124,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":124,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":80,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.117925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00043134,"exclusive_lock_hold_duration_s":0.137853833,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.153717,"completed_at":"2026-06-30T07:58:02.300Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.044506,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1601vm-test-run-nixbot-gitlab> gitlab # [ 195.761335] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.302Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"1eb7adacf5f5a3d2365bd60e","created_at":"2026-06-30T07:58:01.899Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"00a021688a848347dbbd09b2242eb9c6","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.909Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-1eb7adacf5f5a3d2365bd60e: start","job_status":"start","queue_duration_s":0.39295,"scheduling_latency_s":0.392972}1602vm-test-run-nixbot-gitlab> gitlab # [ 195.842642] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.319Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"1eb7adacf5f5a3d2365bd60e","created_at":"2026-06-30T07:58:01.899Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"00a021688a848347dbbd09b2242eb9c6","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.909Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-1eb7adacf5f5a3d2365bd60e: done: 0.016897 sec","job_status":"done","queue_duration_s":0.39295,"scheduling_latency_s":0.392972,"redis_calls":12,"redis_duration_s":0.0027140000000000003,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000475,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000491,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001332,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000416,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000373791,"duration_s":0.016897,"completed_at":"2026-06-30T07:58:02.319Z","load_balancing_strategy":"primary","db_duration_s":0.000427,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603vm-test-run-nixbot-gitlab> gitlab # [ 195.849198] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.320Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"486e8540dd4155051f3c6183","created_at":"2026-06-30T07:58:01.919Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0df1538f6bf0e8864317f489b72ccce1","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.924Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-486e8540dd4155051f3c6183: start","job_status":"start","queue_duration_s":0.3963,"scheduling_latency_s":0.396319}1604vm-test-run-nixbot-gitlab> gitlab # [ 195.872354] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.336Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"486e8540dd4155051f3c6183","created_at":"2026-06-30T07:58:01.919Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0df1538f6bf0e8864317f489b72ccce1","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.924Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-486e8540dd4155051f3c6183: done: 0.016143 sec","job_status":"done","queue_duration_s":0.3963,"scheduling_latency_s":0.396319,"redis_calls":10,"redis_duration_s":0.002216,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001305,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.003046198,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.016143,"completed_at":"2026-06-30T07:58:02.336Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001818,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1605vm-test-run-nixbot-gitlab> gitlab # [ 195.998410] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.338Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"e016405623a653e0e95098bb","created_at":"2026-06-30T07:58:01.944Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"deb05ff8fba172c049f34bc870d72422","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.945Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-e016405623a653e0e95098bb: start","job_status":"start","queue_duration_s":0.392411,"scheduling_latency_s":0.392431}1606vm-test-run-nixbot-gitlab> gitlab # [ 195.999922] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.351Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"e016405623a653e0e95098bb","created_at":"2026-06-30T07:58:01.944Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"deb05ff8fba172c049f34bc870d72422","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.945Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-e016405623a653e0e95098bb: done: 0.013986 sec","job_status":"done","queue_duration_s":0.392411,"scheduling_latency_s":0.392431,"redis_calls":9,"redis_duration_s":0.002074,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001119,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000470451,"exclusive_lock_hold_duration_s":0.00223073,"duration_s":0.013986,"completed_at":"2026-06-30T07:58:02.351Z","load_balancing_strategy":"primary","db_duration_s":0.001084,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1607vm-test-run-nixbot-gitlab> gitlab # [ 196.074881] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.353Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"4c140df24ac5583988e73bfd","created_at":"2026-06-30T07:58:01.950Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6103193a5c99faa6c6eb945a18051adf","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.954Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-4c140df24ac5583988e73bfd: start","job_status":"start","queue_duration_s":0.398311,"scheduling_latency_s":0.398331}1608vm-test-run-nixbot-gitlab> gitlab # [ 196.075880] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.373Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"4c140df24ac5583988e73bfd","created_at":"2026-06-30T07:58:01.950Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6103193a5c99faa6c6eb945a18051adf","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.954Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-4c140df24ac5583988e73bfd: done: 0.019979 sec","job_status":"done","queue_duration_s":0.398311,"scheduling_latency_s":0.398331,"redis_calls":7,"redis_duration_s":0.001595,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001127,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000468,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019979,"completed_at":"2026-06-30T07:58:02.373Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006697,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1609vm-test-run-nixbot-gitlab> gitlab # [ 196.153396] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.374Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"87664e3ae8e83f9ac5667bab","created_at":"2026-06-30T07:58:01.961Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"92184887b4e23241d7ee46c77a73ffa7","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.969Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-87664e3ae8e83f9ac5667bab: start","job_status":"start","queue_duration_s":0.405233,"scheduling_latency_s":0.405254}1610vm-test-run-nixbot-gitlab> gitlab # [ 196.154713] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.412Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"87664e3ae8e83f9ac5667bab","created_at":"2026-06-30T07:58:01.961Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"92184887b4e23241d7ee46c77a73ffa7","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.969Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-87664e3ae8e83f9ac5667bab: done: 0.038325 sec","job_status":"done","queue_duration_s":0.405233,"scheduling_latency_s":0.405254,"redis_calls":12,"redis_duration_s":0.004743,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000709,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002167,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001867,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025786,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001080025,"exclusive_lock_hold_duration_s":0.006155252,"duration_s":0.038325,"completed_at":"2026-06-30T07:58:02.412Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00284,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1611vm-test-run-nixbot-gitlab> gitlab # [ 196.200953] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.415Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4b32a1696c09964f6ba8fc7f","created_at":"2026-06-30T07:58:01.980Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.983Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4b32a1696c09964f6ba8fc7f: start","job_status":"start","queue_duration_s":0.431847,"scheduling_latency_s":0.431903}1612vm-test-run-nixbot-gitlab> gitlab # [ 196.278144] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.492Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4b32a1696c09964f6ba8fc7f","created_at":"2026-06-30T07:58:01.980Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.983Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4b32a1696c09964f6ba8fc7f: done: 0.077155 sec","job_status":"done","queue_duration_s":0.431847,"scheduling_latency_s":0.431903,"redis_calls":60,"redis_duration_s":0.013411999999999999,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000606,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.012162,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000644,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.077155,"completed_at":"2026-06-30T07:58:02.492Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1613vm-test-run-nixbot-gitlab> gitlab # [ 196.286982] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.493Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"4eda2ec4f0e8893b6e14b2ec","created_at":"2026-06-30T07:58:01.988Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"689455c37f722ae178a3051c10ea2dfa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.995Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-4eda2ec4f0e8893b6e14b2ec: start","job_status":"start","queue_duration_s":0.498299,"scheduling_latency_s":0.498326}1614vm-test-run-nixbot-gitlab> gitlab # [ 196.369564] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.513Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"4eda2ec4f0e8893b6e14b2ec","created_at":"2026-06-30T07:58:01.988Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"689455c37f722ae178a3051c10ea2dfa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:01.995Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-4eda2ec4f0e8893b6e14b2ec: done: 0.019982 sec","job_status":"done","queue_duration_s":0.498299,"scheduling_latency_s":0.498326,"redis_calls":14,"redis_duration_s":0.002864,"redis_read_bytes":16,"redis_write_bytes":4026,"redis_queues_calls":2,"redis_queues_duration_s":0.000274,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001913,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000677,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019982,"completed_at":"2026-06-30T07:58:02.513Z","load_balancing_strategy":"primary","db_duration_s":0.000979,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1615vm-test-run-nixbot-gitlab> gitlab # [ 196.373126] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.514Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"47c03e67f82186bbf4c77f26","created_at":"2026-06-30T07:58:02.006Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e3220291fa66f8ff671f140ff037ced","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.009Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-47c03e67f82186bbf4c77f26: start","job_status":"start","queue_duration_s":0.505316,"scheduling_latency_s":0.505336}1616vm-test-run-nixbot-gitlab> gitlab # [ 196.442459] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.526Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"47c03e67f82186bbf4c77f26","created_at":"2026-06-30T07:58:02.006Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e3220291fa66f8ff671f140ff037ced","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.009Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-47c03e67f82186bbf4c77f26: done: 0.011852 sec","job_status":"done","queue_duration_s":0.505316,"scheduling_latency_s":0.505336,"redis_calls":7,"redis_duration_s":0.001572,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001129,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000443,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011852,"completed_at":"2026-06-30T07:58:02.526Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617vm-test-run-nixbot-gitlab> gitlab # [ 196.520117] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.527Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"05b9a2f63525bb9aba227e75","created_at":"2026-06-30T07:58:02.018Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"32624328701140a19ef10f7bc84bc50b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.020Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-05b9a2f63525bb9aba227e75: start","job_status":"start","queue_duration_s":0.507014,"scheduling_latency_s":0.507034}1618vm-test-run-nixbot-gitlab> gitlab # [ 196.521180] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.539Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"05b9a2f63525bb9aba227e75","created_at":"2026-06-30T07:58:02.018Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"32624328701140a19ef10f7bc84bc50b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.020Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-05b9a2f63525bb9aba227e75: done: 0.011683 sec","job_status":"done","queue_duration_s":0.507014,"scheduling_latency_s":0.507034,"redis_calls":7,"redis_duration_s":0.001597,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001138,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000459,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007638,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011683,"completed_at":"2026-06-30T07:58:02.539Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1619vm-test-run-nixbot-gitlab> gitlab # [ 196.547805] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.540Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"5df1c312c804d7084d14f897","created_at":"2026-06-30T07:58:02.027Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"95cfaef349cb3674451e14581369340d","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.036Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-5df1c312c804d7084d14f897: start","job_status":"start","queue_duration_s":0.504561,"scheduling_latency_s":0.504581}1620vm-test-run-nixbot-gitlab> gitlab # [ 196.571241] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.563Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"5df1c312c804d7084d14f897","created_at":"2026-06-30T07:58:02.027Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"95cfaef349cb3674451e14581369340d","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.036Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-5df1c312c804d7084d14f897: done: 0.022776 sec","job_status":"done","queue_duration_s":0.504561,"scheduling_latency_s":0.504581,"redis_calls":10,"redis_duration_s":0.002336,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000434,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001452,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00045,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000419607,"duration_s":0.022776,"completed_at":"2026-06-30T07:58:02.563Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002532,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621vm-test-run-nixbot-gitlab> gitlab # [ 196.643349] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.565Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"fbf7fccd20264897fd19add0","created_at":"2026-06-30T07:58:02.046Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e92af7be21bb265680aab519df8fb269","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.049Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-fbf7fccd20264897fd19add0: start","job_status":"start","queue_duration_s":0.515195,"scheduling_latency_s":0.515217}1622vm-test-run-nixbot-gitlab> gitlab # [ 196.662933] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.578Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"fbf7fccd20264897fd19add0","created_at":"2026-06-30T07:58:02.046Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e92af7be21bb265680aab519df8fb269","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.049Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-fbf7fccd20264897fd19add0: done: 0.012985 sec","job_status":"done","queue_duration_s":0.515195,"scheduling_latency_s":0.515217,"redis_calls":7,"redis_duration_s":0.00147,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001065,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000405,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012985,"completed_at":"2026-06-30T07:58:02.578Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000657,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623vm-test-run-nixbot-gitlab> gitlab # [ 196.737447] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.579Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"07659265bf23e6e0f1b2c135","created_at":"2026-06-30T07:58:02.057Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dec3799419a229e1ec7086a790d564ed","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.059Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-07659265bf23e6e0f1b2c135: start","job_status":"start","queue_duration_s":0.520466,"scheduling_latency_s":0.520487}1624vm-test-run-nixbot-gitlab> gitlab # [ 196.752208] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.616Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"07659265bf23e6e0f1b2c135","created_at":"2026-06-30T07:58:02.057Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dec3799419a229e1ec7086a790d564ed","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.059Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-07659265bf23e6e0f1b2c135: done: 0.037205 sec","job_status":"done","queue_duration_s":0.520466,"scheduling_latency_s":0.520487,"redis_calls":9,"redis_duration_s":0.002192,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001101,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000442514,"exclusive_lock_hold_duration_s":0.023857222,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.037205,"completed_at":"2026-06-30T07:58:02.616Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018866,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1625vm-test-run-nixbot-gitlab> gitlab # [ 196.845198] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:02.618Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"8794f26fd9b77aeb061d08ce","created_at":"2026-06-30T07:58:02.070Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aee436b50f2f9663de0917c7deb958a7","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.073Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-8794f26fd9b77aeb061d08ce: start","job_status":"start","queue_duration_s":0.544843,"scheduling_latency_s":0.544865}1626vm-test-run-nixbot-gitlab> gitlab # [ 196.846761] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.017Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"8794f26fd9b77aeb061d08ce","created_at":"2026-06-30T07:58:02.070Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aee436b50f2f9663de0917c7deb958a7","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.073Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-8794f26fd9b77aeb061d08ce: done: 0.399359 sec","job_status":"done","queue_duration_s":0.544843,"scheduling_latency_s":0.544865,"redis_calls":571,"redis_duration_s":0.127226,"redis_read_bytes":569,"redis_write_bytes":49487,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001137,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.126089,"redis_shared_state_read_bytes":565,"redis_shared_state_write_bytes":49017,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.317678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.399359,"completed_at":"2026-06-30T07:58:03.017Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1627vm-test-run-nixbot-gitlab> gitlab # [ 196.919969] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.019Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"8a91146354ee578487b6dc32","created_at":"2026-06-30T07:58:02.081Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ae462454a9422def4fc2f379240741cd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.083Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-8a91146354ee578487b6dc32: start","job_status":"start","queue_duration_s":0.93565,"scheduling_latency_s":0.935679}1628vm-test-run-nixbot-gitlab> gitlab # [ 196.929388] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.043Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"8a91146354ee578487b6dc32","created_at":"2026-06-30T07:58:02.081Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ae462454a9422def4fc2f379240741cd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.083Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-8a91146354ee578487b6dc32: done: 0.024564 sec","job_status":"done","queue_duration_s":0.93565,"scheduling_latency_s":0.935679,"redis_calls":9,"redis_duration_s":0.0021799999999999996,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001133,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001047,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000525765,"exclusive_lock_hold_duration_s":0.007403176,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.024564,"completed_at":"2026-06-30T07:58:03.043Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006765,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1629vm-test-run-nixbot-gitlab> gitlab # [ 197.000058] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.045Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"0580357f5f9d402730cc043b","created_at":"2026-06-30T07:58:02.107Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"894911134dcc9a23de4ed6f9fc976e09","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.111Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-0580357f5f9d402730cc043b: start","job_status":"start","queue_duration_s":0.934088,"scheduling_latency_s":0.934108}1630vm-test-run-nixbot-gitlab> gitlab # [ 197.070256] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.058Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"0580357f5f9d402730cc043b","created_at":"2026-06-30T07:58:02.107Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-99986bb3d8c6410f","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"894911134dcc9a23de4ed6f9fc976e09","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.111Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-0580357f5f9d402730cc043b: done: 0.013018 sec","job_status":"done","queue_duration_s":0.934088,"scheduling_latency_s":0.934108,"redis_calls":9,"redis_duration_s":0.002021,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001086,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000426591,"exclusive_lock_hold_duration_s":0.00152226,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.013018,"completed_at":"2026-06-30T07:58:03.058Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000732,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1631vm-test-run-nixbot-gitlab> gitlab # [ 197.086795] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1875db3feafc4e6ee37ffadb","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1875db3feafc4e6ee37ffadb: start","job_status":"start","queue_duration_s":0.573521,"scheduling_latency_s":0.573541}1632vm-test-run-nixbot-gitlab> gitlab # [ 197.168523] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.074Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1875db3feafc4e6ee37ffadb","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1875db3feafc4e6ee37ffadb: done: 0.014561 sec","job_status":"done","queue_duration_s":0.573521,"scheduling_latency_s":0.573541,"redis_calls":13,"redis_duration_s":0.002809,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000876,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009741,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014561,"completed_at":"2026-06-30T07:58:03.074Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1633vm-test-run-nixbot-gitlab> gitlab # [ 197.170861] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0979556da2acfcf835792179","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0979556da2acfcf835792179: start","job_status":"start","queue_duration_s":0.589328,"scheduling_latency_s":0.589349}1634vm-test-run-nixbot-gitlab> gitlab # [ 197.188550] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0979556da2acfcf835792179","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0979556da2acfcf835792179: done: 0.01465 sec","job_status":"done","queue_duration_s":0.589328,"scheduling_latency_s":0.589349,"redis_calls":13,"redis_duration_s":0.0030069999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00209,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01465,"completed_at":"2026-06-30T07:58:03.089Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1635vm-test-run-nixbot-gitlab> gitlab # [ 197.276212] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c688a6f32aefa1fd661c21c","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c688a6f32aefa1fd661c21c: start","job_status":"start","queue_duration_s":0.605233,"scheduling_latency_s":0.605255}1636vm-test-run-nixbot-gitlab> gitlab # [ 197.277359] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c688a6f32aefa1fd661c21c","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c688a6f32aefa1fd661c21c: done: 0.014318 sec","job_status":"done","queue_duration_s":0.605233,"scheduling_latency_s":0.605255,"redis_calls":13,"redis_duration_s":0.002764,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00086,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014318,"completed_at":"2026-06-30T07:58:03.105Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1637vm-test-run-nixbot-gitlab> gitlab # [ 197.366272] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"494edc70abb60f855108ba18","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-494edc70abb60f855108ba18: start","job_status":"start","queue_duration_s":0.620973,"scheduling_latency_s":0.620993}1638vm-test-run-nixbot-gitlab> gitlab # [ 197.368385] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"494edc70abb60f855108ba18","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-494edc70abb60f855108ba18: done: 0.014546 sec","job_status":"done","queue_duration_s":0.620973,"scheduling_latency_s":0.620993,"redis_calls":13,"redis_duration_s":0.002797,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000879,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014546,"completed_at":"2026-06-30T07:58:03.121Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1639vm-test-run-nixbot-gitlab> gitlab # [ 197.443295] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc1033157279b033a744e8dd","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc1033157279b033a744e8dd: start","job_status":"start","queue_duration_s":0.63677,"scheduling_latency_s":0.63679}1640vm-test-run-nixbot-gitlab> gitlab # [ 197.444793] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.137Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc1033157279b033a744e8dd","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc1033157279b033a744e8dd: done: 0.014545 sec","job_status":"done","queue_duration_s":0.63677,"scheduling_latency_s":0.63679,"redis_calls":13,"redis_duration_s":0.002754,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000838,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014545,"completed_at":"2026-06-30T07:58:03.137Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1641vm-test-run-nixbot-gitlab> gitlab # [ 197.525784] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a7b0600d2c517ab454c86b0","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a7b0600d2c517ab454c86b0: start","job_status":"start","queue_duration_s":0.652682,"scheduling_latency_s":0.652703}1642vm-test-run-nixbot-gitlab> gitlab # [ 197.527357] gitaly[1385]: time="2026-06-30T07:58:03.443Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRHZ3X5G6NZ1H3H8HP355W error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-30T07:58:13.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:03.443" pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1643vm-test-run-nixbot-gitlab> gitlab # [ 197.530153] gitaly[1385]: time="2026-06-30T07:58:03.443Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRHZ3X5G6NZ1H3H8HP355W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-30T07:58:13.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:03.443" grpc.time_ms=0.303 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1644vm-test-run-nixbot-gitlab> gitlab # [ 197.601512] setup-gitlab-start[2689]: + mkdir -p /tmp/test-flake1645vm-test-run-nixbot-gitlab> gitlab # [ 197.602671] setup-gitlab-start[2689]: + cd /tmp/test-flake1646vm-test-run-nixbot-gitlab> gitlab # [ 197.603875] setup-gitlab-start[2689]: + git init -b master1647vm-test-run-nixbot-gitlab> gitlab # [ 197.605126] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a7b0600d2c517ab454c86b0","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a7b0600d2c517ab454c86b0: done: 0.014501 sec","job_status":"done","queue_duration_s":0.652682,"scheduling_latency_s":0.652703,"redis_calls":13,"redis_duration_s":0.002757,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000841,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014501,"completed_at":"2026-06-30T07:58:03.153Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1648vm-test-run-nixbot-gitlab> gitlab # [ 197.615683] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12fa5fc153cbf01c114aa8eb","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12fa5fc153cbf01c114aa8eb: start","job_status":"start","queue_duration_s":0.668421,"scheduling_latency_s":0.668443}1649vm-test-run-nixbot-gitlab> gitlab # [ 197.689042] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12fa5fc153cbf01c114aa8eb","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12fa5fc153cbf01c114aa8eb: done: 0.014421 sec","job_status":"done","queue_duration_s":0.668421,"scheduling_latency_s":0.668443,"redis_calls":13,"redis_duration_s":0.002892,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000869,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009724,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014421,"completed_at":"2026-06-30T07:58:03.168Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1650vm-test-run-nixbot-gitlab> gitlab # [ 197.758814] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"758f816bf73a139685f9d3ad","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-758f816bf73a139685f9d3ad: start","job_status":"start","queue_duration_s":0.684129,"scheduling_latency_s":0.68415}1651vm-test-run-nixbot-gitlab> gitlab # [ 197.760183] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"758f816bf73a139685f9d3ad","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-758f816bf73a139685f9d3ad: done: 0.015332 sec","job_status":"done","queue_duration_s":0.684129,"scheduling_latency_s":0.68415,"redis_calls":13,"redis_duration_s":0.002948,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001025,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015332,"completed_at":"2026-06-30T07:58:03.185Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1652vm-test-run-nixbot-gitlab> gitlab # [ 197.838324] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9eec5d83fc542618e110290a","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9eec5d83fc542618e110290a: start","job_status":"start","queue_duration_s":0.70073,"scheduling_latency_s":0.700751}1653vm-test-run-nixbot-gitlab> gitlab # [ 197.839874] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9eec5d83fc542618e110290a","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9eec5d83fc542618e110290a: done: 0.021254 sec","job_status":"done","queue_duration_s":0.70073,"scheduling_latency_s":0.700751,"redis_calls":13,"redis_duration_s":0.002875,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021254,"completed_at":"2026-06-30T07:58:03.207Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1654vm-test-run-nixbot-gitlab> gitlab # [ 197.909985] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c77ce475ad0ed2c23621419c","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c77ce475ad0ed2c23621419c: start","job_status":"start","queue_duration_s":0.723236,"scheduling_latency_s":0.723257}1655vm-test-run-nixbot-gitlab> gitlab # [ 197.911377] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c77ce475ad0ed2c23621419c","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c77ce475ad0ed2c23621419c: done: 0.014501 sec","job_status":"done","queue_duration_s":0.723236,"scheduling_latency_s":0.723257,"redis_calls":13,"redis_duration_s":0.002762,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001863,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014501,"completed_at":"2026-06-30T07:58:03.223Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1656vm-test-run-nixbot-gitlab> gitlab # [ 197.982253] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b943c252fa8161099bb7c36","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b943c252fa8161099bb7c36: start","job_status":"start","queue_duration_s":0.738984,"scheduling_latency_s":0.739006}1657vm-test-run-nixbot-gitlab> gitlab # [ 197.983321] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.239Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b943c252fa8161099bb7c36","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b943c252fa8161099bb7c36: done: 0.01432 sec","job_status":"done","queue_duration_s":0.738984,"scheduling_latency_s":0.739006,"redis_calls":13,"redis_duration_s":0.002682,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000836,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001846,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01432,"completed_at":"2026-06-30T07:58:03.239Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1658vm-test-run-nixbot-gitlab> gitlab # [ 198.059063] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"857409782f575c2926f4f4bb","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-857409782f575c2926f4f4bb: start","job_status":"start","queue_duration_s":0.754524,"scheduling_latency_s":0.754546}1659vm-test-run-nixbot-gitlab> gitlab # [ 198.060162] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.254Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"857409782f575c2926f4f4bb","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-857409782f575c2926f4f4bb: done: 0.014423 sec","job_status":"done","queue_duration_s":0.754524,"scheduling_latency_s":0.754546,"redis_calls":13,"redis_duration_s":0.00279,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00087,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00192,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009696,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014423,"completed_at":"2026-06-30T07:58:03.254Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1660vm-test-run-nixbot-gitlab> gitlab # [ 198.145334] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.256Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f087aa348066c577e7fa76cd","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f087aa348066c577e7fa76cd: start","job_status":"start","queue_duration_s":0.77019,"scheduling_latency_s":0.770211}1661vm-test-run-nixbot-gitlab> gitlab # [ 198.146407] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f087aa348066c577e7fa76cd","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f087aa348066c577e7fa76cd: done: 0.016911 sec","job_status":"done","queue_duration_s":0.77019,"scheduling_latency_s":0.770211,"redis_calls":13,"redis_duration_s":0.003158,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000873,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002285,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011628,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016911,"completed_at":"2026-06-30T07:58:03.273Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1662vm-test-run-nixbot-gitlab> gitlab # [ 198.231206] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1857a9b4d8adcce43243289","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1857a9b4d8adcce43243289: start","job_status":"start","queue_duration_s":0.78856,"scheduling_latency_s":0.788589}1663vm-test-run-nixbot-gitlab> gitlab # [ 198.233129] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1857a9b4d8adcce43243289","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1857a9b4d8adcce43243289: done: 0.015272 sec","job_status":"done","queue_duration_s":0.78856,"scheduling_latency_s":0.788589,"redis_calls":13,"redis_duration_s":0.0028539999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000864,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00199,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015272,"completed_at":"2026-06-30T07:58:03.289Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1664vm-test-run-nixbot-gitlab> gitlab # [ 198.325051] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.291Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7df3660f995266850602bb8e","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7df3660f995266850602bb8e: start","job_status":"start","queue_duration_s":0.80507,"scheduling_latency_s":0.805091}1665vm-test-run-nixbot-gitlab> gitlab # [ 198.326167] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7df3660f995266850602bb8e","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7df3660f995266850602bb8e: done: 0.014402 sec","job_status":"done","queue_duration_s":0.80507,"scheduling_latency_s":0.805091,"redis_calls":13,"redis_duration_s":0.002782,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014402,"completed_at":"2026-06-30T07:58:03.305Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1666vm-test-run-nixbot-gitlab> gitlab # [ 198.354872] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a44eeba9efdfb6088e042335","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a44eeba9efdfb6088e042335: start","job_status":"start","queue_duration_s":0.820697,"scheduling_latency_s":0.820718}1667vm-test-run-nixbot-gitlab> gitlab # [ 198.425826] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:04 +0000] "POST /api/v4/projects HTTP/1.1" 201 4795 "" "curl/8.20.0" 30811668vm-test-run-nixbot-gitlab> gitlab # [ 198.427207] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:04 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 701669vm-test-run-nixbot-gitlab> gitlab # [ 198.427798] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:04 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.54.0" 941670vm-test-run-nixbot-gitlab> gitlab # [ 198.428985] gitlab-workhorse[1290]: time="2026-06-30T07:58:05Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521671vm-test-run-nixbot-gitlab> gitlab # [ 198.430220] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:05 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 5801672vm-test-run-nixbot-gitlab> gitlab # [ 198.431122] gitaly[1385]: time="2026-06-30T07:58:03.527Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRHZ3X5G6NZ1H3H8HP355W error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-30T07:58:13.086" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:03.527" pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1673vm-test-run-nixbot-gitlab> gitlab # [ 198.431901] gitaly[1385]: time="2026-06-30T07:58:03.527Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRHZ3X5G6NZ1H3H8HP355W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-30T07:58:13.086" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:03.527" grpc.time_ms=0.319 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1674vm-test-run-nixbot-gitlab> gitlab # [ 198.433251] setup-gitlab-start[2999]: Initialized empty Git repository in /tmp/test-flake/.git/1675vm-test-run-nixbot-gitlab> gitlab # [ 198.434544] systemd[1]: Finished setup-gitlab.service.1676vm-test-run-nixbot-gitlab> gitlab # [ 198.435587] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a44eeba9efdfb6088e042335","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a44eeba9efdfb6088e042335: done: 0.018068 sec","job_status":"done","queue_duration_s":0.820697,"scheduling_latency_s":0.820718,"redis_calls":13,"redis_duration_s":0.003628,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002676,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018068,"completed_at":"2026-06-30T07:58:03.324Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1677vm-test-run-nixbot-gitlab> gitlab # [ 198.490136] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ddd326f2f79ccff4b60fe66","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ddd326f2f79ccff4b60fe66: start","job_status":"start","queue_duration_s":0.840296,"scheduling_latency_s":0.840324}1678vm-test-run-nixbot-gitlab> gitlab # [ 198.509915] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ddd326f2f79ccff4b60fe66","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ddd326f2f79ccff4b60fe66: done: 0.016014 sec","job_status":"done","queue_duration_s":0.840296,"scheduling_latency_s":0.840324,"redis_calls":13,"redis_duration_s":0.002953,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000946,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010638,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016014,"completed_at":"2026-06-30T07:58:03.342Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1679vm-test-run-nixbot-gitlab> gitlab # [ 198.591223] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.343Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39e4b26dfcf96ce62a20cea4","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39e4b26dfcf96ce62a20cea4: start","job_status":"start","queue_duration_s":0.857627,"scheduling_latency_s":0.857651}1680vm-test-run-nixbot-gitlab> gitlab # [ 198.591934] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39e4b26dfcf96ce62a20cea4","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39e4b26dfcf96ce62a20cea4: done: 0.014829 sec","job_status":"done","queue_duration_s":0.857627,"scheduling_latency_s":0.857651,"redis_calls":13,"redis_duration_s":0.002768,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009912,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014829,"completed_at":"2026-06-30T07:58:03.358Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1681vm-test-run-nixbot-gitlab> gitlab # [ 198.702422] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.359Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d89f04c6a7511216961178a4","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d89f04c6a7511216961178a4: start","job_status":"start","queue_duration_s":0.873689,"scheduling_latency_s":0.873709}1682vm-test-run-nixbot-gitlab> gitlab # [ 198.703933] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d89f04c6a7511216961178a4","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d89f04c6a7511216961178a4: done: 0.014533 sec","job_status":"done","queue_duration_s":0.873689,"scheduling_latency_s":0.873709,"redis_calls":13,"redis_duration_s":0.0027660000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000843,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014533,"completed_at":"2026-06-30T07:58:03.374Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1683vm-test-run-nixbot-gitlab> gitlab # [ 198.735227] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5061e8c08adcfa6c65262380","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5061e8c08adcfa6c65262380: start","job_status":"start","queue_duration_s":0.889461,"scheduling_latency_s":0.889481}1684vm-test-run-nixbot-gitlab> gitlab # [ 198.755230] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.390Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5061e8c08adcfa6c65262380","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5061e8c08adcfa6c65262380: done: 0.015295 sec","job_status":"done","queue_duration_s":0.889461,"scheduling_latency_s":0.889481,"redis_calls":13,"redis_duration_s":0.003392,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002452,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015295,"completed_at":"2026-06-30T07:58:03.390Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1685vm-test-run-nixbot-gitlab> gitlab # [ 198.824931] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.392Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9e92583db64cfd27ffbfd0d","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9e92583db64cfd27ffbfd0d: start","job_status":"start","queue_duration_s":0.906168,"scheduling_latency_s":0.906189}1686vm-test-run-nixbot-gitlab> gitlab # [ 198.837203] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9e92583db64cfd27ffbfd0d","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9e92583db64cfd27ffbfd0d: done: 0.016286 sec","job_status":"done","queue_duration_s":0.906168,"scheduling_latency_s":0.906189,"redis_calls":13,"redis_duration_s":0.003177,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00111,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002067,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016286,"completed_at":"2026-06-30T07:58:03.408Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1687vm-test-run-nixbot-gitlab> gitlab # [ 198.906931] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"384192dd584d7a7791d663cc","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-384192dd584d7a7791d663cc: start","job_status":"start","queue_duration_s":0.923717,"scheduling_latency_s":0.923739}1688vm-test-run-nixbot-gitlab> gitlab # [ 198.917752] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"384192dd584d7a7791d663cc","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-384192dd584d7a7791d663cc: done: 0.015222 sec","job_status":"done","queue_duration_s":0.923717,"scheduling_latency_s":0.923739,"redis_calls":13,"redis_duration_s":0.002996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015222,"completed_at":"2026-06-30T07:58:03.424Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1689vm-test-run-nixbot-gitlab> gitlab # [ 199.046045] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb6228c7ea06f3fafb936af6","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb6228c7ea06f3fafb936af6: start","job_status":"start","queue_duration_s":0.94024,"scheduling_latency_s":0.940262}1690vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for unit setup-gitlab.service, in 200.07 seconds)1691vm-test-run-nixbot-gitlab> gitlab: waiting for unit nixbot.service1692vm-test-run-nixbot-gitlab> gitlab # [ 199.048191] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb6228c7ea06f3fafb936af6","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb6228c7ea06f3fafb936af6: done: 0.0153 sec","job_status":"done","queue_duration_s":0.94024,"scheduling_latency_s":0.940262,"redis_calls":13,"redis_duration_s":0.00321,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000874,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002336,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0153,"completed_at":"2026-06-30T07:58:03.441Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1693vm-test-run-nixbot-gitlab> gitlab # [ 199.060994] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7c25b74f08f4851f87308a3","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7c25b74f08f4851f87308a3: start","job_status":"start","queue_duration_s":0.957033,"scheduling_latency_s":0.957073}1694vm-test-run-nixbot-gitlab> gitlab # [ 199.080978] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7c25b74f08f4851f87308a3","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7c25b74f08f4851f87308a3: done: 0.016641 sec","job_status":"done","queue_duration_s":0.957033,"scheduling_latency_s":0.957073,"redis_calls":13,"redis_duration_s":0.002838,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000846,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016641,"completed_at":"2026-06-30T07:58:03.459Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1695vm-test-run-nixbot-gitlab> gitlab # [ 199.184192] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04b1c4741e79b9dc39fa576f","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04b1c4741e79b9dc39fa576f: start","job_status":"start","queue_duration_s":0.975094,"scheduling_latency_s":0.975115}1696vm-test-run-nixbot-gitlab> gitlab # [ 199.185648] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04b1c4741e79b9dc39fa576f","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04b1c4741e79b9dc39fa576f: done: 0.014968 sec","job_status":"done","queue_duration_s":0.975094,"scheduling_latency_s":0.975115,"redis_calls":13,"redis_duration_s":0.003048,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000947,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014968,"completed_at":"2026-06-30T07:58:03.476Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1697vm-test-run-nixbot-gitlab> gitlab # [ 199.222463] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.477Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"195e4535909f375190d43b86","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-195e4535909f375190d43b86: start","job_status":"start","queue_duration_s":0.991412,"scheduling_latency_s":0.991433}1698vm-test-run-nixbot-gitlab> gitlab # [ 199.242544] gitaly[1385]: time="2026-06-30T07:58:03.561Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRHZ3X5G6NZ1H3H8HP355W diskcache=f8f36a3c-6943-45b6-b079-b67572bc0e5c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-06-30T07:58:13.092" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:03.532" pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1699vm-test-run-nixbot-gitlab> gitlab # [ 199.320208] setup-gitlab-start[2689]: + git config user.name test1700vm-test-run-nixbot-gitlab> gitlab # [ 199.321297] setup-gitlab-start[2689]: + git config user.email test@example.com1701vm-test-run-nixbot-gitlab> gitlab # [ 199.322173] setup-gitlab-start[2689]: + cat1702vm-test-run-nixbot-gitlab> gitlab # [ 199.322966] setup-gitlab-start[2689]: + git add flake.nix1703vm-test-run-nixbot-gitlab> gitlab # [ 199.324161] setup-gitlab-start[2689]: + git commit -m 'initial commit'1704vm-test-run-nixbot-gitlab> gitlab # [ 199.325064] systemd[1]: Starting nixbot CI service...1705vm-test-run-nixbot-gitlab> gitlab # [ 199.325983] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"195e4535909f375190d43b86","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-195e4535909f375190d43b86: done: 0.0153 sec","job_status":"done","queue_duration_s":0.991412,"scheduling_latency_s":0.991433,"redis_calls":13,"redis_duration_s":0.003384,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000967,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002417,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0153,"completed_at":"2026-06-30T07:58:03.492Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1706vm-test-run-nixbot-gitlab> gitlab # [ 199.327912] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5eda0d92981296d6777e79a","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5eda0d92981296d6777e79a: start","job_status":"start","queue_duration_s":1.0081,"scheduling_latency_s":1.008122}1707vm-test-run-nixbot-gitlab> gitlab # [ 199.347074] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.509Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5eda0d92981296d6777e79a","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5eda0d92981296d6777e79a: done: 0.01504 sec","job_status":"done","queue_duration_s":1.0081,"scheduling_latency_s":1.008122,"redis_calls":13,"redis_duration_s":0.003258,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002324,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009402,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01504,"completed_at":"2026-06-30T07:58:03.509Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1708vm-test-run-nixbot-gitlab> gitlab # [ 199.440365] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6eb4ce9ecd9c869d7490023d","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6eb4ce9ecd9c869d7490023d: start","job_status":"start","queue_duration_s":1.024522,"scheduling_latency_s":1.024544}1709vm-test-run-nixbot-gitlab> gitlab # [ 199.441862] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6eb4ce9ecd9c869d7490023d","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6eb4ce9ecd9c869d7490023d: done: 0.014911 sec","job_status":"done","queue_duration_s":1.024522,"scheduling_latency_s":1.024544,"redis_calls":13,"redis_duration_s":0.003014,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002086,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014911,"completed_at":"2026-06-30T07:58:03.525Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1710vm-test-run-nixbot-gitlab> gitlab # [ 199.525449] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81f00e4caa570c33348ef064","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81f00e4caa570c33348ef064: start","job_status":"start","queue_duration_s":1.040704,"scheduling_latency_s":1.040724}1711vm-test-run-nixbot-gitlab> gitlab # [ 199.526149] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81f00e4caa570c33348ef064","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81f00e4caa570c33348ef064: done: 0.018218 sec","job_status":"done","queue_duration_s":1.040704,"scheduling_latency_s":1.040724,"redis_calls":13,"redis_duration_s":0.003979,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001447,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002532,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018218,"completed_at":"2026-06-30T07:58:03.544Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1712vm-test-run-nixbot-gitlab> gitlab # [ 199.598156] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dce7e8f29aec349edea9b501","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dce7e8f29aec349edea9b501: start","job_status":"start","queue_duration_s":1.060404,"scheduling_latency_s":1.060431}1713vm-test-run-nixbot-gitlab> gitlab # [ 199.599712] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.563Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dce7e8f29aec349edea9b501","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dce7e8f29aec349edea9b501: done: 0.016909 sec","job_status":"done","queue_duration_s":1.060404,"scheduling_latency_s":1.060431,"redis_calls":13,"redis_duration_s":0.003299,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001101,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002198,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016909,"completed_at":"2026-06-30T07:58:03.563Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1714vm-test-run-nixbot-gitlab> gitlab # [ 199.652447] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab3d080df2fa5affd9d5ff07","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab3d080df2fa5affd9d5ff07: start","job_status":"start","queue_duration_s":1.07876,"scheduling_latency_s":1.078783}1715vm-test-run-nixbot-gitlab> gitlab # [ 199.672368] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.584Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab3d080df2fa5affd9d5ff07","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab3d080df2fa5affd9d5ff07: done: 0.020078 sec","job_status":"done","queue_duration_s":1.07876,"scheduling_latency_s":1.078783,"redis_calls":13,"redis_duration_s":0.0034669999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002505,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020078,"completed_at":"2026-06-30T07:58:03.584Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1716vm-test-run-nixbot-gitlab> gitlab # [ 199.767927] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d71e40e180b9559355c4dc83","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d71e40e180b9559355c4dc83: start","job_status":"start","queue_duration_s":1.100728,"scheduling_latency_s":1.100758}1717vm-test-run-nixbot-gitlab> gitlab # [ 199.768951] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d71e40e180b9559355c4dc83","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d71e40e180b9559355c4dc83: done: 0.015628 sec","job_status":"done","queue_duration_s":1.100728,"scheduling_latency_s":1.100758,"redis_calls":13,"redis_duration_s":0.0031989999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001014,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002185,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015628,"completed_at":"2026-06-30T07:58:03.602Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1718vm-test-run-nixbot-gitlab> gitlab # [ 199.844131] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff538c17f1b4c0189956af01","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff538c17f1b4c0189956af01: start","job_status":"start","queue_duration_s":1.117642,"scheduling_latency_s":1.117663}1719vm-test-run-nixbot-gitlab> gitlab # [ 199.845248] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff538c17f1b4c0189956af01","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff538c17f1b4c0189956af01: done: 0.014731 sec","job_status":"done","queue_duration_s":1.117642,"scheduling_latency_s":1.117663,"redis_calls":13,"redis_duration_s":0.002785,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000828,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014731,"completed_at":"2026-06-30T07:58:03.618Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1720vm-test-run-nixbot-gitlab> gitlab # [ 199.897276] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.619Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3e2218450381c2246a1b363","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3e2218450381c2246a1b363: start","job_status":"start","queue_duration_s":1.133686,"scheduling_latency_s":1.133706}1721vm-test-run-nixbot-gitlab> gitlab # [ 199.917300] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3e2218450381c2246a1b363","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3e2218450381c2246a1b363: done: 0.014596 sec","job_status":"done","queue_duration_s":1.133686,"scheduling_latency_s":1.133706,"redis_calls":13,"redis_duration_s":0.0028650000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00202,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014596,"completed_at":"2026-06-30T07:58:03.634Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1722vm-test-run-nixbot-gitlab> gitlab # [ 199.980619] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"247812c1ffdad3b5ff5f1629","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-247812c1ffdad3b5ff5f1629: start","job_status":"start","queue_duration_s":1.149522,"scheduling_latency_s":1.149541}1723vm-test-run-nixbot-gitlab> gitlab # [ 200.055382] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"247812c1ffdad3b5ff5f1629","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-247812c1ffdad3b5ff5f1629: done: 0.018246 sec","job_status":"done","queue_duration_s":1.149522,"scheduling_latency_s":1.149541,"redis_calls":13,"redis_duration_s":0.003457,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002452,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018246,"completed_at":"2026-06-30T07:58:03.653Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1724vm-test-run-nixbot-gitlab> gitlab # [ 200.060989] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28e6a33adc41e8baf17ff917","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28e6a33adc41e8baf17ff917: start","job_status":"start","queue_duration_s":1.169311,"scheduling_latency_s":1.16934}1725vm-test-run-nixbot-gitlab> gitlab # [ 200.081450] gitaly[1385]: time="2026-06-30T07:58:03.561Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=32 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRHZ3X5G6NZ1H3H8HP355W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-06-30T07:58:13.092" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:03.532" grpc.time_ms=28.418 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1726vm-test-run-nixbot-gitlab> gitlab # [ 200.103451] setup-gitlab-start[3004]: [master (root-commit) dfbe7ce] initial commit1727vm-test-run-nixbot-gitlab> gitlab # [ 200.104883] setup-gitlab-start[3004]: 1 file changed, 10 insertions(+)1728vm-test-run-nixbot-gitlab> gitlab # [ 200.105986] setup-gitlab-start[3004]: create mode 100644 flake.nix1729vm-test-run-nixbot-gitlab> gitlab # [ 200.107260] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28e6a33adc41e8baf17ff917","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28e6a33adc41e8baf17ff917: done: 0.017189 sec","job_status":"done","queue_duration_s":1.169311,"scheduling_latency_s":1.16934,"redis_calls":13,"redis_duration_s":0.003235,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002272,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017189,"completed_at":"2026-06-30T07:58:03.672Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1730vm-test-run-nixbot-gitlab> gitlab # [ 200.200982] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.674Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2649998715fb5f8e5f34725c","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2649998715fb5f8e5f34725c: start","job_status":"start","queue_duration_s":1.188062,"scheduling_latency_s":1.188091}1731vm-test-run-nixbot-gitlab> gitlab # [ 200.202354] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2649998715fb5f8e5f34725c","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2649998715fb5f8e5f34725c: done: 0.016879 sec","job_status":"done","queue_duration_s":1.188062,"scheduling_latency_s":1.188091,"redis_calls":13,"redis_duration_s":0.0037459999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002652,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016879,"completed_at":"2026-06-30T07:58:03.690Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1732vm-test-run-nixbot-gitlab> gitlab # [ 200.307363] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.693Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dfe12b5f7007a33c6fe34100","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dfe12b5f7007a33c6fe34100: start","job_status":"start","queue_duration_s":1.207506,"scheduling_latency_s":1.20753}1733vm-test-run-nixbot-gitlab> gitlab # [ 200.308861] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dfe12b5f7007a33c6fe34100","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dfe12b5f7007a33c6fe34100: done: 0.018627 sec","job_status":"done","queue_duration_s":1.207506,"scheduling_latency_s":1.20753,"redis_calls":13,"redis_duration_s":0.0038520000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001355,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002497,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018627,"completed_at":"2026-06-30T07:58:03.712Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1734vm-test-run-nixbot-gitlab> gitlab # [ 200.383429] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e0b90c48dbb8220d0ffbd15","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e0b90c48dbb8220d0ffbd15: start","job_status":"start","queue_duration_s":1.227443,"scheduling_latency_s":1.227464}1735vm-test-run-nixbot-gitlab> gitlab # [ 200.384764] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e0b90c48dbb8220d0ffbd15","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e0b90c48dbb8220d0ffbd15: done: 0.017272 sec","job_status":"done","queue_duration_s":1.227443,"scheduling_latency_s":1.227464,"redis_calls":13,"redis_duration_s":0.003233,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001157,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002076,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017272,"completed_at":"2026-06-30T07:58:03.730Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1736vm-test-run-nixbot-gitlab> gitlab # [ 200.466447] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"567c2e08d0f019ffe4d6c653","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-567c2e08d0f019ffe4d6c653: start","job_status":"start","queue_duration_s":1.246207,"scheduling_latency_s":1.246244}1737vm-test-run-nixbot-gitlab> gitlab # [ 200.467752] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.747Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"567c2e08d0f019ffe4d6c653","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-567c2e08d0f019ffe4d6c653: done: 0.015807 sec","job_status":"done","queue_duration_s":1.246207,"scheduling_latency_s":1.246244,"redis_calls":13,"redis_duration_s":0.003003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000957,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015807,"completed_at":"2026-06-30T07:58:03.747Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1738vm-test-run-nixbot-gitlab> gitlab # [ 200.547581] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.749Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7d5bcefe63f9aa0e845a15d","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7d5bcefe63f9aa0e845a15d: start","job_status":"start","queue_duration_s":1.263336,"scheduling_latency_s":1.263358}1739vm-test-run-nixbot-gitlab> gitlab # [ 200.548934] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7d5bcefe63f9aa0e845a15d","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7d5bcefe63f9aa0e845a15d: done: 0.014773 sec","job_status":"done","queue_duration_s":1.263336,"scheduling_latency_s":1.263358,"redis_calls":13,"redis_duration_s":0.002902,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000983,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014773,"completed_at":"2026-06-30T07:58:03.764Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1740vm-test-run-nixbot-gitlab> gitlab # [ 200.626924] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a5548cb9b4f4261608c7d9b","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a5548cb9b4f4261608c7d9b: start","job_status":"start","queue_duration_s":1.279379,"scheduling_latency_s":1.2794}1741vm-test-run-nixbot-gitlab> gitlab # [ 200.627971] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a5548cb9b4f4261608c7d9b","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a5548cb9b4f4261608c7d9b: done: 0.014564 sec","job_status":"done","queue_duration_s":1.279379,"scheduling_latency_s":1.2794,"redis_calls":13,"redis_duration_s":0.0027790000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000871,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001908,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014564,"completed_at":"2026-06-30T07:58:03.779Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1742vm-test-run-nixbot-gitlab> gitlab # [ 200.707826] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d9b15d20e549d28d7d71146","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d9b15d20e549d28d7d71146: start","job_status":"start","queue_duration_s":1.295207,"scheduling_latency_s":1.295238}1743vm-test-run-nixbot-gitlab> gitlab # [ 200.709300] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d9b15d20e549d28d7d71146","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d9b15d20e549d28d7d71146: done: 0.015195 sec","job_status":"done","queue_duration_s":1.295207,"scheduling_latency_s":1.295238,"redis_calls":13,"redis_duration_s":0.0032979999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001218,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00208,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015195,"completed_at":"2026-06-30T07:58:03.796Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1744vm-test-run-nixbot-gitlab> gitlab # [ 200.804356] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63481d5ab69eb000844fca4e","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63481d5ab69eb000844fca4e: start","job_status":"start","queue_duration_s":1.311644,"scheduling_latency_s":1.311665}1745vm-test-run-nixbot-gitlab> gitlab # [ 200.805377] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63481d5ab69eb000844fca4e","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63481d5ab69eb000844fca4e: done: 0.014608 sec","job_status":"done","queue_duration_s":1.311644,"scheduling_latency_s":1.311665,"redis_calls":13,"redis_duration_s":0.002883,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000851,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014608,"completed_at":"2026-06-30T07:58:03.812Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1746vm-test-run-nixbot-gitlab> gitlab # [ 200.899125] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0fb154ce7659deb113d7c051","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0fb154ce7659deb113d7c051: start","job_status":"start","queue_duration_s":1.327516,"scheduling_latency_s":1.327537}1747vm-test-run-nixbot-gitlab> gitlab # [ 200.900376] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0fb154ce7659deb113d7c051","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0fb154ce7659deb113d7c051: done: 0.014474 sec","job_status":"done","queue_duration_s":1.327516,"scheduling_latency_s":1.327537,"redis_calls":13,"redis_duration_s":0.002784,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009646,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014474,"completed_at":"2026-06-30T07:58:03.827Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1748vm-test-run-nixbot-gitlab> gitlab # [ 200.976957] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27036772a04dc8e8b27e3550","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27036772a04dc8e8b27e3550: start","job_status":"start","queue_duration_s":1.343263,"scheduling_latency_s":1.343285}1749vm-test-run-nixbot-gitlab> gitlab # [ 200.979188] gitaly[1385]: time="2026-06-30T07:58:03.571Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRHZ3X5G6NZ1H3H8HP355W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-30T07:58:13.131" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:03.571" pid=1385 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1750vm-test-run-nixbot-gitlab> gitlab # [ 201.057488] gitaly[1385]: time="2026-06-30T07:58:03.571Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRHZ3X5G6NZ1H3H8HP355W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-30T07:58:13.131" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:03.571" grpc.time_ms=0.465 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1751vm-test-run-nixbot-gitlab> gitlab # [ 201.059218] setup-gitlab-start[2689]: + git remote add origin http://oauth2:glpat-LkEfa6bgQK70lL3Pp8hpwm86MQp1OjEH.01.0w0zs84ho@gitlab/root/test-flake.git1752vm-test-run-nixbot-gitlab> gitlab # [ 201.060197] setup-gitlab-start[2689]: + git push -u origin master1753vm-test-run-nixbot-gitlab> gitlab # [ 201.061222] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27036772a04dc8e8b27e3550","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27036772a04dc8e8b27e3550: done: 0.01458 sec","job_status":"done","queue_duration_s":1.343263,"scheduling_latency_s":1.343285,"redis_calls":13,"redis_duration_s":0.002822,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000956,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001866,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01458,"completed_at":"2026-06-30T07:58:03.843Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1754vm-test-run-nixbot-gitlab> gitlab # [ 201.075076] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.845Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f22e51e6cc341668ba517ed","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f22e51e6cc341668ba517ed: start","job_status":"start","queue_duration_s":1.359135,"scheduling_latency_s":1.359156}1755vm-test-run-nixbot-gitlab> gitlab # [ 201.095185] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.859Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f22e51e6cc341668ba517ed","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f22e51e6cc341668ba517ed: done: 0.014527 sec","job_status":"done","queue_duration_s":1.359135,"scheduling_latency_s":1.359156,"redis_calls":13,"redis_duration_s":0.002818,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014527,"completed_at":"2026-06-30T07:58:03.859Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1756vm-test-run-nixbot-gitlab> gitlab # [ 201.170753] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad93706da3d3ceda564449ee","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad93706da3d3ceda564449ee: start","job_status":"start","queue_duration_s":1.375107,"scheduling_latency_s":1.375128}1757vm-test-run-nixbot-gitlab> gitlab # [ 201.246825] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad93706da3d3ceda564449ee","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad93706da3d3ceda564449ee: done: 0.017263 sec","job_status":"done","queue_duration_s":1.375107,"scheduling_latency_s":1.375128,"redis_calls":13,"redis_duration_s":0.00318,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001029,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002151,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017263,"completed_at":"2026-06-30T07:58:03.878Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1758vm-test-run-nixbot-gitlab> gitlab # [ 201.249077] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ef28fb381dbed127e6d05fb","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ef28fb381dbed127e6d05fb: start","job_status":"start","queue_duration_s":1.393999,"scheduling_latency_s":1.394022}1759vm-test-run-nixbot-gitlab> gitlab # [ 201.324389] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ef28fb381dbed127e6d05fb","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ef28fb381dbed127e6d05fb: done: 0.015204 sec","job_status":"done","queue_duration_s":1.393999,"scheduling_latency_s":1.394022,"redis_calls":13,"redis_duration_s":0.003007,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002162,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015204,"completed_at":"2026-06-30T07:58:03.895Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1760vm-test-run-nixbot-gitlab> gitlab # [ 201.397044] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.896Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8faa823ca55d232136f6af48","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8faa823ca55d232136f6af48: start","job_status":"start","queue_duration_s":1.410461,"scheduling_latency_s":1.410482}1761vm-test-run-nixbot-gitlab> gitlab # [ 201.398137] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8faa823ca55d232136f6af48","created_at":"2026-06-30T07:58:02.425Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-f367b35c16b344da","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e292f77ea33b47b4fc95dc4613725662","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.485Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8faa823ca55d232136f6af48: done: 0.01451 sec","job_status":"done","queue_duration_s":1.410461,"scheduling_latency_s":1.410482,"redis_calls":13,"redis_duration_s":0.002768,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000873,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009668,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01451,"completed_at":"2026-06-30T07:58:03.910Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1762vm-test-run-nixbot-gitlab> gitlab # [ 201.473980] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.912Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"de735d0e09228c5e72f301a0","created_at":"2026-06-30T07:58:02.503Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-8693672b885a4082","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"689455c37f722ae178a3051c10ea2dfa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.509Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-de735d0e09228c5e72f301a0: start","job_status":"start","queue_duration_s":1.402944,"scheduling_latency_s":1.402966}1763vm-test-run-nixbot-gitlab> gitlab # [ 201.474992] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.923Z","message":"No existing merge request to be cleaned up."}1764vm-test-run-nixbot-gitlab> gitlab # [ 201.476197] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.933Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"de735d0e09228c5e72f301a0","created_at":"2026-06-30T07:58:02.503Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-8693672b885a4082","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"689455c37f722ae178a3051c10ea2dfa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.509Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-de735d0e09228c5e72f301a0: done: 0.021461 sec","job_status":"done","queue_duration_s":1.402944,"scheduling_latency_s":1.402966,"redis_calls":10,"redis_duration_s":0.003057,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001152,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001905,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013796,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021461,"completed_at":"2026-06-30T07:58:03.933Z","load_balancing_strategy":"primary","db_duration_s":0.002233,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1765vm-test-run-nixbot-gitlab> gitlab # [ 201.563825] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.935Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"36d9fc78ee5ac9631afc2706","created_at":"2026-06-30T07:58:02.503Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-8693672b885a4082","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"689455c37f722ae178a3051c10ea2dfa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.509Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-36d9fc78ee5ac9631afc2706: start","job_status":"start","queue_duration_s":1.426158,"scheduling_latency_s":1.426185}1766vm-test-run-nixbot-gitlab> gitlab # [ 201.564693] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.945Z","message":"No existing merge request to be cleaned up."}1767vm-test-run-nixbot-gitlab> gitlab # [ 201.565809] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.952Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"36d9fc78ee5ac9631afc2706","created_at":"2026-06-30T07:58:02.503Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-8693672b885a4082","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"689455c37f722ae178a3051c10ea2dfa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.509Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-36d9fc78ee5ac9631afc2706: done: 0.016966 sec","job_status":"done","queue_duration_s":1.426158,"scheduling_latency_s":1.426185,"redis_calls":10,"redis_duration_s":0.002539,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00161,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016966,"completed_at":"2026-06-30T07:58:03.952Z","load_balancing_strategy":"primary","db_duration_s":0.001332,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1768vm-test-run-nixbot-gitlab> gitlab # [ 201.583359] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.954Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ee771d65e617b9ebc9c9f28b","created_at":"2026-06-30T07:58:02.503Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-8693672b885a4082","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"689455c37f722ae178a3051c10ea2dfa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.509Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ee771d65e617b9ebc9c9f28b: start","job_status":"start","queue_duration_s":1.444759,"scheduling_latency_s":1.444792}1769vm-test-run-nixbot-gitlab> gitlab # [ 201.603333] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.964Z","message":"No existing merge request to be cleaned up."}1770vm-test-run-nixbot-gitlab> gitlab # [ 201.606175] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.972Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ee771d65e617b9ebc9c9f28b","created_at":"2026-06-30T07:58:02.503Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-8693672b885a4082","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"689455c37f722ae178a3051c10ea2dfa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.509Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ee771d65e617b9ebc9c9f28b: done: 0.018389 sec","job_status":"done","queue_duration_s":1.444759,"scheduling_latency_s":1.444792,"redis_calls":10,"redis_duration_s":0.0024720000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000978,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001494,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018389,"completed_at":"2026-06-30T07:58:03.972Z","load_balancing_strategy":"primary","db_duration_s":0.001815,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1771vm-test-run-nixbot-gitlab> gitlab # [ 201.712571] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.974Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e7175fb2026f6d6c2ec4c121","created_at":"2026-06-30T07:58:02.503Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-8693672b885a4082","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"689455c37f722ae178a3051c10ea2dfa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.509Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e7175fb2026f6d6c2ec4c121: start","job_status":"start","queue_duration_s":1.46539,"scheduling_latency_s":1.465461}1772vm-test-run-nixbot-gitlab> gitlab # [ 201.714433] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.985Z","message":"No existing merge request to be cleaned up."}1773vm-test-run-nixbot-gitlab> gitlab # [ 201.715171] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.992Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e7175fb2026f6d6c2ec4c121","created_at":"2026-06-30T07:58:02.503Z","trace_propagation_headers":{"sentry-trace":"ccc288edf9ce489f919205176d070324-8693672b885a4082","baggage":"sentry-trace_id=ccc288edf9ce489f919205176d070324,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"689455c37f722ae178a3051c10ea2dfa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:02.509Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e7175fb2026f6d6c2ec4c121: done: 0.017745 sec","job_status":"done","queue_duration_s":1.46539,"scheduling_latency_s":1.465461,"redis_calls":10,"redis_duration_s":0.002458,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001031,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001427,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017745,"completed_at":"2026-06-30T07:58:03.992Z","load_balancing_strategy":"primary","db_duration_s":0.002229,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1774vm-test-run-nixbot-gitlab> gitlab # [ 201.811607] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:03.993Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"ebd0c67fb09dd0a831288763","created_at":"2026-06-30T07:58:03.595Z","trace_propagation_headers":{"sentry-trace":"fdda0a3cc6f94675b5bf6e7b0382e17d-0586dbc060dc4265","baggage":"sentry-trace_id=fdda0a3cc6f94675b5bf6e7b0382e17d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRHZ3X5G6NZ1H3H8HP355W","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:03.622Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-ebd0c67fb09dd0a831288763: start","job_status":"start","queue_duration_s":0.371583,"scheduling_latency_s":0.371606}1775vm-test-run-nixbot-gitlab> gitlab # [ 201.812666] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:04.036Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"ebd0c67fb09dd0a831288763","created_at":"2026-06-30T07:58:03.595Z","trace_propagation_headers":{"sentry-trace":"fdda0a3cc6f94675b5bf6e7b0382e17d-0586dbc060dc4265","baggage":"sentry-trace_id=fdda0a3cc6f94675b5bf6e7b0382e17d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRHZ3X5G6NZ1H3H8HP355W","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:03.622Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-ebd0c67fb09dd0a831288763: done: 0.042638 sec","job_status":"done","queue_duration_s":0.371583,"scheduling_latency_s":0.371606,"redis_calls":10,"redis_duration_s":0.002895,"redis_read_bytes":8,"redis_write_bytes":1165,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001622,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001273,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":7,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.026473756,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.042638,"completed_at":"2026-06-30T07:58:04.036Z","load_balancing_strategy":"primary","db_duration_s":0.010316,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1776vm-test-run-nixbot-gitlab> gitlab # [ 201.886384] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:04.038Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"cb157a4047b1cd22d25a3b02","created_at":"2026-06-30T07:58:03.632Z","trace_propagation_headers":{"sentry-trace":"fdda0a3cc6f94675b5bf6e7b0382e17d-0586dbc060dc4265","baggage":"sentry-trace_id=fdda0a3cc6f94675b5bf6e7b0382e17d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRHZ3X5G6NZ1H3H8HP355W","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:03.636Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-cb157a4047b1cd22d25a3b02: start","job_status":"start","queue_duration_s":0.401501,"scheduling_latency_s":0.401523}1777vm-test-run-nixbot-gitlab> gitlab # [ 201.887992] gitaly[1385]: time="2026-06-30T07:58:03.583Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRHZ3X5G6NZ1H3H8HP355W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-30T07:58:13.135" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:03.576" grpc.time_ms=7.095 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1778vm-test-run-nixbot-gitlab> gitlab # [ 201.890376] setup-gitlab-start[3008]: To http://gitlab/root/test-flake.git1779vm-test-run-nixbot-gitlab> gitlab # [ 201.891342] setup-gitlab-start[3008]: * [new branch] master -> master1780vm-test-run-nixbot-gitlab> gitlab # [ 201.893057] setup-gitlab-start[3008]: branch 'master' set up to track 'origin/master'.1781vm-test-run-nixbot-gitlab> gitlab # [ 201.894561] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:04.109Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"cb157a4047b1cd22d25a3b02","created_at":"2026-06-30T07:58:03.632Z","trace_propagation_headers":{"sentry-trace":"fdda0a3cc6f94675b5bf6e7b0382e17d-0586dbc060dc4265","baggage":"sentry-trace_id=fdda0a3cc6f94675b5bf6e7b0382e17d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRHZ3X5G6NZ1H3H8HP355W","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:03.636Z","job_size_bytes":2,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-cb157a4047b1cd22d25a3b02: done: 0.071049 sec","job_status":"done","queue_duration_s":0.401501,"scheduling_latency_s":0.401523,"redis_calls":14,"redis_duration_s":0.003359,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000665,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001654,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04939,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.051428324,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.071049,"completed_at":"2026-06-30T07:58:04.109Z","load_balancing_strategy":"primary","db_duration_s":0.015117,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1782vm-test-run-nixbot-gitlab> gitlab # [ 201.983987] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:04.110Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"4db0b19024272456b8ad00ac","created_at":"2026-06-30T07:58:04.027Z","trace_propagation_headers":{"sentry-trace":"fdda0a3cc6f94675b5bf6e7b0382e17d-0586dbc060dc4265","baggage":"sentry-trace_id=fdda0a3cc6f94675b5bf6e7b0382e17d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRHZ3X5G6NZ1H3H8HP355W","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:04.033Z","job_size_bytes":5,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-4db0b19024272456b8ad00ac: start","job_status":"start","queue_duration_s":0.077005,"scheduling_latency_s":0.077027}1783vm-test-run-nixbot-gitlab> gitlab # [ 201.992495] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:04.182Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"4db0b19024272456b8ad00ac","created_at":"2026-06-30T07:58:04.027Z","trace_propagation_headers":{"sentry-trace":"fdda0a3cc6f94675b5bf6e7b0382e17d-0586dbc060dc4265","baggage":"sentry-trace_id=fdda0a3cc6f94675b5bf6e7b0382e17d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRHZ3X5G6NZ1H3H8HP355W","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:04.033Z","job_size_bytes":5,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-4db0b19024272456b8ad00ac: done: 0.071953 sec","job_status":"done","queue_duration_s":0.077005,"scheduling_latency_s":0.077027,"redis_calls":12,"redis_duration_s":0.002837,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000676,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001669,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000415975,"duration_s":0.071953,"completed_at":"2026-06-30T07:58:04.182Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013431,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1784vm-test-run-nixbot-gitlab> gitlab # [ 202.082436] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:04.184Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"78ff477c59a5c0a19426ce0c","created_at":"2026-06-30T07:58:04.053Z","trace_propagation_headers":{"sentry-trace":"fdda0a3cc6f94675b5bf6e7b0382e17d-0586dbc060dc4265","baggage":"sentry-trace_id=fdda0a3cc6f94675b5bf6e7b0382e17d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRHZ3X5G6NZ1H3H8HP355W","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:04.056Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-78ff477c59a5c0a19426ce0c: start","job_status":"start","queue_duration_s":0.127165,"scheduling_latency_s":0.127186}1785vm-test-run-nixbot-gitlab> gitlab # [ 202.088096] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:04.331Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"78ff477c59a5c0a19426ce0c","created_at":"2026-06-30T07:58:04.053Z","trace_propagation_headers":{"sentry-trace":"fdda0a3cc6f94675b5bf6e7b0382e17d-0586dbc060dc4265","baggage":"sentry-trace_id=fdda0a3cc6f94675b5bf6e7b0382e17d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRHZ3X5G6NZ1H3H8HP355W","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:04.056Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-78ff477c59a5c0a19426ce0c: done: 0.147078 sec","job_status":"done","queue_duration_s":0.127165,"scheduling_latency_s":0.127186,"redis_calls":11,"redis_duration_s":0.0030369999999999998,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000649,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001654,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000734,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.12,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.12,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.088926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000352838,"duration_s":0.147078,"completed_at":"2026-06-30T07:58:04.331Z","load_balancing_strategy":"primary","db_duration_s":0.058649,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1786vm-test-run-nixbot-gitlab> gitlab # [ 202.202526] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:04.332Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"990bf973be169086b3397234","created_at":"2026-06-30T07:58:04.059Z","trace_propagation_headers":{"sentry-trace":"fdda0a3cc6f94675b5bf6e7b0382e17d-0586dbc060dc4265","baggage":"sentry-trace_id=fdda0a3cc6f94675b5bf6e7b0382e17d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRHZ3X5G6NZ1H3H8HP355W","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:04.062Z","job_size_bytes":89,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-990bf973be169086b3397234: start","job_status":"start","queue_duration_s":0.269811,"scheduling_latency_s":0.269833}1787vm-test-run-nixbot-gitlab> gitlab # [ 202.204111] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:04.378Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"990bf973be169086b3397234","created_at":"2026-06-30T07:58:04.059Z","trace_propagation_headers":{"sentry-trace":"fdda0a3cc6f94675b5bf6e7b0382e17d-0586dbc060dc4265","baggage":"sentry-trace_id=fdda0a3cc6f94675b5bf6e7b0382e17d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRHZ3X5G6NZ1H3H8HP355W","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:04.062Z","job_size_bytes":89,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-990bf973be169086b3397234: done: 0.045582 sec","job_status":"done","queue_duration_s":0.269811,"scheduling_latency_s":0.269833,"redis_calls":11,"redis_duration_s":0.002742,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000749,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001488,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000505,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000397537,"duration_s":0.045582,"completed_at":"2026-06-30T07:58:04.378Z","load_balancing_strategy":"primary","db_duration_s":0.014574,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1788vm-test-run-nixbot-gitlab> gitlab # [ 202.255281] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:05.114Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 dfbe7ce112013e8b89cb683f585280422ae1494c refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"72e107960331e68a10c58367","created_at":"2026-06-30T07:58:05.107Z","trace_propagation_headers":{"sentry-trace":"2907a283e67640ddabbe71f85a31003c-4dc5428458b34194","baggage":"sentry-trace_id=2907a283e67640ddabbe71f85a31003c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJ2BGPD770KDNGTASH2EA","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:05.112Z","job_size_bytes":185,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-72e107960331e68a10c58367: start","job_status":"start","queue_duration_s":0.002329,"scheduling_latency_s":0.002415}1789vm-test-run-nixbot-gitlab> gitlab # [ 202.284804] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:05.132Z","message":"changes: \"0000000000000000000000000000000000000000 dfbe7ce112013e8b89cb683f585280422ae1494c refs/heads/master\\n\""}1790vm-test-run-nixbot-gitlab> gitlab # [ 202.286055] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:05.833Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 dfbe7ce112013e8b89cb683f585280422ae1494c refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"72e107960331e68a10c58367","created_at":"2026-06-30T07:58:05.107Z","trace_propagation_headers":{"sentry-trace":"2907a283e67640ddabbe71f85a31003c-4dc5428458b34194","baggage":"sentry-trace_id=2907a283e67640ddabbe71f85a31003c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJ2BGPD770KDNGTASH2EA","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:05.112Z","job_size_bytes":185,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-72e107960331e68a10c58367: done: 0.718511 sec","job_status":"done","queue_duration_s":0.002329,"scheduling_latency_s":0.002415,"gitaly_calls":13,"gitaly_duration_s":0.182009,"redis_calls":196,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.045823,"redis_read_bytes":1445,"redis_write_bytes":19018,"redis_cache_calls":14,"redis_cache_duration_s":0.003406,"redis_cache_read_bytes":16,"redis_cache_write_bytes":884,"redis_feature_flag_calls":28,"redis_feature_flag_duration_s":0.006912,"redis_feature_flag_read_bytes":1044,"redis_feature_flag_write_bytes":3487,"redis_queues_calls":8,"redis_queues_duration_s":0.001237,"redis_queues_read_bytes":8,"redis_queues_write_bytes":4934,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002387,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1259,"redis_repository_cache_calls":91,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.019729,"redis_repository_cache_read_bytes":233,"redis_repository_cache_write_bytes":6319,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.012152,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.191,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.206,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.036,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.440993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.003552966,"exclusive_lock_hold_duration_s":0.034846608,"duration_s":0.718511,"completed_at":"2026-06-30T07:58:05.833Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.060835,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1791vm-test-run-nixbot-gitlab> gitlab # [ 202.409295] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:05.834Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"a2b44ed5e0d62b0f9c6dc22d","created_at":"2026-06-30T07:58:05.248Z","trace_propagation_headers":{"sentry-trace":"2907a283e67640ddabbe71f85a31003c-e6b49cc787754532","baggage":"sentry-trace_id=2907a283e67640ddabbe71f85a31003c,sentry-release=Unknown"},"correlation_id":"01KWBRJ2BGPD770KDNGTASH2EA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:05.252Z","job_size_bytes":46,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a2b44ed5e0d62b0f9c6dc22d: start","job_status":"start","queue_duration_s":0.582148,"scheduling_latency_s":0.58217}1792vm-test-run-nixbot-gitlab> gitlab # [ 202.410727] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:05.954Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"a2b44ed5e0d62b0f9c6dc22d","created_at":"2026-06-30T07:58:05.248Z","trace_propagation_headers":{"sentry-trace":"2907a283e67640ddabbe71f85a31003c-e6b49cc787754532","baggage":"sentry-trace_id=2907a283e67640ddabbe71f85a31003c,sentry-release=Unknown"},"correlation_id":"01KWBRJ2BGPD770KDNGTASH2EA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:05.252Z","job_size_bytes":46,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a2b44ed5e0d62b0f9c6dc22d: done: 0.11928 sec","job_status":"done","queue_duration_s":0.582148,"scheduling_latency_s":0.58217,"gitaly_calls":2,"gitaly_duration_s":0.048682,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.007364,"redis_read_bytes":68,"redis_write_bytes":4883,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.00146,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000576,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2112,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001646,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002948,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":752,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000734,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000355632,"duration_s":0.11928,"completed_at":"2026-06-30T07:58:05.954Z","load_balancing_strategy":"primary","db_duration_s":0.012873,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1793vm-test-run-nixbot-gitlab> gitlab # [ 202.469165] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:05.955Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"7ed1e037ecc7fbe9e72b2d46","created_at":"2026-06-30T07:58:05.266Z","trace_propagation_headers":{"sentry-trace":"2907a283e67640ddabbe71f85a31003c-e6b49cc787754532","baggage":"sentry-trace_id=2907a283e67640ddabbe71f85a31003c,sentry-release=Unknown"},"correlation_id":"01KWBRJ2BGPD770KDNGTASH2EA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:05.270Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-7ed1e037ecc7fbe9e72b2d46: start","job_status":"start","queue_duration_s":0.685221,"scheduling_latency_s":0.685243}1794vm-test-run-nixbot-gitlab> gitlab # [ 202.496052] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:06.129Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"7ed1e037ecc7fbe9e72b2d46","created_at":"2026-06-30T07:58:05.266Z","trace_propagation_headers":{"sentry-trace":"2907a283e67640ddabbe71f85a31003c-e6b49cc787754532","baggage":"sentry-trace_id=2907a283e67640ddabbe71f85a31003c,sentry-release=Unknown"},"correlation_id":"01KWBRJ2BGPD770KDNGTASH2EA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:05.270Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-7ed1e037ecc7fbe9e72b2d46: done: 0.173869 sec","job_status":"done","queue_duration_s":0.685221,"scheduling_latency_s":0.685243,"gitaly_calls":1,"gitaly_duration_s":0.105428,"redis_calls":32,"redis_duration_s":0.007502,"redis_read_bytes":212,"redis_write_bytes":3742,"redis_feature_flag_calls":19,"redis_feature_flag_duration_s":0.004281,"redis_feature_flag_read_bytes":146,"redis_feature_flag_write_bytes":2527,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001401,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000641,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001179,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":21,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":21,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":21,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.015,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13469868399999999,"duration_s":0.173869,"completed_at":"2026-06-30T07:58:06.129Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014923,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1795vm-test-run-nixbot-gitlab> gitlab # [ 202.578531] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:06.131Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"2f0a968e579677fe43076e54","created_at":"2026-06-30T07:58:05.379Z","trace_propagation_headers":{"sentry-trace":"2907a283e67640ddabbe71f85a31003c-e6b49cc787754532","baggage":"sentry-trace_id=2907a283e67640ddabbe71f85a31003c,sentry-release=Unknown"},"correlation_id":"01KWBRJ2BGPD770KDNGTASH2EA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:05.381Z","job_size_bytes":23,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-2f0a968e579677fe43076e54: start","job_status":"start","queue_duration_s":0.74986,"scheduling_latency_s":0.749884}1796vm-test-run-nixbot-gitlab> gitlab # [ 202.593890] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:06.177Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"2f0a968e579677fe43076e54","created_at":"2026-06-30T07:58:05.379Z","trace_propagation_headers":{"sentry-trace":"2907a283e67640ddabbe71f85a31003c-e6b49cc787754532","baggage":"sentry-trace_id=2907a283e67640ddabbe71f85a31003c,sentry-release=Unknown"},"correlation_id":"01KWBRJ2BGPD770KDNGTASH2EA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:05.381Z","job_size_bytes":23,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-2f0a968e579677fe43076e54: done: 0.046588 sec","job_status":"done","queue_duration_s":0.74986,"scheduling_latency_s":0.749884,"gitaly_calls":1,"gitaly_duration_s":0.010913,"redis_calls":16,"redis_duration_s":0.006061,"redis_read_bytes":52,"redis_write_bytes":2048,"redis_queues_calls":1,"redis_queues_duration_s":0.000498,"redis_queues_read_bytes":1,"redis_queues_write_bytes":979,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001314,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.0033,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000949,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024087,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.046588,"completed_at":"2026-06-30T07:58:06.177Z","load_balancing_strategy":"primary","db_duration_s":0.002386,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1797vm-test-run-nixbot-gitlab> gitlab # [ 202.730594] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:06.179Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"09e8dcf77f2f9567bed282f0","created_at":"2026-06-30T07:58:05.751Z","trace_propagation_headers":{"sentry-trace":"2907a283e67640ddabbe71f85a31003c-e6b49cc787754532","baggage":"sentry-trace_id=2907a283e67640ddabbe71f85a31003c,sentry-release=Unknown"},"correlation_id":"01KWBRJ2BGPD770KDNGTASH2EA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:767d7744624e9a91a14bc907f3764bc9e918d6453c4490a006d16f3897b33ec3","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:05.757Z","job_size_bytes":467,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-09e8dcf77f2f9567bed282f0: start","job_status":"start","queue_duration_s":0.422437,"scheduling_latency_s":0.422464}1798vm-test-run-nixbot-gitlab> gitlab # [ 202.731985] sidekiq-cluster[2131]: {"severity":"WARN","time":"2026-06-30T07:58:06.986Z","class":"CreatePipelineWorker","correlation_id":"01KWBRJ2BGPD770KDNGTASH2EA","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"dfbe7ce112013e8b89cb683f585280422ae1494c","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"dfbe7ce112013e8b89cb683f585280422ae1494c","ref":"refs/heads/master"},"retry":0}1799vm-test-run-nixbot-gitlab> gitlab # [ 202.733765] nixbot[3123]: {"ts": "2026-06-30T07:58:08.188Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1800vm-test-run-nixbot-gitlab> gitlab # [ 202.734988] nixbot[3123]: {"ts": "2026-06-30T07:58:08.211Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1801vm-test-run-nixbot-gitlab> gitlab # [ 202.735845] nixbot[3123]: {"ts": "2026-06-30T07:58:08.225Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1802vm-test-run-nixbot-gitlab> gitlab # [ 202.736888] nixbot[3123]: {"ts": "2026-06-30T07:58:08.228Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1803vm-test-run-nixbot-gitlab> gitlab # [ 202.738063] nixbot[3123]: {"ts": "2026-06-30T07:58:08.231Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1804vm-test-run-nixbot-gitlab> gitlab # [ 202.738892] nixbot[3123]: {"ts": "2026-06-30T07:58:08.236Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1805vm-test-run-nixbot-gitlab> gitlab # [ 202.740209] nixbot[3123]: {"ts": "2026-06-30T07:58:08.239Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1806vm-test-run-nixbot-gitlab> gitlab # [ 202.740930] nixbot[3123]: {"ts": "2026-06-30T07:58:08.241Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1807vm-test-run-nixbot-gitlab> gitlab # [ 202.742376] nixbot[3123]: {"ts": "2026-06-30T07:58:08.245Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1808vm-test-run-nixbot-gitlab> gitlab # [ 202.744583] nixbot[3123]: {"ts": "2026-06-30T07:58:08.248Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1809vm-test-run-nixbot-gitlab> gitlab # [ 202.745708] nixbot[3123]: {"ts": "2026-06-30T07:58:08.251Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1810vm-test-run-nixbot-gitlab> gitlab # [ 202.746862] nixbot[3123]: {"ts": "2026-06-30T07:58:08.256Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1811vm-test-run-nixbot-gitlab> gitlab # [ 202.748403] gitaly[1385]: time="2026-06-30T07:58:03.641Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRHZ3X5G6NZ1H3H8HP355W error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-30T07:58:13.200" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:03.641" pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1812vm-test-run-nixbot-gitlab> gitlab # [ 202.827447] gitaly[1385]: time="2026-06-30T07:58:03.641Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRHZ3X5G6NZ1H3H8HP355W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-30T07:58:13.200" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:03.641" grpc.time_ms=0.265 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1813vm-test-run-nixbot-gitlab> gitlab # [ 202.829450] systemd[1]: Started nixbot CI service.1814vm-test-run-nixbot-gitlab> gitlab # [ 202.830505] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:06.991Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"09e8dcf77f2f9567bed282f0","created_at":"2026-06-30T07:58:05.751Z","trace_propagation_headers":{"sentry-trace":"2907a283e67640ddabbe71f85a31003c-e6b49cc787754532","baggage":"sentry-trace_id=2907a283e67640ddabbe71f85a31003c,sentry-release=Unknown"},"correlation_id":"01KWBRJ2BGPD770KDNGTASH2EA","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:767d7744624e9a91a14bc907f3764bc9e918d6453c4490a006d16f3897b33ec3","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:05.757Z","job_size_bytes":467,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-09e8dcf77f2f9567bed282f0: done: 0.812133 sec","job_status":"done","queue_duration_s":0.422437,"scheduling_latency_s":0.422464,"gitaly_calls":7,"gitaly_duration_s":0.083647,"redis_calls":53,"redis_duration_s":0.010754999999999999,"redis_read_bytes":171,"redis_write_bytes":4426,"redis_cache_calls":4,"redis_cache_duration_s":0.001091,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.004683,"redis_feature_flag_read_bytes":18,"redis_feature_flag_write_bytes":2433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001313,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002683,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":43,"db_write_count":1,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":43,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":38,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.643264,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000341943,"duration_s":0.812133,"completed_at":"2026-06-30T07:58:06.991Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.063845,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1815vm-test-run-nixbot-gitlab> gitlab # [ 202.858315] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:06.993Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"21c0cd5e7ed5e3aff1160ad4","created_at":"2026-06-30T07:58:05.939Z","trace_propagation_headers":{"sentry-trace":"2907a283e67640ddabbe71f85a31003c-71dd7c51f9054817","baggage":"sentry-trace_id=2907a283e67640ddabbe71f85a31003c,sentry-release=Unknown"},"correlation_id":"01KWBRJ2BGPD770KDNGTASH2EA","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:05.943Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-21c0cd5e7ed5e3aff1160ad4: start","job_status":"start","queue_duration_s":1.049586,"scheduling_latency_s":1.049608}1816vm-test-run-nixbot-gitlab> gitlab # [ 202.884301] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:07.031Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"21c0cd5e7ed5e3aff1160ad4","created_at":"2026-06-30T07:58:05.939Z","trace_propagation_headers":{"sentry-trace":"2907a283e67640ddabbe71f85a31003c-71dd7c51f9054817","baggage":"sentry-trace_id=2907a283e67640ddabbe71f85a31003c,sentry-release=Unknown"},"correlation_id":"01KWBRJ2BGPD770KDNGTASH2EA","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:05.943Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-21c0cd5e7ed5e3aff1160ad4: done: 0.0383 sec","job_status":"done","queue_duration_s":1.049586,"scheduling_latency_s":1.049608,"redis_calls":19,"redis_duration_s":0.004469,"redis_read_bytes":21,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000924,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000537,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002289,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000719,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006381258000000001,"duration_s":0.0383,"completed_at":"2026-06-30T07:58:07.031Z","load_balancing_strategy":"primary","db_duration_s":0.006856,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1817vm-test-run-nixbot-gitlab> gitlab # [ 202.961821] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:07.033Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"6c3e289a6ef16aeac66d8ad4","created_at":"2026-06-30T07:58:07.020Z","trace_propagation_headers":{"sentry-trace":"2907a283e67640ddabbe71f85a31003c-9fbe9b9801c5492d","baggage":"sentry-trace_id=2907a283e67640ddabbe71f85a31003c,sentry-release=Unknown"},"correlation_id":"01KWBRJ2BGPD770KDNGTASH2EA","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:07.024Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-6c3e289a6ef16aeac66d8ad4: start","job_status":"start","queue_duration_s":0.008078,"scheduling_latency_s":0.008099}1818vm-test-run-nixbot-gitlab> gitlab # [ 202.982383] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:07.094Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"6c3e289a6ef16aeac66d8ad4","created_at":"2026-06-30T07:58:07.020Z","trace_propagation_headers":{"sentry-trace":"2907a283e67640ddabbe71f85a31003c-9fbe9b9801c5492d","baggage":"sentry-trace_id=2907a283e67640ddabbe71f85a31003c,sentry-release=Unknown"},"correlation_id":"01KWBRJ2BGPD770KDNGTASH2EA","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:07.024Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-6c3e289a6ef16aeac66d8ad4: done: 0.061426 sec","job_status":"done","queue_duration_s":0.008078,"scheduling_latency_s":0.008099,"redis_calls":11,"redis_duration_s":0.002582,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000463,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001669,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00045,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000390553,"duration_s":0.061426,"completed_at":"2026-06-30T07:58:07.094Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014588,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1819vm-test-run-nixbot-gitlab> gitlab # [ 203.075878] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:08 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 2011820vm-test-run-nixbot-gitlab> gitlab # [ 203.076896] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 751821vm-test-run-nixbot-gitlab> gitlab # [ 203.078097] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 868 "" "python-httpx/0.28.1" 1441822vm-test-run-nixbot-gitlab> gitlab # [ 203.078921] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:09 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 6021823vm-test-run-nixbot-gitlab> gitlab # [ 203.080191] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "python-httpx/0.28.1" 871824vm-test-run-nixbot-gitlab> gitlab # [ 203.081053] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:10 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 868 "" "python-httpx/0.28.1" 561825vm-test-run-nixbot-gitlab> gitlab # [ 203.081925] nixbot[3123]: {"ts": "2026-06-30T07:58:08.259Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1826vm-test-run-nixbot-gitlab> gitlab # [ 203.083046] nixbot[3123]: {"ts": "2026-06-30T07:58:08.261Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1827vm-test-run-nixbot-gitlab> gitlab # [ 203.083976] nixbot[3123]: {"ts": "2026-06-30T07:58:08.264Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1828vm-test-run-nixbot-gitlab> gitlab # [ 203.085102] nixbot[3123]: {"ts": "2026-06-30T07:58:08.266Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1829vm-test-run-nixbot-gitlab> gitlab # [ 203.087991] nixbot[3123]: {"ts": "2026-06-30T07:58:08.268Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1830vm-test-run-nixbot-gitlab> gitlab # [ 203.091775] nixbot[3123]: {"ts": "2026-06-30T07:58:08.270Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1831vm-test-run-nixbot-gitlab> gitlab # [ 203.094648] nixbot[3123]: {"ts": "2026-06-30T07:58:08.274Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1832vm-test-run-nixbot-gitlab> gitlab # [ 203.098157] nixbot[3123]: INFO: Started server process [3123]1833vm-test-run-nixbot-gitlab> gitlab # [ 203.099346] nixbot[3123]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1834vm-test-run-nixbot-gitlab> gitlab # [ 203.101646] nixbot[3123]: {"ts": "2026-06-30T07:58:08.976Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1835vm-test-run-nixbot-gitlab> gitlab # [ 203.105714] nixbot[3123]: {"ts": "2026-06-30T07:58:08.991Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1836vm-test-run-nixbot-gitlab> gitlab # [ 203.109246] nixbot[3123]: {"ts": "2026-06-30T07:58:09.075Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1837vm-test-run-nixbot-gitlab> gitlab # [ 203.112896] nixbot[3123]: {"ts": "2026-06-30T07:58:09.077Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1838vm-test-run-nixbot-gitlab> gitlab # [ 203.116233] gitaly[1385]: time="2026-06-30T07:58:03.670Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRHZ3X5G6NZ1H3H8HP355W diskcache=bc3b45a6-f7aa-4890-813d-b8b39a1ad088 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-06-30T07:58:13.203" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:03.643" pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1839vm-test-run-nixbot-gitlab> gitlab # [ 203.191602] systemd[1]: Reached target Multi-User System.1840vm-test-run-nixbot-gitlab> gitlab # [ 203.192772] nixbot[3123]: {"ts": "2026-06-30T07:58:09.227Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1841vm-test-run-nixbot-gitlab> gitlab # [ 203.193975] nixbot[3123]: INFO: ::ffff:127.0.0.1:60682 - "GET /health HTTP/1.1" 200 OK1842vm-test-run-nixbot-gitlab> gitlab # [ 203.195043] nixbot[3123]: {"ts": "2026-06-30T07:58:09.844Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1843vm-test-run-nixbot-gitlab> gitlab # [ 203.195917] nixbot[3123]: {"ts": "2026-06-30T07:58:09.951Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1844vm-test-run-nixbot-gitlab> gitlab # [ 203.197101] nixbot[3123]: {"ts": "2026-06-30T07:58:10.012Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1845vm-test-run-nixbot-gitlab> gitlab # [ 203.197922] nixbot[3123]: {"ts": "2026-06-30T07:58:10.130Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1846vm-test-run-nixbot-gitlab> gitlab # [ 203.199209] gitaly[1385]: time="2026-06-30T07:58:03.670Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=32 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRHZ3X5G6NZ1H3H8HP355W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-06-30T07:58:13.203" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:03.643" grpc.time_ms=26.391 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1847vm-test-run-nixbot-gitlab> gitlab # [ 203.200087] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 731 "" "python-httpx/0.28.1" 1121848vm-test-run-nixbot-gitlab> gitlab # [ 203.200911] gitaly[1385]: time="2026-06-30T07:58:03.676Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRHZ3X5G6NZ1H3H8HP355W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-30T07:58:13.235" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:03.675" pid=1385 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1849vm-test-run-nixbot-gitlab> gitlab # [ 203.202080] gitaly[1385]: time="2026-06-30T07:58:03.676Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRHZ3X5G6NZ1H3H8HP355W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-30T07:58:13.235" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:03.675" grpc.time_ms=0.423 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1850vm-test-run-nixbot-gitlab> gitlab # [ 203.282357] gitaly[1385]: time="2026-06-30T07:58:03.686Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRHZ3X5G6NZ1H3H8HP355W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-30T07:58:13.238" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:03.679" grpc.time_ms=7.546 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1851vm-test-run-nixbot-gitlab> gitlab # [ 203.283896] nixbot[3123]: {"ts": "2026-06-30T07:58:10.193Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1852vm-test-run-nixbot-gitlab> gitlab # [ 203.284988] nixbot[3123]: {"ts": "2026-06-30T07:58:10.197Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1853vm-test-run-nixbot-gitlab> gitlab # [ 203.285907] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 591854vm-test-run-nixbot-gitlab> gitlab # [ 203.287155] gitaly[1385]: time="2026-06-30T07:58:03.711Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRHZ3X5G6NZ1H3H8HP355W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-30T07:58:13.270" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:03.711" grpc.time_ms=0.135 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1855vm-test-run-nixbot-gitlab> gitlab # [ 203.287955] gitaly[1385]: time="2026-06-30T07:58:03.717Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRHZ3X5G6NZ1H3H8HP355W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-06-30T07:58:13.276" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:03.717" grpc.time_ms=0.171 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1856vm-test-run-nixbot-gitlab> gitlab # [ 203.289223] gitaly[1385]: time="2026-06-30T07:58:04.080Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRHZ3X5G6NZ1H3H8HP355W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-30T07:58:14.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:04.074" grpc.time_ms=5.895 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1857vm-test-run-nixbot-gitlab> gitlab # [ 203.363049] gitaly[1385]: time="2026-06-30T07:58:04.647Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ28AZ6MPVHR387Y8HYDW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:04.637" grpc.time_ms=10.154 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1858vm-test-run-nixbot-gitlab> gitlab # [ 203.364335] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:10 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 521859vm-test-run-nixbot-gitlab> gitlab # [ 203.368752] gitaly[1385]: time="2026-06-30T07:58:04.881Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-30T07:58:14.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:04.873" grpc.time_ms=8.057 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1860vm-test-run-nixbot-gitlab> gitlab # [ 203.370129] gitaly[1385]: time="2026-06-30T07:58:04.910Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-06-30T07:58:34.099" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-06-30T07:58:04.899" grpc.time_ms=10.056 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1861vm-test-run-nixbot-gitlab> gitlab # [ 203.378466] gitaly[1385]: time="2026-06-30T07:58:04.927Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KWBRJ2BGPD770KDNGTASH2EA duration_ms=164ns method=POST pid=1385 status=200 url="http://unix/api/v4/internal/allowed"[ 203.715723] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 8760364165 wd_nsec: 87603597291862vm-test-run-nixbot-gitlab> gitlab # 1863vm-test-run-nixbot-gitlab> gitlab # [ 203.455876] gitaly[1385]: time="2026-06-30T07:58:04.955Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KWBRJ2BGPD770KDNGTASH2EA duration_ms=27ns method=POST pid=1385 status=200 url="http://unix/api/v4/internal/pre_receive"1864vm-test-run-nixbot-gitlab> gitlab # [ 203.460884] gitaly[1385]: time="2026-06-30T07:58:04.956Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5322 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:04.762" grpc.time_ms=193.862 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1865vm-test-run-nixbot-gitlab> gitlab # [ 203.477581] gitaly[1385]: time="2026-06-30T07:58:04.984Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4792 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:04.983" grpc.time_ms=1.066 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1866vm-test-run-nixbot-gitlab> gitlab # [ 203.494499] gitlab-workhorse[1290]: time="2026-06-30T07:58:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1491867vm-test-run-nixbot-gitlab> gitlab # [ 203.497831] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 149 "" "git/2.54.0" 891868vm-test-run-nixbot-gitlab> gitlab # [ 203.501298] gitaly[1385]: time="2026-06-30T07:58:05.025Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4791 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:05.024" grpc.time_ms=0.463 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1869vm-test-run-nixbot-gitlab> gitlab # [ 203.518370] gitaly[1385]: time="2026-06-30T07:58:05.052Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4793 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:05.052" grpc.time_ms=0.273 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1870vm-test-run-nixbot-gitlab> gitlab # [ 203.536123] gitaly[1385]: time="2026-06-30T07:58:05.156Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=10 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-30T07:58:15.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:05.143" grpc.time_ms=13.047 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1871vm-test-run-nixbot-gitlab> gitlab # [ 203.558867] gitlab-workhorse[1290]: time="2026-06-30T07:58:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3781872vm-test-run-nixbot-gitlab> gitlab # [ 203.559377] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 378 "" "git/2.54.0" 851873vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for unit nixbot.service, in 4.42 seconds)1874vm-test-run-nixbot-gitlab> gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1875vm-test-run-nixbot-gitlab> gitlab # [ 203.560325] gitaly[1385]: time="2026-06-30T07:58:05.201Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-30T07:58:15.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:05.195" grpc.time_ms=6.167 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1876vm-test-run-nixbot-gitlab> gitlab # [ 203.562456] systemd[1]: Startup finished in 1.609s (kernel) + 4.305s (initrd) + 3min 17.644s (userspace) = 3min 23.560s.1877vm-test-run-nixbot-gitlab> gitlab # [ 203.563859] gitaly[1385]: time="2026-06-30T07:58:05.209Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1572 command.oublock=0 command.real_time_ms=42 command.spawn_token_fork_ms=29 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-06-30T07:58:15.021" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:05.161" grpc.time_ms=47.517 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1878vm-test-run-nixbot-gitlab> gitlab # [ 203.565153] gitaly[1385]: time="2026-06-30T07:58:05.221Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KWBRJ2BGPD770KDNGTASH2EA duration_ms=141ns method=POST pid=1385 status=200 url="http://unix/api/v4/internal/post_receive"1879vm-test-run-nixbot-gitlab> gitlab # [ 203.565993] gitaly[1385]: time="2026-06-30T07:58:05.222Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4816 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:05.079" grpc.time_ms=142.74 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1880vm-test-run-nixbot-gitlab> gitlab # [ 203.569465] gitaly[1385]: time="2026-06-30T07:58:05.235Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA diskcache=03934a43-6b45-4235-851c-40cc5f41b41a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:04.709" pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1881vm-test-run-nixbot-gitlab> gitlab # [ 203.579235] gitaly[1385]: time="2026-06-30T07:58:05.236Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=158 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13505 command.oublock=32 command.real_time_ms=516 command.spawn_token_fork_ms=1 command.system_time_ms=106 command.user_time_ms=52 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:04.709" grpc.time_ms=526.762 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1882vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1883vm-test-run-nixbot-gitlab> subtest: project discovered and webhook registered1884vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1885vm-test-run-nixbot-gitlab> gitlab # [ 203.647276] gitaly[1385]: time="2026-06-30T07:58:05.244Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-30T07:58:15.045" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:05.235" grpc.time_ms=9.007 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1886vm-test-run-nixbot-gitlab> gitlab # [ 203.648777] gitaly[1385]: time="2026-06-30T07:58:05.298Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=14 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-06-30T07:58:15.083" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=226 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:05.274" grpc.time_ms=23.867 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1887vm-test-run-nixbot-gitlab> gitlab # [ 203.654167] gitaly[1385]: time="2026-06-30T07:58:05.333Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3942 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:05.332" grpc.time_ms=0.387 pid=1385 span.kind=server system=grpc1888vm-test-run-nixbot-gitlab> gitlab # [ 203.654961] gitaly[1385]: time="2026-06-30T07:58:05.355Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3944 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:05.354" grpc.time_ms=0.751 pid=1385 span.kind=server system=grpc1889vm-test-run-nixbot-gitlab> gitlab # [ 203.669165] gitaly[1385]: time="2026-06-30T07:58:05.368Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA diskcache=47e09370-ab1b-43e5-8d90-b6a2c788e7e4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-30T07:58:15.117" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:05.308" pid=1385 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1890vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.10 seconds)1891vm-test-run-nixbot-gitlab> [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-06-30T07:58:09.207Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]1892vm-test-run-nixbot-gitlab> (finished: subtest: project discovered and webhook registered, in 0.10 seconds)1893vm-test-run-nixbot-gitlab> subtest: push delivers the webhook1894vm-test-run-nixbot-gitlab> gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1895vm-test-run-nixbot-gitlab> gitlab # [ 203.740988] gitaly[1385]: time="2026-06-30T07:58:05.368Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=52 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4881 command.oublock=8 command.real_time_ms=50 command.spawn_token_fork_ms=1 command.system_time_ms=36 command.user_time_ms=16 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-30T07:58:15.117" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:05.308" grpc.time_ms=60.185 pid=1385 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1896vm-test-run-nixbot-gitlab> gitlab # [ 203.745646] nixbot[3123]: INFO: ::ffff:127.0.0.1:56260 - "GET /health HTTP/1.1" 200 OK1897vm-test-run-nixbot-gitlab> gitlab # [ 203.746561] gitaly[1385]: time="2026-06-30T07:58:05.383Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-30T07:58:15.193" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:05.383" grpc.time_ms=0.148 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1898vm-test-run-nixbot-gitlab> gitlab # [ 203.747731] gitaly[1385]: time="2026-06-30T07:58:05.397Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=937 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-06-30T07:58:15.199" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:05.389" grpc.time_ms=7.97 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1899vm-test-run-nixbot-gitlab> gitlab # [ 203.752849] gitaly[1385]: time="2026-06-30T07:58:05.454Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=339 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-06-30T07:58:35.048" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:05.448" grpc.time_ms=5.054 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1900vm-test-run-nixbot-gitlab> gitlab # [ 203.773243] gitaly[1385]: time="2026-06-30T07:58:05.471Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-06-30T07:58:15.280" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:05.471" grpc.time_ms=0.182 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1901vm-test-run-nixbot-gitlab> gitlab # [ 203.788526] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "curl/8.20.0" 581902vm-test-run-nixbot-gitlab> gitlab # [ 203.860141] gitaly[1385]: time="2026-06-30T07:58:05.477Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-06-30T07:58:15.284" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-06-30T07:58:05.474" grpc.time_ms=3.451 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1903vm-test-run-nixbot-gitlab> gitlab # [ 203.861479] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:10 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 311904vm-test-run-nixbot-gitlab> gitlab # [ 203.867206] gitaly[1385]: time="2026-06-30T07:58:05.496Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-30T07:58:15.299" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:05.490" grpc.time_ms=6.787 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1905vm-test-run-nixbot-gitlab> gitlab # [ 203.867982] gitaly[1385]: time="2026-06-30T07:58:05.506Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-30T07:58:15.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:05.500" grpc.time_ms=5.309 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1906vm-test-run-nixbot-gitlab> gitlab # [ 203.870856] gitaly[1385]: time="2026-06-30T07:58:05.524Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=963 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-06-30T07:58:35.114" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:05.514" grpc.time_ms=9.257 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1907vm-test-run-nixbot-gitlab> gitlab # [ 203.884926] gitaly[1385]: time="2026-06-30T07:58:05.801Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-06-30T07:58:15.001" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:05.791" grpc.time_ms=9.226 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1908vm-test-run-nixbot-gitlab> gitlab # [ 203.964471] gitaly[1385]: time="2026-06-30T07:58:05.889Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-06-30T13:58:05.877" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:05.877" grpc.time_ms=9.257 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1909vm-test-run-nixbot-gitlab> gitlab # [ 203.965859] gitaly[1385]: time="2026-06-30T07:58:05.928Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=653 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=27 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-06-30T07:58:35.496" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:05.897" grpc.time_ms=31.012 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1910vm-test-run-nixbot-gitlab> gitlab # [ 203.969682] gitaly[1385]: time="2026-06-30T07:58:06.089Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA diskcache=897c6510-cc13-48bd-9206-8aeb96d1e462 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-06-30T13:58:05.987" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:05.987" pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1911vm-test-run-nixbot-gitlab> gitlab # [ 203.970731] gitaly[1385]: time="2026-06-30T07:58:06.090Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1282 command.oublock=0 command.real_time_ms=96 command.spawn_token_fork_ms=75 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-06-30T13:58:05.987" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:05.987" grpc.time_ms=102.507 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1912vm-test-run-nixbot-gitlab> gitlab # [ 204.048237] gitaly[1385]: time="2026-06-30T07:58:06.166Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-06-30T07:58:36.057" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:06.158" grpc.time_ms=8.131 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1913vm-test-run-nixbot-gitlab> gitlab # [ 204.051198] gitaly[1385]: time="2026-06-30T07:58:06.219Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:36.117" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:06.218" grpc.time_ms=0.81 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1914vm-test-run-nixbot-gitlab> gitlab # [ 204.052046] gitaly[1385]: time="2026-06-30T07:58:06.229Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-06-30T07:58:16.001" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:06.221" grpc.time_ms=7.439 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1915vm-test-run-nixbot-gitlab> gitlab # [ 204.052916] gitaly[1385]: time="2026-06-30T07:58:06.324Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-30T07:58:36.222" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:06.322" grpc.time_ms=1.506 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1916vm-test-run-nixbot-gitlab> gitlab # [ 204.132155] gitaly[1385]: time="2026-06-30T07:58:06.332Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=111 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-06-30T07:58:36.227" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:06.328" grpc.time_ms=3.738 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1917vm-test-run-nixbot-gitlab> gitlab # [ 204.137252] gitaly[1385]: time="2026-06-30T07:58:06.423Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-30T07:58:16.194" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:06.415" grpc.time_ms=7.826 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1918vm-test-run-nixbot-gitlab> gitlab # [ 204.140190] gitaly[1385]: time="2026-06-30T07:58:06.938Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=966 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=23 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-06-30T07:58:36.805" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:06.905" grpc.time_ms=32.772 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1919vm-test-run-nixbot-gitlab> gitlab # [ 204.144198] gitaly[1385]: time="2026-06-30T07:58:06.953Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ2BGPD770KDNGTASH2EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-06-30T07:58:36.841" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:06.942" grpc.time_ms=10.691 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1920vm-test-run-nixbot-gitlab> gitlab # [ 204.161981] gitaly[1385]: time="2026-06-30T07:58:08.949Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=963 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=8 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ6C5FMTMKSGHBMY7JWFY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-06-30T07:58:38.031" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:08.931" grpc.time_ms=17.607 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1921vm-test-run-nixbot-gitlab> gitlab # [ 204.234270] gitaly[1385]: time="2026-06-30T07:58:10.063Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ7K199FCTWBJ9GNSEVKS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-06-30T07:58:40.053" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:10.054" grpc.time_ms=9.364 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1922vm-test-run-nixbot-gitlab> gitlab # [ 204.238254] gitaly[1385]: time="2026-06-30T07:58:10.075Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ7K199FCTWBJ9GNSEVKS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:40.073" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:10.074" grpc.time_ms=0.591 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1923vm-test-run-nixbot-gitlab> gitlab # [ 204.239739] gitaly[1385]: time="2026-06-30T07:58:10.087Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ7K199FCTWBJ9GNSEVKS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-06-30T07:58:20.008" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:10.079" grpc.time_ms=8.003 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1924vm-test-run-nixbot-gitlab> gitlab # [ 204.249836] gitaly[1385]: time="2026-06-30T07:58:10.280Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ7SNMZBJTRXE4PMGT924 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:10.270" grpc.time_ms=10.152 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc1925vm-test-run-nixbot-gitlab> gitlab # [ 204.272866] gitaly[1385]: time="2026-06-30T07:58:10.372Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ7VCAQRWMJ85JM0H20MH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:10.357" pid=1385 remote_ip="2001:db8:1::1" request_sha=083c43590fffa527704b32b8836424e8ed055017 response_bytes=149 span.kind=server system=grpc1926vm-test-run-nixbot-gitlab> gitlab # [ 204.290610] gitaly[1385]: time="2026-06-30T07:58:10.372Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ7VCAQRWMJ85JM0H20MH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:10.357" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc1927vm-test-run-nixbot-gitlab> gitlab # [ 204.310106] gitaly[1385]: time="2026-06-30T07:58:10.372Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ7VCAQRWMJ85JM0H20MH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:10.357" grpc.time_ms=15.048 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc1928vm-test-run-nixbot-gitlab> gitlab # [ 204.336194] gitaly[1385]: time="2026-06-30T07:58:10.461Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ7Y9CB20JNWFMGYYD69Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:10.438" pid=1385 remote_ip="2001:db8:1::1" request_sha=8ae11becb7595f1c1953efdcd87f385ef2467908 response_bytes=378 span.kind=server system=grpc1929vm-test-run-nixbot-gitlab> gitlab # [ 204.353256] gitaly[1385]: time="2026-06-30T07:58:10.461Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1233 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ7Y9CB20JNWFMGYYD69Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:10.438" negotiation.command=fetch negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc1930vm-test-run-nixbot-gitlab> gitlab # [ 204.427379] gitaly[1385]: time="2026-06-30T07:58:10.461Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1233 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ7Y9CB20JNWFMGYYD69Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=9 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:10.438" grpc.time_ms=23.366 negotiation.command=fetch negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc1931vm-test-run-nixbot-gitlab> gitlab # [ 204.441052] gitaly[1385]: time="2026-06-30T07:58:11.380Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=476 command.spawn_token_fork_ms=469 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ8B5C221GQ1CQVA97DNK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:10.903" grpc.time_ms=477.391 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1932vm-test-run-nixbot-gitlab> gitlab # [ 204.443218] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:11 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.54.0" 5921933vm-test-run-nixbot-gitlab> gitlab # [ 204.444466] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:11 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 8761934vm-test-run-nixbot-gitlab> gitlab # [ 204.445350] gitaly[1385]: time="2026-06-30T07:58:11.383Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=823 command.spawn_token_fork_ms=821 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ82ACSNTAR98RTR4V1T6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:10.557" grpc.time_ms=825.557 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc1935vm-test-run-nixbot-gitlab> gitlab # Enumerating objects: 5, done.1936vm-test-run-nixbot-gitlab> gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1937vm-test-run-nixbot-gitlab> gitlab # Delta compression using up to 4 threads1938vm-test-run-nixbot-gitlab> gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1939vm-test-run-nixbot-gitlab> gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 136.00 KiB/s, done.1940vm-test-run-nixbot-gitlab> gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1941vm-test-run-nixbot-gitlab> gitlab # [ 204.539306] gitaly[1385]: time="2026-06-30T07:58:11.475Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ8XSVA14VF9N6BKN0FV8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:11.467" pid=1385 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc1942vm-test-run-nixbot-gitlab> gitlab # [ 204.540346] gitlab-workhorse[1290]: time="2026-06-30T07:58:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671943vm-test-run-nixbot-gitlab> gitlab # [ 204.541815] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:11 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 901944vm-test-run-nixbot-gitlab> gitlab # [ 204.545965] gitaly[1385]: time="2026-06-30T07:58:11.475Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ8XSVA14VF9N6BKN0FV8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:11.467" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc1945vm-test-run-nixbot-gitlab> gitlab # [ 204.547049] gitaly[1385]: time="2026-06-30T07:58:11.477Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ8XSVA14VF9N6BKN0FV8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:11.467" grpc.time_ms=8.522 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc1946vm-test-run-nixbot-gitlab> gitlab # [ 204.709673] gitaly[1385]: time="2026-06-30T07:58:11.649Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ93MTQEGW6Y6EGN69M3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:41.047" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:11.648" grpc.time_ms=0.65 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1947vm-test-run-nixbot-gitlab> gitlab # [ 204.738275] gitaly[1385]: time="2026-06-30T07:58:11.677Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=4 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ93MTQEGW6Y6EGN69M3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-06-30T07:58:41.065" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:11.666" grpc.time_ms=11.115 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1948vm-test-run-nixbot-gitlab> gitlab # [ 204.757222] gitaly[1385]: time="2026-06-30T07:58:11.696Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ93MTQEGW6Y6EGN69M3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-30T07:58:21.246" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:11.687" grpc.time_ms=8.959 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1949vm-test-run-nixbot-gitlab> gitlab # [ 204.790656] gitaly[1385]: time="2026-06-30T07:58:11.730Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-06-30T07:58:21.001" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=253 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:11.722" grpc.time_ms=7.726 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1950vm-test-run-nixbot-gitlab> gitlab # [ 204.814794] gitaly[1385]: time="2026-06-30T07:58:11.754Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ93MTQEGW6Y6EGN69M3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-06-30T07:58:21.003" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:11.753" grpc.time_ms=0.224 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1951vm-test-run-nixbot-gitlab> gitlab # [ 204.830875] gitaly[1385]: time="2026-06-30T07:58:11.770Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ93MTQEGW6Y6EGN69M3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-06-30T07:58:21.012" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:11.763" grpc.time_ms=7.018 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1952vm-test-run-nixbot-gitlab> gitlab # [ 204.857540] gitaly[1385]: time="2026-06-30T07:58:11.797Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=36 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-06-30T07:58:41.752" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-06-30T07:58:11.753" grpc.time_ms=43.918 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1953vm-test-run-nixbot-gitlab> gitlab # [ 204.871862] gitaly[1385]: time="2026-06-30T07:58:11.811Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT duration_ms=137ns method=POST pid=1385 status=200 url="http://unix/api/v4/internal/allowed"1954vm-test-run-nixbot-gitlab> gitlab # [ 204.897237] gitaly[1385]: time="2026-06-30T07:58:11.836Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ93MTQEGW6Y6EGN69M3W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4159 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:11.836" grpc.time_ms=0.367 pid=1385 span.kind=server system=grpc1955vm-test-run-nixbot-gitlab> gitlab # [ 204.903595] gitaly[1385]: time="2026-06-30T07:58:11.843Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT duration_ms=29ns method=POST pid=1385 status=200 url="http://unix/api/v4/internal/pre_receive"1956vm-test-run-nixbot-gitlab> gitlab # [ 204.904831] gitaly[1385]: time="2026-06-30T07:58:11.843Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5322 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:11.673" grpc.time_ms=169.7 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1957vm-test-run-nixbot-gitlab> gitlab # [ 204.958344] gitaly[1385]: time="2026-06-30T07:58:11.897Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ93MTQEGW6Y6EGN69M3W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4161 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:11.896" grpc.time_ms=0.63 pid=1385 span.kind=server system=grpc1958vm-test-run-nixbot-gitlab> gitlab # [ 204.970672] gitaly[1385]: time="2026-06-30T07:58:11.910Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ93MTQEGW6Y6EGN69M3W diskcache=c89cd43f-e01f-4506-87c3-9a6e33685cd3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-30T07:58:21.021" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:11.772" pid=1385 ref=refs/keep-around/dfbe7ce112013e8b89cb683f585280422ae1494c remote_ip="2001:db8:1::1" revision=dfbe7ce112013e8b89cb683f585280422ae1494c span.kind=server system=grpc username=root1959vm-test-run-nixbot-gitlab> gitlab # [ 204.985968] gitaly[1385]: time="2026-06-30T07:58:11.910Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=73 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5014 command.oublock=8 command.real_time_ms=128 command.spawn_token_fork_ms=1 command.system_time_ms=42 command.user_time_ms=31 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ93MTQEGW6Y6EGN69M3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-30T07:58:21.021" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:11.772" grpc.time_ms=138.251 pid=1385 ref=refs/keep-around/dfbe7ce112013e8b89cb683f585280422ae1494c remote_ip="2001:db8:1::1" revision=dfbe7ce112013e8b89cb683f585280422ae1494c span.kind=server system=grpc username=root1960vm-test-run-nixbot-gitlab> gitlab # [ 205.020265] gitaly[1385]: time="2026-06-30T07:58:11.959Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4792 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:11.958" grpc.time_ms=0.591 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1961vm-test-run-nixbot-gitlab> gitlab # [ 205.022460] gitaly[1385]: time="2026-06-30T07:58:11.961Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ93MTQEGW6Y6EGN69M3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:41.060" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:11.961" grpc.time_ms=0.454 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1962vm-test-run-nixbot-gitlab> gitlab # [ 205.039510] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:11.976Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"64dfc458f098757731d0d72c","created_at":"2026-06-30T07:58:11.966Z","trace_propagation_headers":{"sentry-trace":"f7debc1d64e2409592748429741b53de-08aaf76532784c40","baggage":"sentry-trace_id=f7debc1d64e2409592748429741b53de,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJ93MTQEGW6Y6EGN69M3W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:11.974Z","job_size_bytes":65,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-64dfc458f098757731d0d72c: start","job_status":"start","queue_duration_s":0.002158,"scheduling_latency_s":0.002205}1963vm-test-run-nixbot-gitlab> gitlab # [ 205.109701] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:12.048Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"64dfc458f098757731d0d72c","created_at":"2026-06-30T07:58:11.966Z","trace_propagation_headers":{"sentry-trace":"f7debc1d64e2409592748429741b53de-08aaf76532784c40","baggage":"sentry-trace_id=f7debc1d64e2409592748429741b53de,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJ93MTQEGW6Y6EGN69M3W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:11.974Z","job_size_bytes":65,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-64dfc458f098757731d0d72c: done: 0.072384 sec","job_status":"done","queue_duration_s":0.002158,"scheduling_latency_s":0.002205,"redis_calls":19,"redis_duration_s":0.005233,"redis_read_bytes":145,"redis_write_bytes":2300,"redis_feature_flag_calls":11,"redis_feature_flag_duration_s":0.002787,"redis_feature_flag_read_bytes":138,"redis_feature_flag_write_bytes":1482,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001836,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00061,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000434692,"duration_s":0.072384,"completed_at":"2026-06-30T07:58:12.048Z","load_balancing_strategy":"primary","db_duration_s":0.016895,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1964vm-test-run-nixbot-gitlab> gitlab # [ 205.114359] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:12.052Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b65ce70f7ede3419bd70c174","created_at":"2026-06-30T07:58:11.977Z","trace_propagation_headers":{"sentry-trace":"f7debc1d64e2409592748429741b53de-08aaf76532784c40","baggage":"sentry-trace_id=f7debc1d64e2409592748429741b53de,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJ93MTQEGW6Y6EGN69M3W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:11.983Z","job_size_bytes":65,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b65ce70f7ede3419bd70c174: start","job_status":"start","queue_duration_s":0.068556,"scheduling_latency_s":0.06858}1965vm-test-run-nixbot-gitlab> gitlab # [ 205.137545] gitaly[1385]: time="2026-06-30T07:58:12.062Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4791 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:12.061" grpc.time_ms=0.446 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1966vm-test-run-nixbot-gitlab> gitlab # [ 205.207293] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:12.146Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b65ce70f7ede3419bd70c174","created_at":"2026-06-30T07:58:11.977Z","trace_propagation_headers":{"sentry-trace":"f7debc1d64e2409592748429741b53de-08aaf76532784c40","baggage":"sentry-trace_id=f7debc1d64e2409592748429741b53de,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJ93MTQEGW6Y6EGN69M3W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:11.983Z","job_size_bytes":65,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b65ce70f7ede3419bd70c174: done: 0.094141 sec","job_status":"done","queue_duration_s":0.068556,"scheduling_latency_s":0.06858,"redis_calls":15,"redis_duration_s":0.01041,"redis_read_bytes":142,"redis_write_bytes":1431,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.004628,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":431,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001672,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00411,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039519,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000401169,"duration_s":0.094141,"completed_at":"2026-06-30T07:58:12.146Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033381,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1967vm-test-run-nixbot-gitlab> gitlab # [ 205.298537] nixbot[3123]: {"ts": "2026-06-30T07:58:12.213Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/dfbe7ce112013e8b89cb683f585280422ae1494c \"HTTP/1.1 201 Created\""}1968vm-test-run-nixbot-gitlab> gitlab # [ 205.299338] nixbot[3123]: {"ts": "2026-06-30T07:58:12.220Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-dfbe7ce11201-8705da3d", "argv0": "bwrap"}1969vm-test-run-nixbot-gitlab> gitlab # [ 205.300329] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/dfbe7ce112013e8b89cb683f585280422ae1494c HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 6411970vm-test-run-nixbot-gitlab> gitlab # [ 205.302349] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:12.241Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"77ff72852d7b946faa717824","created_at":"2026-06-30T07:58:12.192Z","trace_propagation_headers":{"sentry-trace":"f7debc1d64e2409592748429741b53de-08aaf76532784c40","baggage":"sentry-trace_id=f7debc1d64e2409592748429741b53de,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJ93MTQEGW6Y6EGN69M3W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:12.198Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-77ff72852d7b946faa717824: start","job_status":"start","queue_duration_s":0.043487,"scheduling_latency_s":0.043533}1971vm-test-run-nixbot-gitlab> gitlab # [ 205.367874] gitaly[1385]: time="2026-06-30T07:58:12.307Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4793 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:12.304" grpc.time_ms=3.13 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1972vm-test-run-nixbot-gitlab> gitlab # [ 205.416130] gitaly[1385]: time="2026-06-30T07:58:12.353Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ93MTQEGW6Y6EGN69M3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-30T07:58:42.250" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:12.351" grpc.time_ms=1.961 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1973vm-test-run-nixbot-gitlab> gitlab # [ 205.444466] systemd[1]: Started Nix Daemon.1974vm-test-run-nixbot-gitlab> gitlab # [ 205.466232] gitaly[1385]: time="2026-06-30T07:58:12.405Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ93MTQEGW6Y6EGN69M3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:42.304" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:12.404" grpc.time_ms=0.671 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1975vm-test-run-nixbot-gitlab> gitlab # [ 205.478206] gitaly[1385]: time="2026-06-30T07:58:12.417Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT duration_ms=57ns method=POST pid=1385 status=200 url="http://unix/api/v4/internal/post_receive"1976vm-test-run-nixbot-gitlab> gitlab # [ 205.479853] gitaly[1385]: time="2026-06-30T07:58:12.417Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4816 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:12.359" grpc.time_ms=58.331 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1977vm-test-run-nixbot-gitlab> gitlab # [ 205.497555] gitaly[1385]: time="2026-06-30T07:58:12.437Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT diskcache=cb62b87d-eca1-408a-a3ab-5a5abeed26bb grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:11.602" pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1978vm-test-run-nixbot-gitlab> gitlab # [ 205.498925] gitaly[1385]: time="2026-06-30T07:58:12.437Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=363 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13340 command.oublock=32 command.real_time_ms=823 command.spawn_token_fork_ms=1 command.system_time_ms=308 command.user_time_ms=55 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:11.602" grpc.time_ms=834.882 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1979vm-test-run-nixbot-gitlab> gitlab # [ 205.500459] gitlab-workhorse[1290]: time="2026-06-30T07:58:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521980vm-test-run-nixbot-gitlab> gitlab # [ 205.501249] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:12 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 10081981vm-test-run-nixbot-gitlab> gitlab # [ 205.502109] gitaly[1385]: time="2026-06-30T07:58:12.440Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ93MTQEGW6Y6EGN69M3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:42.336" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:12.437" grpc.time_ms=1.742 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1982vm-test-run-nixbot-gitlab> gitlab # [ 205.512532] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:12.451Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"77ff72852d7b946faa717824","created_at":"2026-06-30T07:58:12.192Z","trace_propagation_headers":{"sentry-trace":"f7debc1d64e2409592748429741b53de-08aaf76532784c40","baggage":"sentry-trace_id=f7debc1d64e2409592748429741b53de,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJ93MTQEGW6Y6EGN69M3W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:12.198Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-77ff72852d7b946faa717824: done: 0.210374 sec","job_status":"done","queue_duration_s":0.043487,"scheduling_latency_s":0.043533,"gitaly_calls":3,"gitaly_duration_s":0.018339,"redis_calls":48,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.01047,"redis_read_bytes":208,"redis_write_bytes":6803,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001162,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":16,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.001673,"redis_cache_read_bytes":32,"redis_cache_write_bytes":1470,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.002037,"redis_feature_flag_read_bytes":134,"redis_feature_flag_write_bytes":992,"redis_queues_calls":2,"redis_queues_duration_s":0.000386,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.002038,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":840,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000626,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000279,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001107,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":34,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":34,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":22,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.116935,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.1784738,"duration_s":0.210374,"completed_at":"2026-06-30T07:58:12.451Z","load_balancing_strategy":"primary","db_duration_s":0.048382,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1983vm-test-run-nixbot-gitlab> gitlab # [ 205.583973] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:12.454Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"c3733f2f9a47e3e4c53f5a0f","created_at":"2026-06-30T07:58:12.327Z","trace_propagation_headers":{"sentry-trace":"f7debc1d64e2409592748429741b53de-d21103386eda423a","baggage":"sentry-trace_id=f7debc1d64e2409592748429741b53de,sentry-release=Unknown"},"correlation_id":"01KWBRJ93MTQEGW6Y6EGN69M3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:12.333Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c3733f2f9a47e3e4c53f5a0f: start","job_status":"start","queue_duration_s":0.121528,"scheduling_latency_s":0.121587}1984vm-test-run-nixbot-gitlab> gitlab # [ 205.609868] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:12.482Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"c3733f2f9a47e3e4c53f5a0f","created_at":"2026-06-30T07:58:12.327Z","trace_propagation_headers":{"sentry-trace":"f7debc1d64e2409592748429741b53de-d21103386eda423a","baggage":"sentry-trace_id=f7debc1d64e2409592748429741b53de,sentry-release=Unknown"},"correlation_id":"01KWBRJ93MTQEGW6Y6EGN69M3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:12.333Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c3733f2f9a47e3e4c53f5a0f: done: 0.027685 sec","job_status":"done","queue_duration_s":0.121528,"scheduling_latency_s":0.121587,"redis_calls":10,"redis_duration_s":0.002542,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000474,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001631,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000437,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000396978,"duration_s":0.027685,"completed_at":"2026-06-30T07:58:12.482Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002883,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1985vm-test-run-nixbot-gitlab> gitlab # To http://gitlab/root/test-flake.git1986vm-test-run-nixbot-gitlab> gitlab # dfbe7ce..57191af master -> master1987vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 2.01 seconds)1988vm-test-run-nixbot-gitlab> gitlab # [ 205.682984] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:12.483Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","dfbe7ce112013e8b89cb683f585280422ae1494c 57191af08ca8a4108f21e1e7461823d6343ee58e refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"b1df46a7bd4a82b4aa092b86","created_at":"2026-06-30T07:58:12.399Z","trace_propagation_headers":{"sentry-trace":"cbd7298c3ee34f7b8776147e7ede928d-d1495f8297f040cc","baggage":"sentry-trace_id=cbd7298c3ee34f7b8776147e7ede928d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJ8Z54GDFJDC8AR06BMMT","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:12.401Z","job_size_bytes":185,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-b1df46a7bd4a82b4aa092b86: start","job_status":"start","queue_duration_s":0.082113,"scheduling_latency_s":0.082172}1989vm-test-run-nixbot-gitlab> gitlab: must succeed: git -C /tmp/test-flake rev-parse master1990vm-test-run-nixbot-gitlab> gitlab # [ 205.754174] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:12.493Z","message":"changes: \"dfbe7ce112013e8b89cb683f585280422ae1494c 57191af08ca8a4108f21e1e7461823d6343ee58e refs/heads/master\\n\""}1991vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds)1992vm-test-run-nixbot-gitlab> gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57191af08ca8a4108f21e1e7461823d6343ee58e'1993vm-test-run-nixbot-gitlab> gitlab # [ 205.755912] gitaly[1385]: time="2026-06-30T07:58:12.513Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-30T07:58:22.286" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:12.507" grpc.time_ms=6.192 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1994vm-test-run-nixbot-gitlab> gitlab # [ 205.756481] gitaly[1385]: time="2026-06-30T07:58:12.530Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-30T07:58:22.296" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:12.517" grpc.time_ms=12.947 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1995vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57191af08ca8a4108f21e1e7461823d6343ee58e', in 0.03 seconds)1996vm-test-run-nixbot-gitlab> []1997vm-test-run-nixbot-gitlab> gitlab # [ 205.758003] gitaly[1385]: time="2026-06-30T07:58:12.558Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-06-30T07:58:22.060" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:12.550" grpc.time_ms=7.829 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1998vm-test-run-nixbot-gitlab> gitlab # [ 205.775092] gitaly[1385]: time="2026-06-30T07:58:12.701Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-06-30T07:58:42.461" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:12.561" grpc.time_ms=139.727 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1999vm-test-run-nixbot-gitlab> gitlab # [ 205.797807] gitaly[1385]: time="2026-06-30T07:58:12.724Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=343 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-06-30T07:58:22.220" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-06-30T07:58:12.710" grpc.time_ms=13.523 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2000vm-test-run-nixbot-gitlab> gitlab # [ 205.818835] gitaly[1385]: time="2026-06-30T07:58:12.745Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-30T07:58:22.244" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:12.734" grpc.time_ms=10.502 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2001vm-test-run-nixbot-gitlab> gitlab # [ 205.889491] nixbot[3123]: INFO: ::ffff:127.0.0.1:56276 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57191af08ca8a4108f21e1e7461823d6343ee58e HTTP/1.1" 200 OK2002vm-test-run-nixbot-gitlab> gitlab # [ 205.931980] nix-daemon[3376]: accepted connection from pid 3374, user nixbot2003vm-test-run-nixbot-gitlab> gitlab # [ 205.937649] nix-daemon[3376]: accepted connection from pid 3373, user nixbot2004vm-test-run-nixbot-gitlab> gitlab # [ 205.964092] gitaly[1385]: time="2026-06-30T07:58:12.903Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-06-30T07:58:22.111" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:12.901" grpc.time_ms=1.487 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2005vm-test-run-nixbot-gitlab> gitlab # [ 205.982369] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:12.921Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","dfbe7ce112013e8b89cb683f585280422ae1494c 57191af08ca8a4108f21e1e7461823d6343ee58e refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"b1df46a7bd4a82b4aa092b86","created_at":"2026-06-30T07:58:12.399Z","trace_propagation_headers":{"sentry-trace":"cbd7298c3ee34f7b8776147e7ede928d-d1495f8297f040cc","baggage":"sentry-trace_id=cbd7298c3ee34f7b8776147e7ede928d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJ8Z54GDFJDC8AR06BMMT","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-06-30T07:58:12.401Z","job_size_bytes":185,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-b1df46a7bd4a82b4aa092b86: done: 0.437821 sec","job_status":"done","queue_duration_s":0.082113,"scheduling_latency_s":0.082172,"gitaly_calls":7,"gitaly_duration_s":0.207181,"redis_calls":112,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.035983,"redis_read_bytes":350,"redis_write_bytes":13068,"redis_cache_calls":9,"redis_cache_duration_s":0.002292,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000794,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":323,"redis_queues_calls":8,"redis_queues_duration_s":0.001736,"redis_queues_read_bytes":8,"redis_queues_write_bytes":6768,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.003831,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1182,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.018921,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.008409,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":29,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":29,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.017,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.017,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.179976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000546438,"exclusive_lock_hold_duration_s":0.014879266,"duration_s":0.437821,"completed_at":"2026-06-30T07:58:12.921Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022795,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2006vm-test-run-nixbot-gitlab> gitlab # [ 206.062658] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:12.923Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"12e9fc5b923152ba48df126f","created_at":"2026-06-30T07:58:12.535Z","trace_propagation_headers":{"sentry-trace":"cbd7298c3ee34f7b8776147e7ede928d-7c7fdda0da3844f7","baggage":"sentry-trace_id=cbd7298c3ee34f7b8776147e7ede928d,sentry-release=Unknown"},"correlation_id":"01KWBRJ8Z54GDFJDC8AR06BMMT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:12.537Z","job_size_bytes":46,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-12e9fc5b923152ba48df126f: start","job_status":"start","queue_duration_s":0.38563,"scheduling_latency_s":0.385657}2007vm-test-run-nixbot-gitlab> gitlab # [ 206.063885] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:12.942Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"12e9fc5b923152ba48df126f","created_at":"2026-06-30T07:58:12.535Z","trace_propagation_headers":{"sentry-trace":"cbd7298c3ee34f7b8776147e7ede928d-7c7fdda0da3844f7","baggage":"sentry-trace_id=cbd7298c3ee34f7b8776147e7ede928d,sentry-release=Unknown"},"correlation_id":"01KWBRJ8Z54GDFJDC8AR06BMMT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:12.537Z","job_size_bytes":46,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-12e9fc5b923152ba48df126f: done: 0.019071 sec","job_status":"done","queue_duration_s":0.38563,"scheduling_latency_s":0.385657,"redis_calls":9,"redis_duration_s":0.002085,"redis_read_bytes":23,"redis_write_bytes":782,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001117,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.00026,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000708,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":304,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012148,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019071,"completed_at":"2026-06-30T07:58:12.942Z","load_balancing_strategy":"primary","db_duration_s":0.001795,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2008vm-test-run-nixbot-gitlab> gitlab # [ 206.137114] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:12.943Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"55f0af597acddf0cffb34e83","created_at":"2026-06-30T07:58:12.541Z","trace_propagation_headers":{"sentry-trace":"cbd7298c3ee34f7b8776147e7ede928d-7c7fdda0da3844f7","baggage":"sentry-trace_id=cbd7298c3ee34f7b8776147e7ede928d,sentry-release=Unknown"},"correlation_id":"01KWBRJ8Z54GDFJDC8AR06BMMT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:12.543Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-55f0af597acddf0cffb34e83: start","job_status":"start","queue_duration_s":0.400165,"scheduling_latency_s":0.400188}2009vm-test-run-nixbot-gitlab> gitlab # [ 206.138157] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:13.001Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"55f0af597acddf0cffb34e83","created_at":"2026-06-30T07:58:12.541Z","trace_propagation_headers":{"sentry-trace":"cbd7298c3ee34f7b8776147e7ede928d-7c7fdda0da3844f7","baggage":"sentry-trace_id=cbd7298c3ee34f7b8776147e7ede928d,sentry-release=Unknown"},"correlation_id":"01KWBRJ8Z54GDFJDC8AR06BMMT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:12.543Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-55f0af597acddf0cffb34e83: done: 0.057398 sec","job_status":"done","queue_duration_s":0.400165,"scheduling_latency_s":0.400188,"gitaly_calls":1,"gitaly_duration_s":0.029246,"redis_calls":12,"redis_duration_s":0.0030410000000000003,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001195,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000743,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001103,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.040831726,"duration_s":0.057398,"completed_at":"2026-06-30T07:58:13.001Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003907,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2010vm-test-run-nixbot-gitlab> gitlab # [ 206.232927] gitaly[1385]: time="2026-06-30T07:58:12.986Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT diskcache=44f848ef-1422-4748-b473-c24d6181f29a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-06-30T13:58:12.959" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:12.959" pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2011vm-test-run-nixbot-gitlab> gitlab # [ 206.234382] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:13.002Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"d6af9c17fdcfdb83f7e7abef","created_at":"2026-06-30T07:58:12.788Z","trace_propagation_headers":{"sentry-trace":"cbd7298c3ee34f7b8776147e7ede928d-7c7fdda0da3844f7","baggage":"sentry-trace_id=cbd7298c3ee34f7b8776147e7ede928d,sentry-release=Unknown"},"correlation_id":"01KWBRJ8Z54GDFJDC8AR06BMMT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dc2dbc054e8f0e57e50183d3ea95ba17a4fba1a1130ec445f0c38bd22eef315c","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:12.790Z","job_size_bytes":467,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-d6af9c17fdcfdb83f7e7abef: start","job_status":"start","queue_duration_s":0.211986,"scheduling_latency_s":0.212009}2012vm-test-run-nixbot-gitlab> gitlab # [ 206.235391] gitaly[1385]: time="2026-06-30T07:58:12.987Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=5 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1648 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-06-30T13:58:12.959" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:12.959" grpc.time_ms=26.9 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2013vm-test-run-nixbot-gitlab> gitlab # [ 206.253117] gitaly[1385]: time="2026-06-30T07:58:13.024Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:43.022" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:13.023" grpc.time_ms=0.622 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2014vm-test-run-nixbot-gitlab> gitlab # [ 206.274059] gitaly[1385]: time="2026-06-30T07:58:13.032Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-06-30T07:58:23.005" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:13.026" grpc.time_ms=6.109 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2015vm-test-run-nixbot-gitlab> gitlab # [ 206.295233] gitaly[1385]: time="2026-06-30T07:58:13.057Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-30T07:58:43.055" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:13.056" grpc.time_ms=0.742 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2016vm-test-run-nixbot-gitlab> gitlab # [ 206.315888] gitaly[1385]: time="2026-06-30T07:58:13.062Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=157 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-06-30T07:58:43.059" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:13.059" grpc.time_ms=2.077 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2017vm-test-run-nixbot-gitlab> gitlab # [ 206.341856] gitaly[1385]: time="2026-06-30T07:58:13.110Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-30T07:58:23.083" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:13.103" grpc.time_ms=6.157 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2018vm-test-run-nixbot-gitlab> gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57191af08ca8a4108f21e1e7461823d6343ee58e'2019vm-test-run-nixbot-gitlab> gitlab # [ 206.777140] gitaly[1385]: time="2026-06-30T07:58:13.716Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-06-30T07:58:43.595" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:13.695" grpc.time_ms=20.266 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2020vm-test-run-nixbot-gitlab> gitlab # [ 206.791658] gitaly[1385]: time="2026-06-30T07:58:13.731Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJ8Z54GDFJDC8AR06BMMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-06-30T07:58:43.620" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:13.721" grpc.time_ms=9.925 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2021vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57191af08ca8a4108f21e1e7461823d6343ee58e', in 0.04 seconds)2022vm-test-run-nixbot-gitlab> []2023vm-test-run-nixbot-gitlab> gitlab # [ 206.863131] sidekiq-cluster[2131]: {"severity":"WARN","time":"2026-06-30T07:58:13.801Z","class":"CreatePipelineWorker","correlation_id":"01KWBRJ8Z54GDFJDC8AR06BMMT","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"dfbe7ce112013e8b89cb683f585280422ae1494c","after":"57191af08ca8a4108f21e1e7461823d6343ee58e","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"57191af08ca8a4108f21e1e7461823d6343ee58e","ref":"refs/heads/master"},"retry":0}2024vm-test-run-nixbot-gitlab> gitlab # [ 206.864195] nixbot[3123]: INFO: ::ffff:127.0.0.1:56278 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57191af08ca8a4108f21e1e7461823d6343ee58e HTTP/1.1" 200 OK2025vm-test-run-nixbot-gitlab> gitlab # [ 206.883391] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:13.822Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"d6af9c17fdcfdb83f7e7abef","created_at":"2026-06-30T07:58:12.788Z","trace_propagation_headers":{"sentry-trace":"cbd7298c3ee34f7b8776147e7ede928d-7c7fdda0da3844f7","baggage":"sentry-trace_id=cbd7298c3ee34f7b8776147e7ede928d,sentry-release=Unknown"},"correlation_id":"01KWBRJ8Z54GDFJDC8AR06BMMT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dc2dbc054e8f0e57e50183d3ea95ba17a4fba1a1130ec445f0c38bd22eef315c","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:12.790Z","job_size_bytes":467,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-d6af9c17fdcfdb83f7e7abef: done: 0.819957 sec","job_status":"done","queue_duration_s":0.211986,"scheduling_latency_s":0.212009,"gitaly_calls":7,"gitaly_duration_s":0.063433,"redis_calls":33,"redis_duration_s":0.019042,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000971,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.014529,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002343,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001199,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":30,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.096,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":26,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.093,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.623418,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.819957,"completed_at":"2026-06-30T07:58:13.822Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.095773,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2026vm-test-run-nixbot-gitlab> gitlab # [ 206.960380] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:13.899Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"c7faee50-90aa-4002-bda2-c79b844af2fa\"}"],"class":"WebHookWorker","jid":"44838495544a61d78ab4ffe2","created_at":"2026-06-30T07:58:12.883Z","trace_propagation_headers":{"sentry-trace":"cbd7298c3ee34f7b8776147e7ede928d-7c7fdda0da3844f7","baggage":"sentry-trace_id=cbd7298c3ee34f7b8776147e7ede928d,sentry-release=Unknown"},"correlation_id":"01KWBRJ8Z54GDFJDC8AR06BMMT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:088fdec7f20a7a63e551a99554f5beec28cdbe7f308d304234769a2a5f14c2d1","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:12.890Z","job_size_bytes":1749,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-44838495544a61d78ab4ffe2: start","job_status":"start","queue_duration_s":1.008831,"scheduling_latency_s":1.008872}2027vm-test-run-nixbot-gitlab> gitlab # [ 207.057238] nixbot[3123]: INFO: ::ffff:127.0.0.1:56288 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2028vm-test-run-nixbot-gitlab> gitlab # [ 207.088627] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:14.026Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"c7faee50-90aa-4002-bda2-c79b844af2fa\"}"],"class":"WebHookWorker","jid":"44838495544a61d78ab4ffe2","created_at":"2026-06-30T07:58:12.883Z","trace_propagation_headers":{"sentry-trace":"cbd7298c3ee34f7b8776147e7ede928d-7c7fdda0da3844f7","baggage":"sentry-trace_id=cbd7298c3ee34f7b8776147e7ede928d,sentry-release=Unknown"},"correlation_id":"01KWBRJ8Z54GDFJDC8AR06BMMT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:088fdec7f20a7a63e551a99554f5beec28cdbe7f308d304234769a2a5f14c2d1","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:12.890Z","job_size_bytes":1749,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-44838495544a61d78ab4ffe2: done: 0.12692 sec","job_status":"done","queue_duration_s":1.008831,"scheduling_latency_s":1.008872,"redis_calls":19,"redis_duration_s":0.005696,"redis_read_bytes":31,"redis_write_bytes":5279,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001247,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000625,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3641,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002714,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00111,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.011418490000011161,"cpu_s":0.069311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000847594,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","duration_s":0.12692,"completed_at":"2026-06-30T07:58:14.026Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002948,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2029vm-test-run-nixbot-gitlab> gitlab # [ 207.168726] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:14.108Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","44838495544a61d78ab4ffe2"],"class":"WebHooks::LogExecutionWorker","jid":"98d613f34389caffd610cd12","created_at":"2026-06-30T07:58:14.002Z","trace_propagation_headers":{"sentry-trace":"cbd7298c3ee34f7b8776147e7ede928d-9546796d0d984770","baggage":"sentry-trace_id=cbd7298c3ee34f7b8776147e7ede928d,sentry-release=Unknown"},"correlation_id":"01KWBRJ8Z54GDFJDC8AR06BMMT","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6410d20466e22b559fbeab6eab0a466f65af23f03fd0623afa3fb45689b99826","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:14.011Z","job_size_bytes":2507,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-98d613f34389caffd610cd12: start","job_status":"start","queue_duration_s":0.095984,"scheduling_latency_s":0.096025}2030vm-test-run-nixbot-gitlab> gitlab # [ 207.264136] gitaly[1385]: time="2026-06-30T07:58:14.203Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJBGRNJE09P7SHTD7NQYT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:14.190" grpc.time_ms=12.784 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc2031vm-test-run-nixbot-gitlab> gitlab # [ 207.286933] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:14 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 1852032vm-test-run-nixbot-gitlab> gitlab # [ 207.325047] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:14.264Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","44838495544a61d78ab4ffe2"],"class":"WebHooks::LogExecutionWorker","jid":"98d613f34389caffd610cd12","created_at":"2026-06-30T07:58:14.002Z","trace_propagation_headers":{"sentry-trace":"cbd7298c3ee34f7b8776147e7ede928d-9546796d0d984770","baggage":"sentry-trace_id=cbd7298c3ee34f7b8776147e7ede928d,sentry-release=Unknown"},"correlation_id":"01KWBRJ8Z54GDFJDC8AR06BMMT","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6410d20466e22b559fbeab6eab0a466f65af23f03fd0623afa3fb45689b99826","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:14.011Z","job_size_bytes":2507,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-98d613f34389caffd610cd12: done: 0.156452 sec","job_status":"done","queue_duration_s":0.095984,"scheduling_latency_s":0.096025,"redis_calls":10,"redis_duration_s":0.002747,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00061,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001611,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000526,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.031,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.031,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000386083,"duration_s":0.156452,"completed_at":"2026-06-30T07:58:14.264Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020272,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2033vm-test-run-nixbot-gitlab> gitlab # [ 207.400739] gitaly[1385]: time="2026-06-30T07:58:14.340Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJBPRS0QQ8HBZ766KXN3X grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:14.303" pid=1385 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc2034vm-test-run-nixbot-gitlab> gitlab # [ 207.401405] gitaly[1385]: time="2026-06-30T07:58:14.340Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=33 command.spawn_token_fork_ms=27 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJBPRS0QQ8HBZ766KXN3X grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:14.303" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc2035vm-test-run-nixbot-gitlab> gitlab # [ 207.403625] gitaly[1385]: time="2026-06-30T07:58:14.341Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=33 command.spawn_token_fork_ms=27 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJBPRS0QQ8HBZ766KXN3X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:14.303" grpc.time_ms=37.574 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc2036vm-test-run-nixbot-gitlab> gitlab # [ 207.404794] gitlab-workhorse[1290]: time="2026-06-30T07:58:14Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672037vm-test-run-nixbot-gitlab> gitlab # [ 207.405902] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:14 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 1102038vm-test-run-nixbot-gitlab> gitlab # [ 207.465280] gitaly[1385]: time="2026-06-30T07:58:14.404Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJBT8SQ2PBGQ6B9GE1NQ6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:14.392" pid=1385 remote_ip="2001:db8:1::1" request_sha=ac50d3eba2de3b5e212b7c47674f896f0e4af6b9 response_bytes=385 span.kind=server system=grpc2039vm-test-run-nixbot-gitlab> gitlab # [ 207.468274] gitaly[1385]: time="2026-06-30T07:58:14.404Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1209 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJBT8SQ2PBGQ6B9GE1NQ6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:14.392" negotiation.command=fetch negotiation.haves=1 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc2040vm-test-run-nixbot-gitlab> gitlab # [ 207.469368] gitlab-workhorse[1290]: time="2026-06-30T07:58:14Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3852041vm-test-run-nixbot-gitlab> gitlab # [ 207.470121] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:14 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 385 "" "git/2.54.0" 602042vm-test-run-nixbot-gitlab> gitlab # [ 207.470964] gitaly[1385]: time="2026-06-30T07:58:14.405Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1209 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJBT8SQ2PBGQ6B9GE1NQ6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:14.392" grpc.time_ms=12.706 negotiation.command=fetch negotiation.haves=1 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc2043vm-test-run-nixbot-gitlab> gitlab # [ 207.560970] nixbot[3123]: {"ts": "2026-06-30T07:58:14.500Z", "level": "info", "logger": "nixbot.canceller", "msg": "cancelling build", "build_id": 1, "reason": "superseded"}2044vm-test-run-nixbot-gitlab> gitlab # [ 207.570932] nix-daemon[3402]: unexpected Nix daemon error: error: interrupted by the user2045vm-test-run-nixbot-gitlab> gitlab # [ 207.629591] gitaly[1385]: time="2026-06-30T07:58:14.569Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJBZB1QHAFXPV9CATZBPT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:44.567" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:14.567" grpc.time_ms=0.775 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2046vm-test-run-nixbot-gitlab> gitlab # [ 207.638966] gitaly[1385]: time="2026-06-30T07:58:14.578Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJBZY6HAM44VB36K5YDSR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:44.076" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:14.577" grpc.time_ms=0.752 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2047vm-test-run-nixbot-gitlab> gitlab # [ 207.678667] gitaly[1385]: time="2026-06-30T07:58:14.618Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJBZY6HAM44VB36K5YDSR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-30T07:58:24.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:14.610" grpc.time_ms=7.851 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2048vm-test-run-nixbot-gitlab> gitlab # [ 207.709957] gitaly[1385]: time="2026-06-30T07:58:14.649Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJBZB1QHAFXPV9CATZBPT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-06-30T07:58:44.642" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:14.642" grpc.time_ms=6.903 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2049vm-test-run-nixbot-gitlab> gitlab # [ 207.722564] gitaly[1385]: time="2026-06-30T07:58:14.662Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJBZB1QHAFXPV9CATZBPT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-30T07:58:24.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:14.656" grpc.time_ms=5.254 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2050vm-test-run-nixbot-gitlab> gitlab # [ 207.742107] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:14.679Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"c2ef9c1b8850c1a40208c952","created_at":"2026-06-30T07:58:14.674Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-e2781f37828e4f57","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:14.678Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c2ef9c1b8850c1a40208c952: start","job_status":"start","queue_duration_s":0.001552,"scheduling_latency_s":0.001592}2051vm-test-run-nixbot-gitlab> gitlab # [ 207.754121] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:14 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/dfbe7ce112013e8b89cb683f585280422ae1494c HTTP/1.1" 201 651 "" "python-httpx/0.28.1" 1642052vm-test-run-nixbot-gitlab> gitlab # [ 207.755169] nixbot[3123]: {"ts": "2026-06-30T07:58:14.693Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/dfbe7ce112013e8b89cb683f585280422ae1494c \"HTTP/1.1 201 Created\""}2053vm-test-run-nixbot-gitlab> gitlab # [ 207.780518] gitaly[1385]: time="2026-06-30T07:58:14.719Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJBZB1QHAFXPV9CATZBPT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-06-30T07:58:24.069" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:14.719" grpc.time_ms=0.212 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2054vm-test-run-nixbot-gitlab> gitlab # [ 207.792476] gitaly[1385]: time="2026-06-30T07:58:14.732Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJBZB1QHAFXPV9CATZBPT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-06-30T07:58:24.004" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:14.725" grpc.time_ms=6.784 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2055vm-test-run-nixbot-gitlab> gitlab # [ 207.814526] gitaly[1385]: time="2026-06-30T07:58:14.754Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJC5BXCGEJSWVG8RE04RV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:44.252" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:14.752" grpc.time_ms=1.09 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2056vm-test-run-nixbot-gitlab> gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57191af08ca8a4108f21e1e7461823d6343ee58e'2057vm-test-run-nixbot-gitlab> gitlab # [ 207.846258] gitaly[1385]: time="2026-06-30T07:58:14.785Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJC5BXCGEJSWVG8RE04RV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-30T07:58:24.178" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:14.779" grpc.time_ms=6.356 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2058vm-test-run-nixbot-gitlab> gitlab # [ 207.870342] gitaly[1385]: time="2026-06-30T07:58:14.796Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJBZY6HAM44VB36K5YDSR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:14.794" grpc.time_ms=1.247 pid=1385 span.kind=server system=grpc2059vm-test-run-nixbot-gitlab> gitlab # [ 207.888452] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:14 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/dfbe7ce112013e8b89cb683f585280422ae1494c HTTP/1.1" 201 665 "" "python-httpx/0.28.1" 1262060vm-test-run-nixbot-gitlab> gitlab # [ 207.893236] nixbot[3123]: {"ts": "2026-06-30T07:58:14.828Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/dfbe7ce112013e8b89cb683f585280422ae1494c \"HTTP/1.1 201 Created\""}2061vm-test-run-nixbot-gitlab> gitlab # [ 207.898221] gitaly[1385]: time="2026-06-30T07:58:14.833Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJBZB1QHAFXPV9CATZBPT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4159 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:14.833" grpc.time_ms=0.36 pid=1385 span.kind=server system=grpc2062vm-test-run-nixbot-gitlab> gitlab # [ 207.913979] nixbot[3123]: INFO: ::ffff:127.0.0.1:56294 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57191af08ca8a4108f21e1e7461823d6343ee58e HTTP/1.1" 200 OK2063vm-test-run-nixbot-gitlab> gitlab # [ 207.917467] gitaly[1385]: time="2026-06-30T07:58:14.856Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJBZB1QHAFXPV9CATZBPT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4161 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:14.856" grpc.time_ms=0.299 pid=1385 span.kind=server system=grpc2064vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57191af08ca8a4108f21e1e7461823d6343ee58e', in 0.07 seconds)2065vm-test-run-nixbot-gitlab> [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '57191af08ca8a4108f21e1e7461823d6343ee58e', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-06-30T07:58:14.492452Z', 'started_at': None, 'finished_at': None}]2066vm-test-run-nixbot-gitlab> (finished: subtest: push delivers the webhook, in 4.17 seconds)2067vm-test-run-nixbot-gitlab> subtest: eval and build post commit statuses2068vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses2069vm-test-run-nixbot-gitlab> gitlab # [ 207.934600] gitaly[1385]: time="2026-06-30T07:58:14.874Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJBZB1QHAFXPV9CATZBPT diskcache=7d6e2559-8f73-493c-ba87-fdc9e435b2df grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-30T07:58:24.015" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:14.735" pid=1385 ref=refs/keep-around/57191af08ca8a4108f21e1e7461823d6343ee58e remote_ip="2001:db8:1::1" revision=57191af08ca8a4108f21e1e7461823d6343ee58e span.kind=server system=grpc username=root2070vm-test-run-nixbot-gitlab> gitlab # [ 207.953058] gitaly[1385]: time="2026-06-30T07:58:14.874Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=57 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5136 command.oublock=8 command.real_time_ms=124 command.spawn_token_fork_ms=0 command.system_time_ms=37 command.user_time_ms=20 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJBZB1QHAFXPV9CATZBPT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-30T07:58:24.015" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-30T07:58:14.735" grpc.time_ms=138.989 pid=1385 ref=refs/keep-around/57191af08ca8a4108f21e1e7461823d6343ee58e remote_ip="2001:db8:1::1" revision=57191af08ca8a4108f21e1e7461823d6343ee58e span.kind=server system=grpc username=root2071vm-test-run-nixbot-gitlab> gitlab # [ 207.966228] gitaly[1385]: time="2026-06-30T07:58:14.880Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJBZB1QHAFXPV9CATZBPT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:44.877" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:14.878" grpc.time_ms=1.071 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2072vm-test-run-nixbot-gitlab> gitlab # [ 208.007053] gitaly[1385]: time="2026-06-30T07:58:14.944Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJBZY6HAM44VB36K5YDSR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3901 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:14.944" grpc.time_ms=0.432 pid=1385 span.kind=server system=grpc2073vm-test-run-nixbot-gitlab> gitlab # [ 208.055399] gitaly[1385]: time="2026-06-30T07:58:14.994Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJBZY6HAM44VB36K5YDSR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:14.993" grpc.time_ms=0.43 pid=1385 span.kind=server system=grpc2074vm-test-run-nixbot-gitlab> gitlab # [ 208.076291] gitaly[1385]: time="2026-06-30T07:58:15.015Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJCDN4WEP1HN0WW1FDRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:45.014" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:15.014" grpc.time_ms=0.608 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2075vm-test-run-nixbot-gitlab> gitlab # [ 208.081722] gitaly[1385]: time="2026-06-30T07:58:15.021Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJBZY6HAM44VB36K5YDSR diskcache=d0578c82-5df1-410a-a95f-24f20a68d8dc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-30T07:58:44.667" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:14.767" pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2076vm-test-run-nixbot-gitlab> gitlab # [ 208.082803] gitaly[1385]: time="2026-06-30T07:58:15.021Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=200 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7160 command.oublock=0 command.real_time_ms=244 command.spawn_token_fork_ms=0 command.system_time_ms=174 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJBZY6HAM44VB36K5YDSR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-30T07:58:44.667" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:14.767" grpc.time_ms=253.819 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2077vm-test-run-nixbot-gitlab> gitlab # [ 208.098232] nixbot[3123]: {"ts": "2026-06-30T07:58:15.037Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/57191af08ca8a4108f21e1e7461823d6343ee58e \"HTTP/1.1 201 Created\""}2078vm-test-run-nixbot-gitlab> gitlab # [ 208.099756] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:15 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/57191af08ca8a4108f21e1e7461823d6343ee58e HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 5322079vm-test-run-nixbot-gitlab> gitlab # [ 208.105225] nixbot[3123]: {"ts": "2026-06-30T07:58:15.044Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-57191af08ca8-be0cfd65", "argv0": "bwrap"}2080vm-test-run-nixbot-gitlab> gitlab # [ 208.152346] gitaly[1385]: time="2026-06-30T07:58:15.091Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJBZY6HAM44VB36K5YDSR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-30T07:58:45.090" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:15.090" grpc.time_ms=0.746 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2081vm-test-run-nixbot-gitlab> gitlab # [ 208.182454] gitaly[1385]: time="2026-06-30T07:58:15.122Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJBZY6HAM44VB36K5YDSR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:45.017" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:15.117" grpc.time_ms=4.037 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2082vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses, in 0.27 seconds)2083vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '57191af08ca8a4108f21e1e7461823d6343ee58e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-06-30T07:58:15.008Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2084vm-test-run-nixbot-gitlab> gitlab # [ 208.202463] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:15 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1632085vm-test-run-nixbot-gitlab> gitlab # [ 208.228949] gitaly[1385]: time="2026-06-30T07:58:15.168Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJBZY6HAM44VB36K5YDSR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:45.067" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:15.167" grpc.time_ms=0.754 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2086vm-test-run-nixbot-gitlab> gitlab # [ 208.239486] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.178Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"89bfbec4716d624571dd3df0","created_at":"2026-06-30T07:58:15.176Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"c2ef9c1b8850c1a40208c952","job_size_bytes":3,"pid":2131,"job_status":"deduplicated","message":"PipelineProcessWorker JID-89bfbec4716d624571dd3df0: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2087vm-test-run-nixbot-gitlab> gitlab # [ 208.241940] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.181Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"c2ef9c1b8850c1a40208c952","created_at":"2026-06-30T07:58:14.674Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-e2781f37828e4f57","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:14.678Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2131,"job_status":"rescheduled","message":"PipelineProcessWorker JID-c2ef9c1b8850c1a40208c952: rescheduled"}2088vm-test-run-nixbot-gitlab> gitlab # [ 208.248753] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.188Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"c2ef9c1b8850c1a40208c952","created_at":"2026-06-30T07:58:14.674Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-e2781f37828e4f57","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:14.678Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c2ef9c1b8850c1a40208c952: done: 0.508624 sec","job_status":"done","queue_duration_s":0.001552,"scheduling_latency_s":0.001592,"gitaly_calls":4,"gitaly_duration_s":0.278859,"redis_calls":104,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.023362,"redis_read_bytes":267,"redis_write_bytes":24007,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001124,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":17,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.00189,"redis_cache_read_bytes":33,"redis_cache_write_bytes":1526,"redis_feature_flag_calls":22,"redis_feature_flag_duration_s":0.005473,"redis_feature_flag_read_bytes":22,"redis_feature_flag_write_bytes":3871,"redis_queues_calls":22,"redis_queues_duration_s":0.003545,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12386,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.005887,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000246,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00089,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003183,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":850,"db_count":47,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.015,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.018,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.026,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.157983,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.470563437,"duration_s":0.508624,"completed_at":"2026-06-30T07:58:15.188Z","load_balancing_strategy":"primary","db_duration_s":0.053348,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2089vm-test-run-nixbot-gitlab> gitlab # [ 208.337750] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.195Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"3c678a47e4fca37f43e021b1","created_at":"2026-06-30T07:58:14.755Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:14.759Z","job_size_bytes":23,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-3c678a47e4fca37f43e021b1: start","job_status":"start","queue_duration_s":0.435857,"scheduling_latency_s":0.43588}2090vm-test-run-nixbot-gitlab> gitlab # [ 208.345329] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.284Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"3c678a47e4fca37f43e021b1","created_at":"2026-06-30T07:58:14.755Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:14.759Z","job_size_bytes":23,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-3c678a47e4fca37f43e021b1: done: 0.089661 sec","job_status":"done","queue_duration_s":0.435857,"scheduling_latency_s":0.43588,"redis_calls":15,"redis_duration_s":0.008446,"redis_read_bytes":13,"redis_write_bytes":3012,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000513,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_calls":2,"redis_queues_duration_s":0.001096,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1627,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003886,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":742,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000513,"redis_rate_limiting_write_bytes":148,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002438,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":13,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":13,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062197,"worker_id":"sidekiq_0","rate_limiting_gates":["permanent_email_failure","temporary_email_failure"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000345295,"duration_s":0.089661,"completed_at":"2026-06-30T07:58:15.284Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011278,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2091vm-test-run-nixbot-gitlab> gitlab # [ 208.416128] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.286Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"c11da49da7583a257927d266","created_at":"2026-06-30T07:58:15.274Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-ab4f1b1841ec41c0","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineNotificationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:b7d1f2d061d7cdf52f2d5ae567a3ca0b74b4fba83862ca88fcd24df5c1ca891a","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.278Z","job_size_bytes":464,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-c11da49da7583a257927d266: start","job_status":"start","queue_duration_s":0.008674,"scheduling_latency_s":0.008696}2092vm-test-run-nixbot-gitlab> gitlab # [ 208.435156] sidekiq-cluster[2131]: {"severity":"WARN","time":"2026-06-30T07:58:15.318Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"c11da49da7583a257927d266","created_at":"2026-06-30T07:58:15.274Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-ab4f1b1841ec41c0","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineNotificationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:b7d1f2d061d7cdf52f2d5ae567a3ca0b74b4fba83862ca88fcd24df5c1ca891a","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.278Z","job_size_bytes":464,"pid":2131,"sidekiq_tid":"m2vb","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-c11da49da7583a257927d266: fail: 0.031533 sec","job_status":"fail","queue_duration_s":0.008674,"scheduling_latency_s":0.008696,"redis_calls":7,"redis_duration_s":0.00236,"redis_read_bytes":5,"redis_write_bytes":786,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001095,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001265,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031533,"completed_at":"2026-06-30T07:58:15.318Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/pipelines.rb:33:in `pipeline_mail'","app/mailers/emails/pipelines.rb:10:in `pipeline_failed_email'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/abbaw4w9gll6p923md75p3h3rrmhrdqn-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/bqz31s23z0jk4464lbybyz83ikl0gmyd-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/wp2rnxa243q2gn2f8h04d48hnvfr0387-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/85h4805ad7n5qn7wq2m6icypga7rnk80-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.004486,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2093vm-test-run-nixbot-gitlab> gitlab # [ 209.097573] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.321Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"17cee25f1c0886ca02671ff6","created_at":"2026-06-30T07:58:14.885Z","trace_propagation_headers":{"sentry-trace":"fc56649f9502474c89c6e9eedfd3931e-f2bcb04ed28b4584","baggage":"sentry-trace_id=fc56649f9502474c89c6e9eedfd3931e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJBZB1QHAFXPV9CATZBPT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:14.888Z","job_size_bytes":65,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-17cee25f1c0886ca02671ff6: start","job_status":"start","queue_duration_s":0.432829,"scheduling_latency_s":0.432869}2094vm-test-run-nixbot-gitlab> gitlab # [ 209.099535] nix-daemon[3376]: accepted connection from pid 3529, user nixbot2095vm-test-run-nixbot-gitlab> gitlab # [ 209.100718] nix-daemon[3376]: accepted connection from pid 3531, user nixbot2096vm-test-run-nixbot-gitlab> gitlab # [ 209.102213] gitaly[1385]: time="2026-06-30T07:58:15.572Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJBZB1QHAFXPV9CATZBPT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-30T07:58:45.470" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:15.570" grpc.time_ms=1.281 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2097vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses2098vm-test-run-nixbot-gitlab> gitlab # [ 209.103161] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.469Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"17cee25f1c0886ca02671ff6","created_at":"2026-06-30T07:58:14.885Z","trace_propagation_headers":{"sentry-trace":"fc56649f9502474c89c6e9eedfd3931e-f2bcb04ed28b4584","baggage":"sentry-trace_id=fc56649f9502474c89c6e9eedfd3931e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJBZB1QHAFXPV9CATZBPT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:14.888Z","job_size_bytes":65,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-17cee25f1c0886ca02671ff6: done: 0.148586 sec","job_status":"done","queue_duration_s":0.432829,"scheduling_latency_s":0.432869,"redis_calls":7,"redis_duration_s":0.0030340000000000002,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002523,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000511,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.124,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.123,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.148586,"completed_at":"2026-06-30T07:58:15.469Z","load_balancing_strategy":"primary","db_duration_s":0.123663,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2099vm-test-run-nixbot-gitlab> gitlab # [ 209.218081] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.471Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"627d8af2d4de014e8a3bd6eb","created_at":"2026-06-30T07:58:14.889Z","trace_propagation_headers":{"sentry-trace":"fc56649f9502474c89c6e9eedfd3931e-f2bcb04ed28b4584","baggage":"sentry-trace_id=fc56649f9502474c89c6e9eedfd3931e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJBZB1QHAFXPV9CATZBPT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:14.891Z","job_size_bytes":65,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-627d8af2d4de014e8a3bd6eb: start","job_status":"start","queue_duration_s":0.580303,"scheduling_latency_s":0.580332}2100vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses, in 0.09 seconds)2101vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '57191af08ca8a4108f21e1e7461823d6343ee58e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-06-30T07:58:15.008Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2102vm-test-run-nixbot-gitlab> gitlab # [ 209.219099] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.518Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"627d8af2d4de014e8a3bd6eb","created_at":"2026-06-30T07:58:14.889Z","trace_propagation_headers":{"sentry-trace":"fc56649f9502474c89c6e9eedfd3931e-f2bcb04ed28b4584","baggage":"sentry-trace_id=fc56649f9502474c89c6e9eedfd3931e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJBZB1QHAFXPV9CATZBPT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:14.891Z","job_size_bytes":65,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-627d8af2d4de014e8a3bd6eb: done: 0.047224 sec","job_status":"done","queue_duration_s":0.580303,"scheduling_latency_s":0.580332,"redis_calls":10,"redis_duration_s":0.002434,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001207,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001227,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047224,"completed_at":"2026-06-30T07:58:15.518Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011192,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2103vm-test-run-nixbot-gitlab> gitlab # [ 209.295407] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.520Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"efea7f14243f20447c4f1ed2","created_at":"2026-06-30T07:58:15.016Z","trace_propagation_headers":{"sentry-trace":"fc56649f9502474c89c6e9eedfd3931e-f2bcb04ed28b4584","baggage":"sentry-trace_id=fc56649f9502474c89c6e9eedfd3931e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJBZB1QHAFXPV9CATZBPT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.020Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-efea7f14243f20447c4f1ed2: start","job_status":"start","queue_duration_s":0.499338,"scheduling_latency_s":0.499362}2104vm-test-run-nixbot-gitlab> gitlab # [ 209.296399] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.637Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"efea7f14243f20447c4f1ed2","created_at":"2026-06-30T07:58:15.016Z","trace_propagation_headers":{"sentry-trace":"fc56649f9502474c89c6e9eedfd3931e-f2bcb04ed28b4584","baggage":"sentry-trace_id=fc56649f9502474c89c6e9eedfd3931e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJBZB1QHAFXPV9CATZBPT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.020Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-efea7f14243f20447c4f1ed2: done: 0.117334 sec","job_status":"done","queue_duration_s":0.499338,"scheduling_latency_s":0.499362,"gitaly_calls":3,"gitaly_duration_s":0.00939,"redis_calls":44,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.008066,"redis_read_bytes":99,"redis_write_bytes":6014,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001005,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.00212,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_queues_calls":2,"redis_queues_duration_s":0.000292,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001745,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000276,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000669,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":31,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":31,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":19,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080515,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.097740914,"duration_s":0.117334,"completed_at":"2026-06-30T07:58:15.637Z","load_balancing_strategy":"primary","db_duration_s":0.025956,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2105vm-test-run-nixbot-gitlab> gitlab # [ 209.413443] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.639Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"93363f5c0879b2aaef602f83","created_at":"2026-06-30T07:58:15.027Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.032Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-93363f5c0879b2aaef602f83: start","job_status":"start","queue_duration_s":0.607182,"scheduling_latency_s":0.607229}2106vm-test-run-nixbot-gitlab> gitlab # [ 209.414388] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.666Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"93363f5c0879b2aaef602f83","created_at":"2026-06-30T07:58:15.027Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.032Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-93363f5c0879b2aaef602f83: done: 0.026883 sec","job_status":"done","queue_duration_s":0.607182,"scheduling_latency_s":0.607229,"redis_calls":10,"redis_duration_s":0.002296,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000463,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001359,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015888,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000398654,"duration_s":0.026883,"completed_at":"2026-06-30T07:58:15.666Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003495,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2107vm-test-run-nixbot-gitlab> gitlab # [ 209.516499] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.667Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"bfacb3f722e998e7ccb1372f","created_at":"2026-06-30T07:58:15.042Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.047Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-bfacb3f722e998e7ccb1372f: start","job_status":"start","queue_duration_s":0.620324,"scheduling_latency_s":0.620345}2108vm-test-run-nixbot-gitlab> gitlab # [ 209.518074] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.694Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"bfacb3f722e998e7ccb1372f","created_at":"2026-06-30T07:58:15.042Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.047Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-bfacb3f722e998e7ccb1372f: done: 0.026716 sec","job_status":"done","queue_duration_s":0.620324,"scheduling_latency_s":0.620345,"redis_calls":10,"redis_duration_s":0.002316,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000429,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001437,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00045,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000359823,"duration_s":0.026716,"completed_at":"2026-06-30T07:58:15.694Z","load_balancing_strategy":"primary","db_duration_s":0.005031,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2109vm-test-run-nixbot-gitlab> gitlab # [ 209.589384] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.695Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"d585c1cd74c4862ebb0e2f81","created_at":"2026-06-30T07:58:15.061Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.066Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-d585c1cd74c4862ebb0e2f81: start","job_status":"start","queue_duration_s":0.629511,"scheduling_latency_s":0.629532}2110vm-test-run-nixbot-gitlab> gitlab # [ 209.590681] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.721Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"d585c1cd74c4862ebb0e2f81","created_at":"2026-06-30T07:58:15.061Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.066Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-d585c1cd74c4862ebb0e2f81: done: 0.025499 sec","job_status":"done","queue_duration_s":0.629511,"scheduling_latency_s":0.629532,"redis_calls":13,"redis_duration_s":0.003048,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00045,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001398,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000706,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000494,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000351162,"duration_s":0.025499,"completed_at":"2026-06-30T07:58:15.721Z","load_balancing_strategy":"primary","db_duration_s":0.003189,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2111vm-test-run-nixbot-gitlab> gitlab # [ 209.683167] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.723Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"1503676c6f10c969cb4eb5d0","created_at":"2026-06-30T07:58:15.067Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.070Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-1503676c6f10c969cb4eb5d0: start","job_status":"start","queue_duration_s":0.653038,"scheduling_latency_s":0.653081}2112vm-test-run-nixbot-gitlab> gitlab # [ 209.684694] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.749Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"1503676c6f10c969cb4eb5d0","created_at":"2026-06-30T07:58:15.067Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.070Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-1503676c6f10c969cb4eb5d0: done: 0.026134 sec","job_status":"done","queue_duration_s":0.653038,"scheduling_latency_s":0.653081,"redis_calls":10,"redis_duration_s":0.002492,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000486,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001483,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000523,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000359543,"duration_s":0.026134,"completed_at":"2026-06-30T07:58:15.749Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00332,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2113vm-test-run-nixbot-gitlab> gitlab # [ 209.772955] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.750Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f9f059e071986d67af5ca15a","created_at":"2026-06-30T07:58:15.070Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.074Z","job_size_bytes":19,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f9f059e071986d67af5ca15a: start","job_status":"start","queue_duration_s":0.676122,"scheduling_latency_s":0.676144}2114vm-test-run-nixbot-gitlab> gitlab # [ 209.774075] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.774Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f9f059e071986d67af5ca15a","created_at":"2026-06-30T07:58:15.070Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.074Z","job_size_bytes":19,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f9f059e071986d67af5ca15a: done: 0.023783 sec","job_status":"done","queue_duration_s":0.676122,"scheduling_latency_s":0.676144,"redis_calls":11,"redis_duration_s":0.002546,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000439,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00165,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000457,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000334959,"duration_s":0.023783,"completed_at":"2026-06-30T07:58:15.774Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003005,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2115vm-test-run-nixbot-gitlab> gitlab # [ 209.851083] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.775Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"failed\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"2ffaa0b7623f08a45af31958","created_at":"2026-06-30T07:58:15.077Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2e8f76273ed3dffe93170e4a8828cd9c1cde36f18ce9deaf751670cff2f2dad","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.080Z","job_size_bytes":65,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-2ffaa0b7623f08a45af31958: start","job_status":"start","queue_duration_s":0.695399,"scheduling_latency_s":0.695419}2116vm-test-run-nixbot-gitlab> gitlab # [ 209.922827] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.797Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"failed\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"2ffaa0b7623f08a45af31958","created_at":"2026-06-30T07:58:15.077Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2e8f76273ed3dffe93170e4a8828cd9c1cde36f18ce9deaf751670cff2f2dad","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.080Z","job_size_bytes":65,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-2ffaa0b7623f08a45af31958: done: 0.022032 sec","job_status":"done","queue_duration_s":0.695399,"scheduling_latency_s":0.695419,"redis_calls":10,"redis_duration_s":0.002353,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000469,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001444,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00044,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037407,"duration_s":0.022032,"completed_at":"2026-06-30T07:58:15.797Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003124,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2117vm-test-run-nixbot-gitlab> gitlab # [ 209.930347] gitaly[1385]: time="2026-06-30T07:58:15.597Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJBZB1QHAFXPV9CATZBPT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:45.495" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:15.596" grpc.time_ms=0.688 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2118vm-test-run-nixbot-gitlab> gitlab # [ 210.000408] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 522119vm-test-run-nixbot-gitlab> gitlab # [ 210.001336] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.799Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"5c667499e07cb75b52fe704e","created_at":"2026-06-30T07:58:15.081Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.082Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5c667499e07cb75b52fe704e: start","job_status":"start","queue_duration_s":0.716429,"scheduling_latency_s":0.716448}2120vm-test-run-nixbot-gitlab> gitlab # [ 210.002387] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.881Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"5c667499e07cb75b52fe704e","created_at":"2026-06-30T07:58:15.081Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.082Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5c667499e07cb75b52fe704e: done: 0.082595 sec","job_status":"done","queue_duration_s":0.716429,"scheduling_latency_s":0.716448,"redis_calls":7,"redis_duration_s":0.001886,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001392,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000494,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.082595,"completed_at":"2026-06-30T07:58:15.881Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003302,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2121vm-test-run-nixbot-gitlab> gitlab # [ 210.075361] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.883Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"20c849bca70dcd4794ea85a8","created_at":"2026-06-30T07:58:15.128Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.133Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-20c849bca70dcd4794ea85a8: start","job_status":"start","queue_duration_s":0.749792,"scheduling_latency_s":0.749823}2122vm-test-run-nixbot-gitlab> gitlab # [ 210.076848] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.925Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"20c849bca70dcd4794ea85a8","created_at":"2026-06-30T07:58:15.128Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.133Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-20c849bca70dcd4794ea85a8: done: 0.04173 sec","job_status":"done","queue_duration_s":0.749792,"scheduling_latency_s":0.749823,"redis_calls":10,"redis_duration_s":0.004824,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001876,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00247,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000478,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000376025,"duration_s":0.04173,"completed_at":"2026-06-30T07:58:15.925Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009975,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2123vm-test-run-nixbot-gitlab> gitlab # [ 210.148903] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.926Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"613633307a99b7ed7b9766a6","created_at":"2026-06-30T07:58:15.134Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.137Z","job_size_bytes":6,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-613633307a99b7ed7b9766a6: start","job_status":"start","queue_duration_s":0.78917,"scheduling_latency_s":0.789192}2124vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses2125vm-test-run-nixbot-gitlab> gitlab # [ 210.162118] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.948Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"613633307a99b7ed7b9766a6","created_at":"2026-06-30T07:58:15.134Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.137Z","job_size_bytes":6,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-613633307a99b7ed7b9766a6: done: 0.022219 sec","job_status":"done","queue_duration_s":0.78917,"scheduling_latency_s":0.789192,"redis_calls":10,"redis_duration_s":0.002549,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000509,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001385,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000655,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000384966,"duration_s":0.022219,"completed_at":"2026-06-30T07:58:15.948Z","load_balancing_strategy":"primary","db_duration_s":0.001836,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2126vm-test-run-nixbot-gitlab> gitlab # [ 210.249373] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:15.950Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"5d1fbca9db7b62863b9f5652","created_at":"2026-06-30T07:58:15.182Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.184Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5d1fbca9db7b62863b9f5652: start","job_status":"start","queue_duration_s":0.766232,"scheduling_latency_s":0.766252}2127vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses, in 0.10 seconds)2128vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '57191af08ca8a4108f21e1e7461823d6343ee58e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-06-30T07:58:15.008Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2129vm-test-run-nixbot-gitlab> gitlab # [ 210.318362] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:16.025Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"5d1fbca9db7b62863b9f5652","created_at":"2026-06-30T07:58:15.182Z","trace_propagation_headers":{"sentry-trace":"cd31511464e64ead8fd219601f7bc4d9-bac859cc66cc4d89","baggage":"sentry-trace_id=cd31511464e64ead8fd219601f7bc4d9,sentry-release=Unknown"},"correlation_id":"01KWBRJBZY6HAM44VB36K5YDSR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.184Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5d1fbca9db7b62863b9f5652: done: 0.075214 sec","job_status":"done","queue_duration_s":0.766232,"scheduling_latency_s":0.766252,"gitaly_calls":2,"gitaly_duration_s":0.007952,"redis_calls":19,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.003348,"redis_read_bytes":42,"redis_write_bytes":1891,"redis_cache_calls":8,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000655,"redis_cache_read_bytes":16,"redis_cache_write_bytes":735,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001435,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000237,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":20,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":20,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":9,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05226,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.053825835,"duration_s":0.075214,"completed_at":"2026-06-30T07:58:16.025Z","load_balancing_strategy":"primary","db_duration_s":0.012559,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2130vm-test-run-nixbot-gitlab> gitlab # [ 210.325375] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:16.027Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"435a38dd1a44a92076772903","created_at":"2026-06-30T07:58:15.560Z","trace_propagation_headers":{"sentry-trace":"fc56649f9502474c89c6e9eedfd3931e-2a91588596c14aff","baggage":"sentry-trace_id=fc56649f9502474c89c6e9eedfd3931e,sentry-release=Unknown"},"correlation_id":"01KWBRJBZB1QHAFXPV9CATZBPT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.562Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-435a38dd1a44a92076772903: start","job_status":"start","queue_duration_s":0.464892,"scheduling_latency_s":0.464915}2131vm-test-run-nixbot-gitlab> gitlab # [ 210.351231] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:16.054Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"435a38dd1a44a92076772903","created_at":"2026-06-30T07:58:15.560Z","trace_propagation_headers":{"sentry-trace":"fc56649f9502474c89c6e9eedfd3931e-2a91588596c14aff","baggage":"sentry-trace_id=fc56649f9502474c89c6e9eedfd3931e,sentry-release=Unknown"},"correlation_id":"01KWBRJBZB1QHAFXPV9CATZBPT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:15.562Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-435a38dd1a44a92076772903: done: 0.027194 sec","job_status":"done","queue_duration_s":0.464892,"scheduling_latency_s":0.464915,"redis_calls":7,"redis_duration_s":0.001656,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001183,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000473,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027194,"completed_at":"2026-06-30T07:58:16.054Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002687,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2132vm-test-run-nixbot-gitlab> gitlab # [ 210.441773] gitaly[1385]: time="2026-06-30T07:58:15.627Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJBZB1QHAFXPV9CATZBPT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:45.526" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:15.627" grpc.time_ms=0.597 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2133vm-test-run-nixbot-gitlab> gitlab # [ 210.442863] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 582134vm-test-run-nixbot-gitlab> gitlab # [ 210.443707] gitaly[1385]: time="2026-06-30T07:58:15.986Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJBZY6HAM44VB36K5YDSR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-30T07:58:45.885" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:15.985" grpc.time_ms=0.754 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2135vm-test-run-nixbot-gitlab> gitlab # [ 210.522073] gitaly[1385]: time="2026-06-30T07:58:16.015Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJBZY6HAM44VB36K5YDSR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:46.014" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:16.014" grpc.time_ms=0.692 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2136vm-test-run-nixbot-gitlab> gitlab # [ 210.523355] gitaly[1385]: time="2026-06-30T07:58:16.211Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJDKGA3E6YQF23PA95BNX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:46.210" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:16.210" grpc.time_ms=0.719 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2137vm-test-run-nixbot-gitlab> gitlab # [ 210.524219] gitaly[1385]: time="2026-06-30T07:58:17.308Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJENPXY5XF0TWJKPZ4X6G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:47.306" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:17.307" grpc.time_ms=0.715 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2138vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses2139vm-test-run-nixbot-gitlab> gitlab # [ 211.508639] gitaly[1385]: time="2026-06-30T07:58:18.447Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJFR8JXSTWXA6Q5VHAJZ0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:48.444" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:18.445" grpc.time_ms=1.19 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2140vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses, in 0.17 seconds)2141vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '57191af08ca8a4108f21e1e7461823d6343ee58e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-06-30T07:58:15.008Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2142vm-test-run-nixbot-gitlab> gitlab # [ 211.558607] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 972143vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses2144vm-test-run-nixbot-gitlab> gitlab # [ 212.674929] gitaly[1385]: time="2026-06-30T07:58:19.613Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJGWJNQDEWBZYPYK1Q15A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:49.611" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:19.612" grpc.time_ms=1.277 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2145vm-test-run-nixbot-gitlab> gitlab # [ 212.762345] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1612146vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses, in 0.22 seconds)2147vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '57191af08ca8a4108f21e1e7461823d6343ee58e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-06-30T07:58:15.008Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2148vm-test-run-nixbot-gitlab> gitlab # [ 212.876671] nix-daemon[3376]: accepted connection from pid 3566, user nixbot2149vm-test-run-nixbot-gitlab> gitlab # [ 212.923835] gitaly[1385]: time="2026-06-30T07:58:19.862Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJH4RK8Z91FQFJX1HBQMA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:49.860" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:19.861" grpc.time_ms=1.173 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2150vm-test-run-nixbot-gitlab> gitlab # [ 213.008704] gitaly[1385]: time="2026-06-30T07:58:19.948Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJH4RK8Z91FQFJX1HBQMA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-30T07:58:29.213" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:19.934" grpc.time_ms=13.465 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2151vm-test-run-nixbot-gitlab> gitlab # [ 213.070257] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.008Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"d7a4f0edd87c5ac364098035","created_at":"2026-06-30T07:58:19.997Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-184e5fb5996a4cf5","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.003Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d7a4f0edd87c5ac364098035: start","job_status":"start","queue_duration_s":0.004887,"scheduling_latency_s":0.004958}2152vm-test-run-nixbot-gitlab> gitlab # [ 213.119339] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/57191af08ca8a4108f21e1e7461823d6343ee58e HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 2572153vm-test-run-nixbot-gitlab> gitlab # [ 213.125108] nixbot[3123]: {"ts": "2026-06-30T07:58:20.063Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/57191af08ca8a4108f21e1e7461823d6343ee58e \"HTTP/1.1 201 Created\""}2154vm-test-run-nixbot-gitlab> gitlab # [ 213.183064] gitaly[1385]: time="2026-06-30T07:58:20.122Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJHD7EA181AW0VMJSGVQ7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:50.121" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:20.121" grpc.time_ms=0.59 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2155vm-test-run-nixbot-gitlab> gitlab # [ 213.238600] gitaly[1385]: time="2026-06-30T07:58:20.178Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJH4RK8Z91FQFJX1HBQMA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:20.177" grpc.time_ms=0.284 pid=1385 span.kind=server system=grpc2156vm-test-run-nixbot-gitlab> gitlab # [ 213.239436] gitaly[1385]: time="2026-06-30T07:58:20.179Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJHD7EA181AW0VMJSGVQ7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-30T07:58:30.028" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:20.168" grpc.time_ms=10.122 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2157vm-test-run-nixbot-gitlab> gitlab # [ 213.300368] gitaly[1385]: time="2026-06-30T07:58:20.239Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJH4RK8Z91FQFJX1HBQMA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3901 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:20.239" grpc.time_ms=0.445 pid=1385 span.kind=server system=grpc2158vm-test-run-nixbot-gitlab> gitlab # [ 213.318125] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/57191af08ca8a4108f21e1e7461823d6343ee58e HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1852159vm-test-run-nixbot-gitlab> gitlab # [ 213.323583] nixbot[3123]: {"ts": "2026-06-30T07:58:20.262Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/57191af08ca8a4108f21e1e7461823d6343ee58e \"HTTP/1.1 201 Created\""}2160vm-test-run-nixbot-gitlab> gitlab # [ 213.349270] gitaly[1385]: time="2026-06-30T07:58:20.288Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJH4RK8Z91FQFJX1HBQMA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:20.288" grpc.time_ms=0.377 pid=1385 span.kind=server system=grpc2161vm-test-run-nixbot-gitlab> gitlab # [ 213.377376] gitaly[1385]: time="2026-06-30T07:58:20.316Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJH4RK8Z91FQFJX1HBQMA diskcache=858eda00-283f-48d4-9335-688393ec3fdd grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-30T07:58:50.024" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:20.152" pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2162vm-test-run-nixbot-gitlab> gitlab # [ 213.377961] gitaly[1385]: time="2026-06-30T07:58:20.317Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=94 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7320 command.oublock=0 command.real_time_ms=156 command.spawn_token_fork_ms=0 command.system_time_ms=57 command.user_time_ms=37 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJH4RK8Z91FQFJX1HBQMA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-30T07:58:50.024" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:20.152" grpc.time_ms=164.82 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2163vm-test-run-nixbot-gitlab> gitlab # [ 213.433853] gitaly[1385]: time="2026-06-30T07:58:20.373Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJH4RK8Z91FQFJX1HBQMA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-30T07:58:50.271" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:20.372" grpc.time_ms=1.245 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2164vm-test-run-nixbot-gitlab> gitlab # [ 213.483074] gitaly[1385]: time="2026-06-30T07:58:20.422Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJH4RK8Z91FQFJX1HBQMA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:50.320" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:20.421" grpc.time_ms=0.969 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2165vm-test-run-nixbot-gitlab> gitlab # [ 213.548835] gitaly[1385]: time="2026-06-30T07:58:20.488Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJH4RK8Z91FQFJX1HBQMA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:50.386" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:20.486" grpc.time_ms=1.321 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2166vm-test-run-nixbot-gitlab> gitlab # [ 213.595877] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.534Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"cc94ce6f7ca64303681a00cd","created_at":"2026-06-30T07:58:20.531Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"d7a4f0edd87c5ac364098035","job_size_bytes":3,"pid":2131,"job_status":"deduplicated","message":"PipelineProcessWorker JID-cc94ce6f7ca64303681a00cd: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2167vm-test-run-nixbot-gitlab> gitlab # [ 213.622281] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.561Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"d7a4f0edd87c5ac364098035","created_at":"2026-06-30T07:58:19.997Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-184e5fb5996a4cf5","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.003Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2131,"job_status":"rescheduled","message":"PipelineProcessWorker JID-d7a4f0edd87c5ac364098035: rescheduled"}2168vm-test-run-nixbot-gitlab> gitlab # [ 213.645799] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.575Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"d7a4f0edd87c5ac364098035","created_at":"2026-06-30T07:58:19.997Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-184e5fb5996a4cf5","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.003Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d7a4f0edd87c5ac364098035: done: 0.566926 sec","job_status":"done","queue_duration_s":0.004887,"scheduling_latency_s":0.004958,"gitaly_calls":4,"gitaly_duration_s":0.28181,"redis_calls":93,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.057519,"redis_read_bytes":262,"redis_write_bytes":23384,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002322,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":21,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.003833,"redis_cache_read_bytes":39,"redis_cache_write_bytes":1840,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001972,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":712,"redis_queues_calls":25,"redis_queues_duration_s":0.006934,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14465,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.034686,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000452,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001182,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.003816,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":38,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":38,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":23,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.013,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.025,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.174607,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.483632696,"duration_s":0.566926,"completed_at":"2026-06-30T07:58:20.575Z","load_balancing_strategy":"primary","db_duration_s":0.05827,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2169vm-test-run-nixbot-gitlab> gitlab # [ 213.683120] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.578Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d764d6b68ea6ee199d50946e","created_at":"2026-06-30T07:58:20.109Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.113Z","job_size_bytes":23,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d764d6b68ea6ee199d50946e: start","job_status":"start","queue_duration_s":0.464841,"scheduling_latency_s":0.46501}2170vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses2171vm-test-run-nixbot-gitlab> gitlab # [ 213.692908] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.632Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d764d6b68ea6ee199d50946e","created_at":"2026-06-30T07:58:20.109Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.113Z","job_size_bytes":23,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d764d6b68ea6ee199d50946e: done: 0.053517 sec","job_status":"done","queue_duration_s":0.464841,"scheduling_latency_s":0.46501,"redis_calls":7,"redis_duration_s":0.003591,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002503,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001088,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.053517,"completed_at":"2026-06-30T07:58:20.632Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010598,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2172vm-test-run-nixbot-gitlab> gitlab # [ 213.755892] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.634Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"924703581dd629253731bf57","created_at":"2026-06-30T07:58:20.325Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.329Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-924703581dd629253731bf57: start","job_status":"start","queue_duration_s":0.304673,"scheduling_latency_s":0.304698}2173vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses, in 0.09 seconds)2174vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '57191af08ca8a4108f21e1e7461823d6343ee58e', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-06-30T07:58:15.008Z', 'started_at': None, 'finished_at': '2026-06-30T07:58:19.983Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': '57191af08ca8a4108f21e1e7461823d6343ee58e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-06-30T07:58:20.232Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2175vm-test-run-nixbot-gitlab> gitlab # [ 213.844235] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.656Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"924703581dd629253731bf57","created_at":"2026-06-30T07:58:20.325Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.329Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-924703581dd629253731bf57: done: 0.022363 sec","job_status":"done","queue_duration_s":0.304673,"scheduling_latency_s":0.304698,"redis_calls":7,"redis_duration_s":0.003087,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002191,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022363,"completed_at":"2026-06-30T07:58:20.656Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004594,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2176vm-test-run-nixbot-gitlab> gitlab # [ 213.848400] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.658Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"fe373e71322a557fe7f1ceb0","created_at":"2026-06-30T07:58:20.341Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.344Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-fe373e71322a557fe7f1ceb0: start","job_status":"start","queue_duration_s":0.314329,"scheduling_latency_s":0.31435}2177vm-test-run-nixbot-gitlab> gitlab # [ 213.930240] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.687Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"fe373e71322a557fe7f1ceb0","created_at":"2026-06-30T07:58:20.341Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.344Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-fe373e71322a557fe7f1ceb0: done: 0.02848 sec","job_status":"done","queue_duration_s":0.314329,"scheduling_latency_s":0.31435,"redis_calls":7,"redis_duration_s":0.003124,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0023,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000824,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02848,"completed_at":"2026-06-30T07:58:20.687Z","load_balancing_strategy":"primary","db_duration_s":0.00918,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2178vm-test-run-nixbot-gitlab> gitlab # [ 214.001185] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.689Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"b543d7b2b977c5f1a68fba06","created_at":"2026-06-30T07:58:20.353Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.355Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b543d7b2b977c5f1a68fba06: start","job_status":"start","queue_duration_s":0.334547,"scheduling_latency_s":0.334572}2179vm-test-run-nixbot-gitlab> gitlab # [ 214.003187] gitaly[1385]: time="2026-06-30T07:58:20.783Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJJ2BGGSVWGKHJECQBTRQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:50.282" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:20.783" grpc.time_ms=0.496 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2180vm-test-run-nixbot-gitlab> gitlab # [ 214.004490] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:20 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 582181vm-test-run-nixbot-gitlab> gitlab # [ 214.005368] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.717Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"b543d7b2b977c5f1a68fba06","created_at":"2026-06-30T07:58:20.353Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.355Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b543d7b2b977c5f1a68fba06: done: 0.027973 sec","job_status":"done","queue_duration_s":0.334547,"scheduling_latency_s":0.334572,"redis_calls":10,"redis_duration_s":0.005574,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002094,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002613,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000867,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027973,"completed_at":"2026-06-30T07:58:20.717Z","load_balancing_strategy":"primary","db_duration_s":0.005425,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2182vm-test-run-nixbot-gitlab> gitlab # [ 214.086367] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.719Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e174818b10bb75d9abb3058d","created_at":"2026-06-30T07:58:20.355Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.357Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e174818b10bb75d9abb3058d: start","job_status":"start","queue_duration_s":0.362475,"scheduling_latency_s":0.362497}2183vm-test-run-nixbot-gitlab> gitlab # [ 214.087827] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.749Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e174818b10bb75d9abb3058d","created_at":"2026-06-30T07:58:20.355Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.357Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e174818b10bb75d9abb3058d: done: 0.030165 sec","job_status":"done","queue_duration_s":0.362475,"scheduling_latency_s":0.362497,"redis_calls":7,"redis_duration_s":0.002245,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001652,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000593,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030165,"completed_at":"2026-06-30T07:58:20.749Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007151,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2184vm-test-run-nixbot-gitlab> gitlab # [ 214.174324] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.752Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"4a1da6b348932ce9d9e95af8","created_at":"2026-06-30T07:58:20.357Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.360Z","job_size_bytes":19,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-4a1da6b348932ce9d9e95af8: start","job_status":"start","queue_duration_s":0.392098,"scheduling_latency_s":0.392147}2185vm-test-run-nixbot-gitlab> gitlab # [ 214.175382] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.776Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"4a1da6b348932ce9d9e95af8","created_at":"2026-06-30T07:58:20.357Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.360Z","job_size_bytes":19,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-4a1da6b348932ce9d9e95af8: done: 0.02437 sec","job_status":"done","queue_duration_s":0.392098,"scheduling_latency_s":0.392147,"redis_calls":8,"redis_duration_s":0.003826,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003322,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000504,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02437,"completed_at":"2026-06-30T07:58:20.776Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002276,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2186vm-test-run-nixbot-gitlab> gitlab # [ 214.248337] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.778Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"cbca0787f217521b17e59c2d","created_at":"2026-06-30T07:58:20.361Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.362Z","job_size_bytes":66,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-cbca0787f217521b17e59c2d: start","job_status":"start","queue_duration_s":0.415337,"scheduling_latency_s":0.415361}2187vm-test-run-nixbot-gitlab> gitlab # [ 214.316224] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.801Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"cbca0787f217521b17e59c2d","created_at":"2026-06-30T07:58:20.361Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.362Z","job_size_bytes":66,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-cbca0787f217521b17e59c2d: done: 0.023081 sec","job_status":"done","queue_duration_s":0.415337,"scheduling_latency_s":0.415361,"redis_calls":7,"redis_duration_s":0.004763,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004092,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000671,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023081,"completed_at":"2026-06-30T07:58:20.801Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001847,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2188vm-test-run-nixbot-gitlab> gitlab # [ 214.389157] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.803Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"e39a02c8a5f0de93112be688","created_at":"2026-06-30T07:58:20.363Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.365Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-e39a02c8a5f0de93112be688: start","job_status":"start","queue_duration_s":0.437876,"scheduling_latency_s":0.437906}2189vm-test-run-nixbot-gitlab> gitlab # [ 214.390694] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.827Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"e39a02c8a5f0de93112be688","created_at":"2026-06-30T07:58:20.363Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.365Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-e39a02c8a5f0de93112be688: done: 0.02452 sec","job_status":"done","queue_duration_s":0.437876,"scheduling_latency_s":0.437906,"redis_calls":7,"redis_duration_s":0.001603,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001129,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02452,"completed_at":"2026-06-30T07:58:20.827Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002816,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2190vm-test-run-nixbot-gitlab> gitlab # [ 214.462210] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.828Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"d5a5a9bb8d2effa284719e0d","created_at":"2026-06-30T07:58:20.450Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.451Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-d5a5a9bb8d2effa284719e0d: start","job_status":"start","queue_duration_s":0.377155,"scheduling_latency_s":0.377176}2191vm-test-run-nixbot-gitlab> gitlab # [ 214.463285] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.846Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"d5a5a9bb8d2effa284719e0d","created_at":"2026-06-30T07:58:20.450Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.451Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-d5a5a9bb8d2effa284719e0d: done: 0.018153 sec","job_status":"done","queue_duration_s":0.377155,"scheduling_latency_s":0.377176,"redis_calls":7,"redis_duration_s":0.001582,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001122,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00046,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018153,"completed_at":"2026-06-30T07:58:20.846Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003036,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2192vm-test-run-nixbot-gitlab> gitlab # [ 214.532236] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.848Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"ecb6f7684bfde4963b5d2de7","created_at":"2026-06-30T07:58:20.452Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.453Z","job_size_bytes":6,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-ecb6f7684bfde4963b5d2de7: start","job_status":"start","queue_duration_s":0.394766,"scheduling_latency_s":0.394786}2193vm-test-run-nixbot-gitlab> gitlab # [ 214.601811] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.860Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"ecb6f7684bfde4963b5d2de7","created_at":"2026-06-30T07:58:20.452Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.453Z","job_size_bytes":6,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-ecb6f7684bfde4963b5d2de7: done: 0.012458 sec","job_status":"done","queue_duration_s":0.394766,"scheduling_latency_s":0.394786,"redis_calls":7,"redis_duration_s":0.001506,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001094,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000412,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012458,"completed_at":"2026-06-30T07:58:20.860Z","load_balancing_strategy":"primary","db_duration_s":0.000351,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2194vm-test-run-nixbot-gitlab> gitlab # [ 214.605247] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.862Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"0c9699f3d8d38f883cf559bc","created_at":"2026-06-30T07:58:20.454Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.458Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-0c9699f3d8d38f883cf559bc: start","job_status":"start","queue_duration_s":0.403608,"scheduling_latency_s":0.403629}2195vm-test-run-nixbot-gitlab> gitlab # [ 214.630271] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.887Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"0c9699f3d8d38f883cf559bc","created_at":"2026-06-30T07:58:20.454Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.458Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-0c9699f3d8d38f883cf559bc: done: 0.0249 sec","job_status":"done","queue_duration_s":0.403608,"scheduling_latency_s":0.403629,"redis_calls":10,"redis_duration_s":0.002237,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000441,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001365,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000431,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01509,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000363733,"duration_s":0.0249,"completed_at":"2026-06-30T07:58:20.887Z","load_balancing_strategy":"primary","db_duration_s":0.004039,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2196vm-test-run-nixbot-gitlab> gitlab # [ 214.701112] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:20.888Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"0d5ebbad3b8b54e87cec8d0a","created_at":"2026-06-30T07:58:20.562Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.564Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0d5ebbad3b8b54e87cec8d0a: start","job_status":"start","queue_duration_s":0.323702,"scheduling_latency_s":0.323723}2197vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses2198vm-test-run-nixbot-gitlab> gitlab # [ 214.722329] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:21.005Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"0d5ebbad3b8b54e87cec8d0a","created_at":"2026-06-30T07:58:20.562Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-ea668404b07c4d99","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.564Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0d5ebbad3b8b54e87cec8d0a: done: 0.116913 sec","job_status":"done","queue_duration_s":0.323702,"scheduling_latency_s":0.323723,"gitaly_calls":3,"gitaly_duration_s":0.008916,"redis_calls":44,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.007426,"redis_read_bytes":98,"redis_write_bytes":6014,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001029,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.001688,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_queues_calls":2,"redis_queues_duration_s":0.000322,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001719,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000242,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000434,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":20,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082465,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.097190285,"duration_s":0.116913,"completed_at":"2026-06-30T07:58:21.005Z","load_balancing_strategy":"primary","db_duration_s":0.024101,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2199vm-test-run-nixbot-gitlab> gitlab # [ 214.868164] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:21.006Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"183e9306a7b5ff974cd9b7e3","created_at":"2026-06-30T07:58:20.938Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-8606cc18fde642c9","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.941Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-183e9306a7b5ff974cd9b7e3: start","job_status":"start","queue_duration_s":0.06577,"scheduling_latency_s":0.065792}2200vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses, in 0.09 seconds)2201vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '57191af08ca8a4108f21e1e7461823d6343ee58e', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-06-30T07:58:15.008Z', 'started_at': None, 'finished_at': '2026-06-30T07:58:19.983Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': '57191af08ca8a4108f21e1e7461823d6343ee58e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-06-30T07:58:20.232Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2202vm-test-run-nixbot-gitlab> gitlab # [ 214.869387] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:21.030Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"183e9306a7b5ff974cd9b7e3","created_at":"2026-06-30T07:58:20.938Z","trace_propagation_headers":{"sentry-trace":"0f967a7e76754084b2b74ad77a7d4cbe-8606cc18fde642c9","baggage":"sentry-trace_id=0f967a7e76754084b2b74ad77a7d4cbe,sentry-release=Unknown"},"correlation_id":"01KWBRJH4RK8Z91FQFJX1HBQMA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:20.941Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-183e9306a7b5ff974cd9b7e3: done: 0.0236 sec","job_status":"done","queue_duration_s":0.06577,"scheduling_latency_s":0.065792,"redis_calls":7,"redis_duration_s":0.0017519999999999999,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00129,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000462,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016436,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0236,"completed_at":"2026-06-30T07:58:21.030Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002634,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2203vm-test-run-nixbot-gitlab> gitlab # [ 214.945055] gitaly[1385]: time="2026-06-30T07:58:20.950Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJH4RK8Z91FQFJX1HBQMA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-30T07:58:50.849" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:20.950" grpc.time_ms=0.782 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2204vm-test-run-nixbot-gitlab> gitlab # [ 214.946374] gitaly[1385]: time="2026-06-30T07:58:20.974Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJH4RK8Z91FQFJX1HBQMA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:50.873" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:20.973" grpc.time_ms=0.648 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2205vm-test-run-nixbot-gitlab> gitlab # [ 214.947216] gitaly[1385]: time="2026-06-30T07:58:20.995Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJH4RK8Z91FQFJX1HBQMA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:50.894" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:20.994" grpc.time_ms=0.683 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2206vm-test-run-nixbot-gitlab> gitlab # [ 214.953712] gitaly[1385]: time="2026-06-30T07:58:21.873Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJK4EJQCJR0PBC4VZ2RVB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:51.372" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:21.872" grpc.time_ms=0.56 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2207vm-test-run-nixbot-gitlab> gitlab # [ 215.032587] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:21 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 542208vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses2209vm-test-run-nixbot-gitlab> gitlab # [ 216.073125] gitaly[1385]: time="2026-06-30T07:58:23.011Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJM6TTF5HPPXN9E4RYE14 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:53.009" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:23.010" grpc.time_ms=1.173 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2210vm-test-run-nixbot-gitlab> gitlab # [ 216.122331] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 1162211vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses, in 0.17 seconds)2212vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '57191af08ca8a4108f21e1e7461823d6343ee58e', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-06-30T07:58:15.008Z', 'started_at': None, 'finished_at': '2026-06-30T07:58:19.983Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': '57191af08ca8a4108f21e1e7461823d6343ee58e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-06-30T07:58:20.232Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2213vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses2214vm-test-run-nixbot-gitlab> gitlab # [ 217.241479] gitaly[1385]: time="2026-06-30T07:58:24.180Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJNBE4J0PVY6PAXNSF34B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:54.177" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:24.178" grpc.time_ms=1.197 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2215vm-test-run-nixbot-gitlab> gitlab # [ 217.268650] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:24 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 972216vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses, in 0.17 seconds)2217vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '57191af08ca8a4108f21e1e7461823d6343ee58e', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-06-30T07:58:15.008Z', 'started_at': None, 'finished_at': '2026-06-30T07:58:19.983Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': '57191af08ca8a4108f21e1e7461823d6343ee58e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-06-30T07:58:20.232Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2218vm-test-run-nixbot-gitlab> gitlab # [ 217.781460] nix-daemon[3376]: accepted connection from pid 3642, user nixbot2219vm-test-run-nixbot-gitlab> gitlab # [ 217.899755] gitaly[1385]: time="2026-06-30T07:58:24.839Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJNZT299MA8A3F5YW29M8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:54.336" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:24.837" grpc.time_ms=1.124 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2220vm-test-run-nixbot-gitlab> gitlab # [ 217.968485] gitaly[1385]: time="2026-06-30T07:58:24.907Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJNZT299MA8A3F5YW29M8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-30T07:58:34.142" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:24.893" grpc.time_ms=14.134 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2221vm-test-run-nixbot-gitlab> gitlab # [ 218.020342] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:24.959Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"6fd772027607f0086e97cfae","created_at":"2026-06-30T07:58:24.951Z","trace_propagation_headers":{"sentry-trace":"76887bb2ab744ed1b6bef67f85659528-0204909fb5b540a8","baggage":"sentry-trace_id=76887bb2ab744ed1b6bef67f85659528,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJNZT299MA8A3F5YW29M8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:24.956Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6fd772027607f0086e97cfae: start","job_status":"start","queue_duration_s":0.002497,"scheduling_latency_s":0.002553}2222vm-test-run-nixbot-gitlab> gitlab # [ 218.049612] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/57191af08ca8a4108f21e1e7461823d6343ee58e HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2182223vm-test-run-nixbot-gitlab> gitlab # [ 218.051759] nixbot[3123]: {"ts": "2026-06-30T07:58:24.983Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/57191af08ca8a4108f21e1e7461823d6343ee58e \"HTTP/1.1 201 Created\""}2224vm-test-run-nixbot-gitlab> gitlab # [ 218.144146] gitaly[1385]: time="2026-06-30T07:58:25.082Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJNZT299MA8A3F5YW29M8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:25.082" grpc.time_ms=0.434 pid=1385 span.kind=server system=grpc2225vm-test-run-nixbot-gitlab> gitlab # [ 218.192704] gitaly[1385]: time="2026-06-30T07:58:25.132Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJNZT299MA8A3F5YW29M8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3901 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:25.131" grpc.time_ms=1.181 pid=1385 span.kind=server system=grpc2226vm-test-run-nixbot-gitlab> gitlab # [ 218.233548] nix-daemon[3376]: accepted connection from pid 3676, user nixbot2227vm-test-run-nixbot-gitlab> gitlab # [ 218.236433] gitaly[1385]: time="2026-06-30T07:58:25.174Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWBRJNZT299MA8A3F5YW29M8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-30T07:58:25.172" grpc.time_ms=1.555 pid=1385 span.kind=server system=grpc2228vm-test-run-nixbot-gitlab> gitlab # [ 218.254524] gitaly[1385]: time="2026-06-30T07:58:25.193Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJNZT299MA8A3F5YW29M8 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-30T07:58:55.051" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:25.052" operations="[repack_refs]" pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2229vm-test-run-nixbot-gitlab> gitlab # [ 218.270472] gitaly[1385]: time="2026-06-30T07:58:25.196Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJNZT299MA8A3F5YW29M8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-30T07:58:55.051" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:25.052" pid=1385 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-06-30 07:58:03.538748199 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2230vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses2231vm-test-run-nixbot-gitlab> gitlab # [ 218.296818] gitaly[1385]: time="2026-06-30T07:58:25.236Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJNZT299MA8A3F5YW29M8 diskcache=45bf9ea7-5bbf-40a5-9dd2-32833b4d8553 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-30T07:58:55.051" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:25.052" pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2232vm-test-run-nixbot-gitlab> gitlab # [ 218.297978] gitaly[1385]: time="2026-06-30T07:58:25.236Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=152 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7217 command.oublock=0 command.real_time_ms=142 command.spawn_token_fork_ms=1 command.system_time_ms=108 command.user_time_ms=44 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJNZT299MA8A3F5YW29M8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-30T07:58:55.051" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:25.052" grpc.time_ms=183.849 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2233vm-test-run-nixbot-gitlab> gitlab # [ 218.341661] gitaly[1385]: time="2026-06-30T07:58:25.281Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJNZT299MA8A3F5YW29M8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-30T07:58:55.051" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:25.052" pid=1385 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2234vm-test-run-nixbot-gitlab> gitlab # [ 218.342313] gitaly[1385]: time="2026-06-30T07:58:25.281Z" level=info msg="optimized repository" clean_stale_data_time=70.548351ms clean_work_trees_time="93.867µs" commit_graph_time="8.102µs" correlation_id=01KWBRJNZT299MA8A3F5YW29M8 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="8.66µs" pid=1385 prune_time="7.822µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="8.381µs" storage_name=default system=housekeeping total_time=70.881076ms2235vm-test-run-nixbot-gitlab> gitlab # [ 218.343060] gitaly[1385]: time="2026-06-30T07:58:25.281Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJNZT299MA8A3F5YW29M8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-30T07:58:55.051" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-06-30T07:58:25.052" pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2236vm-test-run-nixbot-gitlab> gitlab # [ 218.383452] gitaly[1385]: time="2026-06-30T07:58:25.322Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJNZT299MA8A3F5YW29M8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-30T07:58:55.221" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:25.322" grpc.time_ms=0.655 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2237vm-test-run-nixbot-gitlab> gitlab # [ 218.412887] gitaly[1385]: time="2026-06-30T07:58:25.352Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWBRJPGCTY49JSQQA5NNB7AT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:25.343" grpc.time_ms=9.289 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc2238vm-test-run-nixbot-gitlab> gitlab # [ 218.414434] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:25 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 612239vm-test-run-nixbot-gitlab> gitlab # [ 218.415947] gitaly[1385]: time="2026-06-30T07:58:25.355Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJNZT299MA8A3F5YW29M8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:55.254" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:25.354" grpc.time_ms=0.696 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2240vm-test-run-nixbot-gitlab> gitlab # [ 218.463341] gitaly[1385]: time="2026-06-30T07:58:25.402Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJNZT299MA8A3F5YW29M8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:55.301" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:25.401" grpc.time_ms=0.541 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2241vm-test-run-nixbot-gitlab> gitlab # [ 218.475450] gitaly[1385]: time="2026-06-30T07:58:25.415Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJPJC61YABD4F6EX0MMKM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:25.404" pid=1385 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc2242vm-test-run-nixbot-gitlab> gitlab # [ 218.479322] gitaly[1385]: time="2026-06-30T07:58:25.416Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJPJC61YABD4F6EX0MMKM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:25.404" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc2243vm-test-run-nixbot-gitlab> gitlab # [ 218.480830] gitlab-workhorse[1290]: time="2026-06-30T07:58:25Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672244vm-test-run-nixbot-gitlab> gitlab # [ 218.481894] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:25 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 612245vm-test-run-nixbot-gitlab> gitlab # [ 218.483096] gitaly[1385]: time="2026-06-30T07:58:25.416Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJPJC61YABD4F6EX0MMKM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-30T07:58:25.404" grpc.time_ms=11.873 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc2246vm-test-run-nixbot-gitlab> gitlab # [ 218.544624] gitaly[1385]: time="2026-06-30T07:58:25.484Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWBRJPKWMWKNS1DWGZQYWGDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-30T07:58:55.482" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-30T07:58:25.483" grpc.time_ms=0.573 pid=1385 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2247vm-test-run-nixbot-gitlab> gitlab # [ 218.586106] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:25.525Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"6fd772027607f0086e97cfae","created_at":"2026-06-30T07:58:24.951Z","trace_propagation_headers":{"sentry-trace":"76887bb2ab744ed1b6bef67f85659528-0204909fb5b540a8","baggage":"sentry-trace_id=76887bb2ab744ed1b6bef67f85659528,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRJNZT299MA8A3F5YW29M8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:24.956Z","job_size_bytes":3,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6fd772027607f0086e97cfae: done: 0.566434 sec","job_status":"done","queue_duration_s":0.002497,"scheduling_latency_s":0.002553,"gitaly_calls":4,"gitaly_duration_s":0.34073,"redis_calls":83,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.034069,"redis_read_bytes":173,"redis_write_bytes":20925,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002927,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":21,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.006526,"redis_cache_read_bytes":39,"redis_cache_write_bytes":1840,"redis_queues_calls":23,"redis_queues_duration_s":0.007585,"redis_queues_read_bytes":25,"redis_queues_write_bytes":13378,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.00837,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3094,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000394,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002698,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002642,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":36,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":21,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.011,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.014,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.023,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.178901,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.534067598,"duration_s":0.566434,"completed_at":"2026-06-30T07:58:25.525Z","load_balancing_strategy":"primary","db_duration_s":0.054226,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2248vm-test-run-nixbot-gitlab> gitlab # [ 218.629256] sidekiq-cluster[2131]: {"severity":"INFO","time":"2026-06-30T07:58:25.530Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"5a1117bdf9c8acac9c534a7a","created_at":"2026-06-30T07:58:01.178Z","trace_propagation_headers":{"sentry-trace":"1e49b21144464ce9b5e93fc201cb2fa1-21242deae55e464f","baggage":"sentry-trace_id=1e49b21144464ce9b5e93fc201cb2fa1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRHYSZPVV54A5M7J8J2GGZ","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:9278bac34cea775dd37617311ce20fcfb1bcc16105f19768bca7d24b578973d3","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:25.043Z","retry_count":0,"job_size_bytes":451,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-5a1117bdf9c8acac9c534a7a: start","job_status":"start","queue_duration_s":0.486679,"scheduling_latency_s":0.486703}2249vm-test-run-nixbot-gitlab> gitlab # [ 218.630440] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/30:07:58:25 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses HTTP/1.1" 200 1328 "" "curl/8.20.0" 1252250vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57191af08ca8a4108f21e1e7461823d6343ee58e/statuses, in 0.55 seconds)2251vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '57191af08ca8a4108f21e1e7461823d6343ee58e', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-06-30T07:58:15.008Z', 'started_at': None, 'finished_at': '2026-06-30T07:58:19.983Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': '57191af08ca8a4108f21e1e7461823d6343ee58e', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-06-30T07:58:20.232Z', 'started_at': None, 'finished_at': '2026-06-30T07:58:24.939Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2252vm-test-run-nixbot-gitlab> (finished: subtest: eval and build post commit statuses, in 10.92 seconds)2253vm-test-run-nixbot-gitlab> (finished: run the VM test script, in 257.16 seconds)2254vm-test-run-nixbot-gitlab> test script finished in 257.19s2255vm-test-run-nixbot-gitlab> cleanup2256vm-test-run-nixbot-gitlab> kill QemuMachine (pid 13)2257vm-test-run-nixbot-gitlab> gitlab # [ 218.657099] sidekiq-cluster[2131]: {"severity":"WARN","time":"2026-06-30T07:58:25.596Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"5a1117bdf9c8acac9c534a7a","created_at":"2026-06-30T07:58:01.178Z","trace_propagation_headers":{"sentry-trace":"1e49b21144464ce9b5e93fc201cb2fa1-21242deae55e464f","baggage":"sentry-trace_id=1e49b21144464ce9b5e93fc201cb2fa1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWBRHYSZPVV54A5M7J8J2GGZ","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:9278bac34cea775dd37617311ce20fcfb1bcc16105f19768bca7d24b578973d3","size_limiter":"validated","enqueued_at":"2026-06-30T07:58:25.043Z","retry_count":0,"job_size_bytes":451,"pid":2131,"sidekiq_tid":"ma1b","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-5a1117bdf9c8acac9c534a7a: fail: 0.065328 sec","job_status":"fail","queue_duration_s":0.486679,"scheduling_latency_s":0.486703,"redis_calls":7,"redis_duration_s":0.001748,"redis_read_bytes":5,"redis_write_bytes":786,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001238,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00051,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.065328,"completed_at":"2026-06-30T07:58:25.595Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/profile.rb:99:in `access_token_created_email'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/abbaw4w9gll6p923md75p3h3rrmhrdqn-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/bqz31s23z0jk4464lbybyz83ikl0gmyd-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/2cs1nrzqiqemu-system-x86_64: terminating on signal 15 from pid 6 (/nix/store/60m4rxhg2fldqaak400c0lry96ijrzqn-python3-3.13.13/bin/python3.13)2258vm-test-run-nixbot-gitlab> gitlab # r2259vm-test-run-nixbot-gitlab> (finished: cleanup, in 1.27 seconds)22602261post-build step Upload coverage to codecov: ok2262Skipping codecov: project=Mic92/nixbot attr=x86_64-linux.nixbot-gitlab