1these 13 derivations will be built:2 /nix/store/hqid5b9xlp6q1ais9v82iiz6z7by7912-nixbot-effects.drv3 /nix/store/rf81mir6wii23w01skcml7szggk1ggf5-unit-nixbot.service.drv4 /nix/store/kdipdr7xpbrdpkvj2c743h0p7mjxpqcc-system-units.drv5 /nix/store/8dhq6swscssv966dg0r8vh9j4m14cs6x-etc.drv6 /nix/store/0wld859x63zkxsml50g0rn4xan8fyl9s-activate.drv7 /nix/store/64d24lwh2z2fy6kvp0336mp2g6r4m2wb-nixos-system-gitlab-test.drv8 /nix/store/afjzcxbnrji7wv1sll3njw2sd8s74w6l-closure-info.drv9 /nix/store/m3576mgz4p0jw2vy70kjnjchdys04pdi-closure-info.drv10 /nix/store/lpspwx4vsyzc6669y09z5zmym7483zdq-run-nixos-vm.drv11 /nix/store/dzgps0xs6v4yka33y3spcyp38yb4v37x-nixos-vm.drv12 /nix/store/bmp6n4inqds8ivszpn1n900dnkww05bz-driverConfiguration.json.drv13 /nix/store/j62kg7g2zwd3i5iz5gzxdfaidbimn7s3-nixos-test-driver-nixbot-gitlab.drv14 /nix/store/q7whsrd97narn31m48g1hm53mrnyi2b5-vm-test-run-nixbot-gitlab.drv15building '/nix/store/hqid5b9xlp6q1ais9v82iiz6z7by7912-nixbot-effects.drv' on 'ssh-ng://nix@jamie'16building '/nix/store/hqid5b9xlp6q1ais9v82iiz6z7by7912-nixbot-effects.drv'17nixbot-effects> Sourcing python-remove-tests-dir-hook18nixbot-effects> Sourcing python-catch-conflicts-hook.sh19nixbot-effects> Sourcing python-remove-bin-bytecode-hook.sh20nixbot-effects> Sourcing pypa-build-hook21nixbot-effects> Using pypaBuildPhase22nixbot-effects> Sourcing python-runtime-deps-check-hook23nixbot-effects> Using pythonRuntimeDepsCheckHook24nixbot-effects> Sourcing pypa-install-hook25nixbot-effects> Using pypaInstallPhase26nixbot-effects> Sourcing python-imports-check-hook.sh27nixbot-effects> Using pythonImportsCheckPhase28nixbot-effects> Sourcing python-namespaces-hook29nixbot-effects> Sourcing python-catch-conflicts-hook.sh30nixbot-effects> Running phase: unpackPhase31nixbot-effects> unpacking source archive /nix/store/hh3npwby2c7rp5yqxljjmn6jpsi32w3w-nixbot_effects32nixbot-effects> source root is nixbot_effects33nixbot-effects> setting SOURCE_DATE_EPOCH to timestamp 315619200 of file "nixbot_effects/pyproject.toml"34nixbot-effects> Running phase: patchPhase35nixbot-effects> Running phase: updateAutotoolsGnuConfigScriptsPhase36nixbot-effects> Running phase: configurePhase37nixbot-effects> no configure script, doing nothing38nixbot-effects> Running phase: buildPhase39nixbot-effects> Executing pypaBuildPhase40nixbot-effects> Creating a wheel...41nixbot-effects> pypa build flags: --no-isolation --outdir dist/ --wheel42nixbot-effects> * Getting build dependencies for wheel...43nixbot-effects> * Building wheel...44nixbot-effects> Successfully built nixbot_effects-0.0.1-py3-none-any.whl45nixbot-effects> Finished creating a wheel...46nixbot-effects> Finished executing pypaBuildPhase47nixbot-effects> Running phase: pythonRuntimeDepsCheckHook48nixbot-effects> Executing pythonRuntimeDepsCheck49nixbot-effects> Checking runtime dependencies for nixbot_effects-0.0.1-py3-none-any.whl50nixbot-effects> Finished executing pythonRuntimeDepsCheck51nixbot-effects> Running phase: installPhase52nixbot-effects> Executing pypaInstallPhase53nixbot-effects> Successfully installed nixbot_effects-0.0.1-py3-none-any.whl54nixbot-effects> Finished executing pypaInstallPhase55nixbot-effects> Running phase: pythonOutputDistPhase56nixbot-effects> Executing pythonOutputDistPhase57nixbot-effects> Finished executing pythonOutputDistPhase58nixbot-effects> Running phase: fixupPhase59nixbot-effects> shrinking RPATHs of ELF executables and libraries in /nix/store/4fd8akndqj9vpcs6n3w9hi1gr3yimqs7-nixbot-effects60nixbot-effects> checking for references to /build/ in /nix/store/4fd8akndqj9vpcs6n3w9hi1gr3yimqs7-nixbot-effects...61nixbot-effects> patching script interpreter paths in /nix/store/4fd8akndqj9vpcs6n3w9hi1gr3yimqs7-nixbot-effects62nixbot-effects> stripping (with command strip and flags -S -p) in /nix/store/4fd8akndqj9vpcs6n3w9hi1gr3yimqs7-nixbot-effects/lib /nix/store/4fd8akndqj9vpcs6n3w9hi1gr3yimqs7-nixbot-effects/bin63nixbot-effects> shrinking RPATHs of ELF executables and libraries in /nix/store/cr0jacb6jphvc21204azmkkm6phcqjj0-nixbot-effects-dist64nixbot-effects> checking for references to /build/ in /nix/store/cr0jacb6jphvc21204azmkkm6phcqjj0-nixbot-effects-dist...65nixbot-effects> patching script interpreter paths in /nix/store/cr0jacb6jphvc21204azmkkm6phcqjj0-nixbot-effects-dist66nixbot-effects> Rewriting #!/nix/store/60m4rxhg2fldqaak400c0lry96ijrzqn-python3-3.13.13/bin/python3.13 to #!/nix/store/60m4rxhg2fldqaak400c0lry96ijrzqn-python3-3.13.1367nixbot-effects> wrapping `/nix/store/4fd8akndqj9vpcs6n3w9hi1gr3yimqs7-nixbot-effects/bin/nixbot-effects'...68nixbot-effects> Executing pythonRemoveTestsDir69nixbot-effects> Finished executing pythonRemoveTestsDir70nixbot-effects> Running phase: installCheckPhase71nixbot-effects> no Makefile or custom installCheckPhase, doing nothing72nixbot-effects> Running phase: pythonCatchConflictsPhase73nixbot-effects> Running phase: pythonRemoveBinBytecodePhase74nixbot-effects> Running phase: pythonImportsCheckPhase75nixbot-effects> Executing pythonImportsCheckPhase76building '/nix/store/rf81mir6wii23w01skcml7szggk1ggf5-unit-nixbot.service.drv'77unit-nixbot.service> tribuchet: building on jamie78building '/nix/store/kdipdr7xpbrdpkvj2c743h0p7mjxpqcc-system-units.drv'79system-units> tribuchet: building on jamie80building '/nix/store/8dhq6swscssv966dg0r8vh9j4m14cs6x-etc.drv'81etc> tribuchet: building on jamie82building '/nix/store/0wld859x63zkxsml50g0rn4xan8fyl9s-activate.drv'83activate> tribuchet: building on jamie84building '/nix/store/64d24lwh2z2fy6kvp0336mp2g6r4m2wb-nixos-system-gitlab-test.drv'85nixos-system-gitlab-test> tribuchet: building on jamie86nixos-system-gitlab-test> structuredAttrs is enabled87building '/nix/store/afjzcxbnrji7wv1sll3njw2sd8s74w6l-closure-info.drv'88closure-info> tribuchet: building on jamie89closure-info> structuredAttrs is enabled90building '/nix/store/m3576mgz4p0jw2vy70kjnjchdys04pdi-closure-info.drv'91closure-info> tribuchet: building on jamie92closure-info> structuredAttrs is enabled93building '/nix/store/lpspwx4vsyzc6669y09z5zmym7483zdq-run-nixos-vm.drv'94run-nixos-vm> tribuchet: building on jamie95building '/nix/store/dzgps0xs6v4yka33y3spcyp38yb4v37x-nixos-vm.drv'96nixos-vm> tribuchet: building on jamie97building '/nix/store/bmp6n4inqds8ivszpn1n900dnkww05bz-driverConfiguration.json.drv'98driverConfiguration.json> tribuchet: building on jamie99driverConfiguration.json> structuredAttrs is enabled100building '/nix/store/j62kg7g2zwd3i5iz5gzxdfaidbimn7s3-nixos-test-driver-nixbot-gitlab.drv'101nixos-test-driver-nixbot-gitlab> tribuchet: building on jamie102nixos-test-driver-nixbot-gitlab> Running type check (enable/disable: config.skipTypeCheck)103nixos-test-driver-nixbot-gitlab> See https://nixos.org/manual/nixos/stable/#test-opt-skipTypeCheck104nixos-test-driver-nixbot-gitlab> All checks passed!105nixos-test-driver-nixbot-gitlab> Linting test script (enable/disable: config.skipLint)106nixos-test-driver-nixbot-gitlab> See https://nixos.org/manual/nixos/stable/#test-opt-skipLint107nixos-test-driver-nixbot-gitlab> All checks passed!108building '/nix/store/q7whsrd97narn31m48g1hm53mrnyi2b5-vm-test-run-nixbot-gitlab.drv' on 'ssh-ng://nix@jamie'109building '/nix/store/q7whsrd97narn31m48g1hm53mrnyi2b5-vm-test-run-nixbot-gitlab.drv'110vm-test-run-nixbot-gitlab> Machine state will be reset. To keep it, pass --keep-machine-state111vm-test-run-nixbot-gitlab> start all VLans112vm-test-run-nixbot-gitlab> (finished: start all VLans, in 0.01 seconds)113vm-test-run-nixbot-gitlab> Test will time out and terminate in 3600 seconds114vm-test-run-nixbot-gitlab> run the VM test script115vm-test-run-nixbot-gitlab> additionally exposed symbols:116vm-test-run-nixbot-gitlab> gitlab,117vm-test-run-nixbot-gitlab> vlan1,118vm-test-run-nixbot-gitlab> start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh119vm-test-run-nixbot-gitlab> start all VMs120vm-test-run-nixbot-gitlab> gitlab: starting vm121vm-test-run-nixbot-gitlab> gitlab: QEMU running (pid 13)122vm-test-run-nixbot-gitlab> gitlab # Disk image does not exist, creating the virtualisation disk image...123vm-test-run-nixbot-gitlab> gitlab # Formatting '/build/vm-state-gitlab/tmp.eCgWrCJzif', fmt=raw size=1073741824124vm-test-run-nixbot-gitlab> gitlab # mke2fs 1.47.3 (8-Jul-2025)125vm-test-run-nixbot-gitlab> gitlab # Discarding device blocks: 0/262144 done126vm-test-run-nixbot-gitlab> gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes127vm-test-run-nixbot-gitlab> gitlab # Filesystem UUID: b527a1d4-7540-451b-bdf2-cac13a488acb128vm-test-run-nixbot-gitlab> gitlab # Superblock backups stored on blocks:129vm-test-run-nixbot-gitlab> gitlab # 32768, 98304, 163840, 229376130vm-test-run-nixbot-gitlab> gitlab # 131vm-test-run-nixbot-gitlab> gitlab # Allocating group tables: 0/8 done132vm-test-run-nixbot-gitlab> gitlab # Writing inode tables: 0/8 done133vm-test-run-nixbot-gitlab> gitlab # Creating journal (8192 blocks): done134vm-test-run-nixbot-gitlab> gitlab # Writing superblocks and filesystem accounting information: 0/8 done135vm-test-run-nixbot-gitlab> (finished: start all VMs, in 35.13 seconds)136vm-test-run-nixbot-gitlab> gitlab # 137vm-test-run-nixbot-gitlab> gitlab: waiting for unit setup-gitlab.service138vm-test-run-nixbot-gitlab> gitlab # Virtualisation disk image created.139vm-test-run-nixbot-gitlab> gitlab: waiting for the VM to finish booting140vm-test-run-nixbot-gitlab> gitlab # Creating Nix store image...141vm-test-run-nixbot-gitlab> gitlab # Created Nix store image.142vm-test-run-nixbot-gitlab> gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)143vm-test-run-nixbot-gitlab> gitlab # 144vm-test-run-nixbot-gitlab> gitlab # 145vm-test-run-nixbot-gitlab> gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA00146vm-test-run-nixbot-gitlab> gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...147vm-test-run-nixbot-gitlab> gitlab # 148vm-test-run-nixbot-gitlab> gitlab # 149vm-test-run-nixbot-gitlab> gitlab # 150vm-test-run-nixbot-gitlab> gitlab # 151vm-test-run-nixbot-gitlab> gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB00152vm-test-run-nixbot-gitlab> gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...153vm-test-run-nixbot-gitlab> gitlab # 154vm-test-run-nixbot-gitlab> gitlab # 155vm-test-run-nixbot-gitlab> gitlab # Booting from ROM...156vm-test-run-nixbot-gitlab> gitlab # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.34 (nixbld@localhost) (gcc (GCC) 15.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Jun 1 15:51:08 UTC 2026157vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9f1l5ayb691nmqcrbgnh3mi0zkc22l7c-nixos-system-gitlab-test/init regInfo=/nix/store/i8mifxjbabd8p5znmlanx8fmj6k7ddh0-closure-info/registration console=ttyS0,115200n8 console=tty0158vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-provided physical RAM map:159vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable160vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved161vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved162vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable163vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved164vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved165vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved166vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable167vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved168vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] NX (Execute Disable) protection: active169vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] APIC: Static calls initialized170vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] SMBIOS 2.8 present.171vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014172vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] DMI: Memory slots populated: 1/1173vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Hypervisor detected: KVM174vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000175vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00176vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] kvm-clock: using sched offset of 494071318 cycles177vm-test-run-nixbot-gitlab> gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns178vm-test-run-nixbot-gitlab> gitlab # [ 0.000005] tsc: Detected 2400.010 MHz processor179vm-test-run-nixbot-gitlab> gitlab # [ 0.000813] last_pfn = 0x1c0000 max_arch_pfn = 0x10000000000180vm-test-run-nixbot-gitlab> gitlab # [ 0.000850] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs181vm-test-run-nixbot-gitlab> gitlab # [ 0.000853] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT182vm-test-run-nixbot-gitlab> gitlab # [ 0.000904] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000183vm-test-run-nixbot-gitlab> gitlab # [ 0.002759] found SMP MP-table at [mem 0x000f5470-0x000f547f]184vm-test-run-nixbot-gitlab> gitlab # [ 0.002770] Using GB pages for direct mapping185vm-test-run-nixbot-gitlab> gitlab # [ 0.002870] RAMDISK: [mem 0xbe4e0000-0xbffcffff]186vm-test-run-nixbot-gitlab> gitlab # [ 0.002878] ACPI: Early table checksum verification disabled187vm-test-run-nixbot-gitlab> gitlab # [ 0.002880] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )188vm-test-run-nixbot-gitlab> gitlab # [ 0.002884] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)189vm-test-run-nixbot-gitlab> gitlab # [ 0.002888] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)190vm-test-run-nixbot-gitlab> gitlab # [ 0.002895] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)191vm-test-run-nixbot-gitlab> gitlab # [ 0.002897] ACPI: FACS 0x00000000BFFE0000 000040192vm-test-run-nixbot-gitlab> gitlab # [ 0.002899] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)193vm-test-run-nixbot-gitlab> gitlab # [ 0.002900] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)194vm-test-run-nixbot-gitlab> gitlab # [ 0.002902] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)195vm-test-run-nixbot-gitlab> gitlab # [ 0.002903] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]196vm-test-run-nixbot-gitlab> gitlab # [ 0.002904] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]197vm-test-run-nixbot-gitlab> gitlab # [ 0.002905] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]198vm-test-run-nixbot-gitlab> gitlab # [ 0.002905] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]199vm-test-run-nixbot-gitlab> gitlab # [ 0.002906] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]200vm-test-run-nixbot-gitlab> gitlab # [ 0.002906] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]201vm-test-run-nixbot-gitlab> gitlab # [ 0.003401] No NUMA configuration found202vm-test-run-nixbot-gitlab> gitlab # [ 0.003402] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]203vm-test-run-nixbot-gitlab> gitlab # [ 0.003406] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]204vm-test-run-nixbot-gitlab> gitlab # [ 0.005628] Zone ranges:205vm-test-run-nixbot-gitlab> gitlab # [ 0.005629] DMA [mem 0x0000000000001000-0x0000000000ffffff]206vm-test-run-nixbot-gitlab> gitlab # [ 0.005631] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]207vm-test-run-nixbot-gitlab> gitlab # [ 0.005632] Normal [mem 0x0000000100000000-0x00000001bfffffff]208vm-test-run-nixbot-gitlab> gitlab # [ 0.005633] Device empty209vm-test-run-nixbot-gitlab> gitlab # [ 0.005634] Movable zone start for each node210vm-test-run-nixbot-gitlab> gitlab # [ 0.005635] Early memory node ranges211vm-test-run-nixbot-gitlab> gitlab # [ 0.005635] node 0: [mem 0x0000000000001000-0x000000000009efff]212vm-test-run-nixbot-gitlab> gitlab # [ 0.005636] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]213vm-test-run-nixbot-gitlab> gitlab # [ 0.005637] node 0: [mem 0x0000000100000000-0x00000001bfffffff]214vm-test-run-nixbot-gitlab> gitlab # [ 0.005638] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]215vm-test-run-nixbot-gitlab> gitlab # [ 0.005656] On node 0, zone DMA: 1 pages in unavailable ranges216vm-test-run-nixbot-gitlab> gitlab # [ 0.005915] On node 0, zone DMA: 97 pages in unavailable ranges217vm-test-run-nixbot-gitlab> gitlab # [ 0.109295] On node 0, zone Normal: 40 pages in unavailable ranges218vm-test-run-nixbot-gitlab> gitlab # [ 0.110323] ACPI: PM-Timer IO Port: 0x608219vm-test-run-nixbot-gitlab> gitlab # [ 0.110340] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])220vm-test-run-nixbot-gitlab> gitlab # [ 0.110378] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23221vm-test-run-nixbot-gitlab> gitlab # [ 0.110381] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)222vm-test-run-nixbot-gitlab> gitlab # [ 0.110383] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)223vm-test-run-nixbot-gitlab> gitlab # [ 0.110384] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)224vm-test-run-nixbot-gitlab> gitlab # [ 0.110385] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)225vm-test-run-nixbot-gitlab> gitlab # [ 0.110385] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)226vm-test-run-nixbot-gitlab> gitlab # [ 0.110388] ACPI: Using ACPI (MADT) for SMP configuration information227vm-test-run-nixbot-gitlab> gitlab # [ 0.110389] ACPI: HPET id: 0x8086a201 base: 0xfed00000228vm-test-run-nixbot-gitlab> gitlab # [ 0.110395] TSC deadline timer available229vm-test-run-nixbot-gitlab> gitlab # [ 0.110400] CPU topo: Max. logical packages: 1230vm-test-run-nixbot-gitlab> gitlab # [ 0.110400] CPU topo: Max. logical dies: 1231vm-test-run-nixbot-gitlab> gitlab # [ 0.110401] CPU topo: Max. dies per package: 1232vm-test-run-nixbot-gitlab> gitlab # [ 0.110404] CPU topo: Max. threads per core: 1233vm-test-run-nixbot-gitlab> gitlab # [ 0.110405] CPU topo: Num. cores per package: 4234vm-test-run-nixbot-gitlab> gitlab # [ 0.110405] CPU topo: Num. threads per package: 4235vm-test-run-nixbot-gitlab> gitlab # [ 0.110405] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs236vm-test-run-nixbot-gitlab> gitlab # [ 0.110429] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()237vm-test-run-nixbot-gitlab> gitlab # [ 0.110447] kvm-guest: KVM setup pv remote TLB flush238vm-test-run-nixbot-gitlab> gitlab # [ 0.110451] kvm-guest: setup PV sched yield239vm-test-run-nixbot-gitlab> gitlab # [ 0.110473] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]240vm-test-run-nixbot-gitlab> gitlab # [ 0.110474] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]241vm-test-run-nixbot-gitlab> gitlab # [ 0.110475] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]242vm-test-run-nixbot-gitlab> gitlab # [ 0.110477] [mem 0xc0000000-0xfeffbfff] available for PCI devices243vm-test-run-nixbot-gitlab> gitlab # [ 0.110478] Booting paravirtualized kernel on KVM244vm-test-run-nixbot-gitlab> gitlab # [ 0.110481] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns245vm-test-run-nixbot-gitlab> gitlab # [ 0.114918] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1246vm-test-run-nixbot-gitlab> gitlab # [ 0.117228] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288247vm-test-run-nixbot-gitlab> gitlab # [ 0.117282] kvm-guest: PV spinlocks enabled248vm-test-run-nixbot-gitlab> gitlab # [ 0.117284] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)249vm-test-run-nixbot-gitlab> gitlab # [ 0.117287] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9f1l5ayb691nmqcrbgnh3mi0zkc22l7c-nixos-system-gitlab-test/init regInfo=/nix/store/i8mifxjbabd8p5znmlanx8fmj6k7ddh0-closure-info/registration console=ttyS0,115200n8 console=tty0250vm-test-run-nixbot-gitlab> gitlab # [ 0.117378] Unknown kernel command line parameters "regInfo=/nix/store/i8mifxjbabd8p5znmlanx8fmj6k7ddh0-closure-info/registration", will be passed to user space.251vm-test-run-nixbot-gitlab> gitlab # [ 0.117391] random: crng init done252vm-test-run-nixbot-gitlab> gitlab # [ 0.117392] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes253vm-test-run-nixbot-gitlab> gitlab # [ 0.125849] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)254vm-test-run-nixbot-gitlab> gitlab # [ 0.130003] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)255vm-test-run-nixbot-gitlab> gitlab # [ 0.130080] software IO TLB: area num 4.256vm-test-run-nixbot-gitlab> gitlab # [ 0.202919] Fallback order for Node 0: 0257vm-test-run-nixbot-gitlab> gitlab # [ 0.202927] Built 1 zonelists, mobility grouping on. Total pages: 1572726258vm-test-run-nixbot-gitlab> gitlab # [ 0.202929] Policy zone: Normal259vm-test-run-nixbot-gitlab> gitlab # [ 0.205714] mem auto-init: stack:all(zero), heap alloc:on, heap free:off260vm-test-run-nixbot-gitlab> gitlab # [ 0.214877] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1261vm-test-run-nixbot-gitlab> gitlab # [ 0.228561] allocated 12582912 bytes of page_ext262vm-test-run-nixbot-gitlab> gitlab # [ 0.238156] ftrace: allocating 48565 entries in 192 pages263vm-test-run-nixbot-gitlab> gitlab # [ 0.238158] ftrace: allocated 192 pages with 2 groups264vm-test-run-nixbot-gitlab> gitlab # [ 0.239016] Dynamic Preempt: lazy265vm-test-run-nixbot-gitlab> gitlab # [ 0.239192] rcu: Preemptible hierarchical RCU implementation.266vm-test-run-nixbot-gitlab> gitlab # [ 0.239193] rcu: RCU event tracing is enabled.267vm-test-run-nixbot-gitlab> gitlab # [ 0.239194] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.268vm-test-run-nixbot-gitlab> gitlab # [ 0.239195] Trampoline variant of Tasks RCU enabled.269vm-test-run-nixbot-gitlab> gitlab # [ 0.239195] Rude variant of Tasks RCU enabled.270vm-test-run-nixbot-gitlab> gitlab # [ 0.239196] Tracing variant of Tasks RCU enabled.271vm-test-run-nixbot-gitlab> gitlab # [ 0.239197] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.272vm-test-run-nixbot-gitlab> gitlab # [ 0.239197] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4273vm-test-run-nixbot-gitlab> gitlab # [ 0.239222] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.274vm-test-run-nixbot-gitlab> gitlab # [ 0.239224] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.275vm-test-run-nixbot-gitlab> gitlab # [ 0.239225] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.276vm-test-run-nixbot-gitlab> gitlab # [ 0.243563] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16277vm-test-run-nixbot-gitlab> gitlab # [ 0.243832] rcu: srcu_init: Setting srcu_struct sizes based on contention.278vm-test-run-nixbot-gitlab> gitlab # [ 0.243958] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)279vm-test-run-nixbot-gitlab> gitlab # [ 0.251321] Console: colour VGA+ 80x25280vm-test-run-nixbot-gitlab> gitlab # [ 0.251324] printk: legacy console [tty0] enabled281vm-test-run-nixbot-gitlab> gitlab # [ 0.295679] printk: legacy console [ttyS0] enabled282vm-test-run-nixbot-gitlab> gitlab # [ 0.497207] ACPI: Core revision 20250807283vm-test-run-nixbot-gitlab> gitlab # [ 0.498809] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns284vm-test-run-nixbot-gitlab> gitlab # [ 0.501651] APIC: Switch to symmetric I/O mode setup285vm-test-run-nixbot-gitlab> gitlab # [ 0.503398] x2apic enabled286vm-test-run-nixbot-gitlab> gitlab # [ 0.504631] APIC: Switched APIC routing to: physical x2apic287vm-test-run-nixbot-gitlab> gitlab # [ 0.506359] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()288vm-test-run-nixbot-gitlab> gitlab # [ 0.508617] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()289vm-test-run-nixbot-gitlab> gitlab # [ 0.511383] kvm-guest: setup PV IPIs290vm-test-run-nixbot-gitlab> gitlab # [ 0.513684] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1291vm-test-run-nixbot-gitlab> gitlab # [ 0.515537] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns292vm-test-run-nixbot-gitlab> gitlab # [ 0.518681] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400010)293vm-test-run-nixbot-gitlab> gitlab # [ 0.519798] x86/cpu: User Mode Instruction Prevention (UMIP) activated294vm-test-run-nixbot-gitlab> gitlab # [ 0.521838] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127295vm-test-run-nixbot-gitlab> gitlab # [ 0.523680] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0296vm-test-run-nixbot-gitlab> gitlab # [ 0.524685] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto297vm-test-run-nixbot-gitlab> gitlab # [ 0.526681] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl298vm-test-run-nixbot-gitlab> gitlab # [ 0.528681] Transient Scheduler Attacks: Mitigation: Clear CPU buffers299vm-test-run-nixbot-gitlab> gitlab # [ 0.529680] Spectre V2 : Mitigation: Enhanced / Automatic IBRS300vm-test-run-nixbot-gitlab> gitlab # [ 0.530680] Speculative Return Stack Overflow: Mitigation: Safe RET301vm-test-run-nixbot-gitlab> gitlab # [ 0.531680] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization302vm-test-run-nixbot-gitlab> gitlab # [ 0.532687] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier303vm-test-run-nixbot-gitlab> gitlab # [ 0.534681] active return thunk: srso_alias_return_thunk304vm-test-run-nixbot-gitlab> gitlab # [ 0.535708] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'305vm-test-run-nixbot-gitlab> gitlab # [ 0.537681] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'306vm-test-run-nixbot-gitlab> gitlab # [ 0.538680] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'307vm-test-run-nixbot-gitlab> gitlab # [ 0.539680] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'308vm-test-run-nixbot-gitlab> gitlab # [ 0.540680] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'309vm-test-run-nixbot-gitlab> gitlab # [ 0.541680] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'310vm-test-run-nixbot-gitlab> gitlab # [ 0.543680] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'311vm-test-run-nixbot-gitlab> gitlab # [ 0.545680] x86/fpu: Supporting XSAVE feature 0x800: 'Control-flow User registers'312vm-test-run-nixbot-gitlab> gitlab # [ 0.546680] x86/fpu: Supporting XSAVE feature 0x1000: 'Control-flow Kernel registers (KVM only)'313vm-test-run-nixbot-gitlab> gitlab # [ 0.548680] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256314vm-test-run-nixbot-gitlab> gitlab # [ 0.549680] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64315vm-test-run-nixbot-gitlab> gitlab # [ 0.550681] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512316vm-test-run-nixbot-gitlab> gitlab # [ 0.552680] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024317vm-test-run-nixbot-gitlab> gitlab # [ 0.554681] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8318vm-test-run-nixbot-gitlab> gitlab # [ 0.555680] x86/fpu: xstate_offset[11]: 2440, xstate_sizes[11]: 16319vm-test-run-nixbot-gitlab> gitlab # [ 0.556680] x86/fpu: xstate_offset[12]: 2456, xstate_sizes[12]: 24320vm-test-run-nixbot-gitlab> gitlab # [ 0.557680] x86/fpu: Enabled xstate features 0x1ae7, context size is 2480 bytes, using 'compacted' format.321vm-test-run-nixbot-gitlab> gitlab # [ 0.586985] Freeing SMP alternatives memory: 44K322vm-test-run-nixbot-gitlab> gitlab # [ 0.587683] pid_max: default: 32768 minimum: 301323vm-test-run-nixbot-gitlab> gitlab # [ 0.590112] LSM: initializing lsm=capability,landlock,yama,bpf,ima324vm-test-run-nixbot-gitlab> gitlab # [ 0.591785] landlock: Up and running.325vm-test-run-nixbot-gitlab> gitlab # [ 0.592680] Yama: becoming mindful.326vm-test-run-nixbot-gitlab> gitlab # [ 0.594890] LSM support for eBPF active327vm-test-run-nixbot-gitlab> gitlab # [ 0.595901] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)328vm-test-run-nixbot-gitlab> gitlab # [ 0.598793] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)329vm-test-run-nixbot-gitlab> gitlab # [ 0.601336] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)330vm-test-run-nixbot-gitlab> gitlab # [ 0.602270] Performance Events: Fam17h+ core perfctr, AMD PMU driver.331vm-test-run-nixbot-gitlab> gitlab # [ 0.602685] ... version: 2332vm-test-run-nixbot-gitlab> gitlab # [ 0.603682] ... bit width: 48333vm-test-run-nixbot-gitlab> gitlab # [ 0.604695] ... generic counters: 6334vm-test-run-nixbot-gitlab> gitlab # [ 0.605682] ... generic bitmap: 000000000000003f335vm-test-run-nixbot-gitlab> gitlab # [ 0.606682] ... fixed-purpose counters: 0336vm-test-run-nixbot-gitlab> gitlab # [ 0.607682] ... fixed-purpose bitmap: 0000000000000000337vm-test-run-nixbot-gitlab> gitlab # [ 0.608681] ... value mask: 0000ffffffffffff338vm-test-run-nixbot-gitlab> gitlab # [ 0.609682] ... max period: 00007fffffffffff339vm-test-run-nixbot-gitlab> gitlab # [ 0.610682] ... global_ctrl mask: 000000000000003f340vm-test-run-nixbot-gitlab> gitlab # [ 0.611828] signal: max sigframe size: 3376341vm-test-run-nixbot-gitlab> gitlab # [ 0.612807] rcu: Hierarchical SRCU implementation.342vm-test-run-nixbot-gitlab> gitlab # [ 0.613687] rcu: Max phase no-delay instances is 400.343vm-test-run-nixbot-gitlab> gitlab # [ 0.614905] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level344vm-test-run-nixbot-gitlab> gitlab # [ 0.620129] smp: Bringing up secondary CPUs ...345vm-test-run-nixbot-gitlab> gitlab # [ 0.621123] smpboot: x86: Booting SMP configuration:346vm-test-run-nixbot-gitlab> gitlab # [ 0.621685] .... node #0, CPUs: #1 #2 #3347vm-test-run-nixbot-gitlab> gitlab # [ 0.625824] smp: Brought up 1 node, 4 CPUs348vm-test-run-nixbot-gitlab> gitlab # [ 0.627683] smpboot: Total of 4 processors activated (19200.08 BogoMIPS)349vm-test-run-nixbot-gitlab> gitlab # [ 0.629259] Memory: 6013196K/6290904K available (17098K kernel code, 2721K rwdata, 13520K rodata, 3644K init, 3008K bss, 258292K reserved, 0K cma-reserved)350vm-test-run-nixbot-gitlab> gitlab # [ 0.631681] devtmpfs: initialized351vm-test-run-nixbot-gitlab> gitlab # [ 0.632920] x86/mm: Memory block size: 128MB352vm-test-run-nixbot-gitlab> gitlab # [ 0.636692] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns353vm-test-run-nixbot-gitlab> gitlab # [ 0.637735] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)354vm-test-run-nixbot-gitlab> gitlab # [ 0.638815] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).355vm-test-run-nixbot-gitlab> gitlab # [ 0.639806] pinctrl core: initialized pinctrl subsystem356vm-test-run-nixbot-gitlab> gitlab # [ 0.641082] PM: RTC time: 17:50:06, date: 2026-07-01357vm-test-run-nixbot-gitlab> gitlab # [ 0.644673] NET: Registered PF_NETLINK/PF_ROUTE protocol family358vm-test-run-nixbot-gitlab> gitlab # [ 0.647069] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations359vm-test-run-nixbot-gitlab> gitlab # [ 0.647739] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations360vm-test-run-nixbot-gitlab> gitlab # [ 0.649825] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations361vm-test-run-nixbot-gitlab> gitlab # [ 0.650694] audit: initializing netlink subsys (disabled)362vm-test-run-nixbot-gitlab> gitlab # [ 0.651867] audit: type=2000 audit(1782928206.192:1): state=initialized audit_enabled=0 res=1363vm-test-run-nixbot-gitlab> gitlab # [ 0.651938] thermal_sys: Registered thermal governor 'fair_share'364vm-test-run-nixbot-gitlab> gitlab # [ 0.653683] thermal_sys: Registered thermal governor 'bang_bang'365vm-test-run-nixbot-gitlab> gitlab # [ 0.654683] thermal_sys: Registered thermal governor 'step_wise'366vm-test-run-nixbot-gitlab> gitlab # [ 0.655683] thermal_sys: Registered thermal governor 'user_space'367vm-test-run-nixbot-gitlab> gitlab # [ 0.656682] thermal_sys: Registered thermal governor 'power_allocator'368vm-test-run-nixbot-gitlab> gitlab # [ 0.657701] cpuidle: using governor menu369vm-test-run-nixbot-gitlab> gitlab # [ 0.660917] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5370vm-test-run-nixbot-gitlab> gitlab # [ 0.662009] PCI: Using configuration type 1 for base access371vm-test-run-nixbot-gitlab> gitlab # [ 0.662683] PCI: Using configuration type 1 for extended access372vm-test-run-nixbot-gitlab> gitlab # [ 0.663897] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.373vm-test-run-nixbot-gitlab> gitlab # [ 0.666868] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages374vm-test-run-nixbot-gitlab> gitlab # [ 0.667683] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page375vm-test-run-nixbot-gitlab> gitlab # [ 0.668683] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages376vm-test-run-nixbot-gitlab> gitlab # [ 0.669682] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page377vm-test-run-nixbot-gitlab> gitlab # [ 0.675210] ACPI: Added _OSI(Module Device)378vm-test-run-nixbot-gitlab> gitlab # [ 0.677691] ACPI: Added _OSI(Processor Device)379vm-test-run-nixbot-gitlab> gitlab # [ 0.681694] ACPI: Added _OSI(Processor Aggregator Device)380vm-test-run-nixbot-gitlab> gitlab # [ 0.690710] ACPI: 1 ACPI AML tables successfully acquired and loaded381vm-test-run-nixbot-gitlab> gitlab # [ 0.699581] ACPI: Interpreter enabled382vm-test-run-nixbot-gitlab> gitlab # [ 0.702846] ACPI: PM: (supports S0 S3 S4 S5)383vm-test-run-nixbot-gitlab> gitlab # [ 0.706693] ACPI: Using IOAPIC for interrupt routing384vm-test-run-nixbot-gitlab> gitlab # [ 0.710056] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug385vm-test-run-nixbot-gitlab> gitlab # [ 0.716690] PCI: Using E820 reservations for host bridge windows386vm-test-run-nixbot-gitlab> gitlab # [ 0.721313] ACPI: Enabled 2 GPEs in block 00 to 0F387vm-test-run-nixbot-gitlab> gitlab # [ 0.737780] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])388vm-test-run-nixbot-gitlab> gitlab # [ 0.740697] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]389vm-test-run-nixbot-gitlab> gitlab # [ 0.746872] acpiphp: Slot [3] registered390vm-test-run-nixbot-gitlab> gitlab # [ 0.749770] acpiphp: Slot [4] registered391vm-test-run-nixbot-gitlab> gitlab # [ 0.751769] acpiphp: Slot [5] registered392vm-test-run-nixbot-gitlab> gitlab # [ 0.754815] acpiphp: Slot [6] registered393vm-test-run-nixbot-gitlab> gitlab # [ 0.756767] acpiphp: Slot [7] registered394vm-test-run-nixbot-gitlab> gitlab # [ 0.758726] acpiphp: Slot [8] registered395vm-test-run-nixbot-gitlab> gitlab # [ 0.760726] acpiphp: Slot [9] registered396vm-test-run-nixbot-gitlab> gitlab # [ 0.761737] acpiphp: Slot [10] registered397vm-test-run-nixbot-gitlab> gitlab # [ 0.762725] acpiphp: Slot [11] registered398vm-test-run-nixbot-gitlab> gitlab # [ 0.763726] acpiphp: Slot [12] registered399vm-test-run-nixbot-gitlab> gitlab # [ 0.765753] acpiphp: Slot [13] registered400vm-test-run-nixbot-gitlab> gitlab # [ 0.767777] acpiphp: Slot [14] registered401vm-test-run-nixbot-gitlab> gitlab # [ 0.770781] acpiphp: Slot [15] registered402vm-test-run-nixbot-gitlab> gitlab # [ 0.773776] acpiphp: Slot [16] registered403vm-test-run-nixbot-gitlab> gitlab # [ 0.776808] acpiphp: Slot [17] registered404vm-test-run-nixbot-gitlab> gitlab # [ 0.779777] acpiphp: Slot [18] registered405vm-test-run-nixbot-gitlab> gitlab # [ 0.782774] acpiphp: Slot [19] registered406vm-test-run-nixbot-gitlab> gitlab # [ 0.786791] acpiphp: Slot [20] registered407vm-test-run-nixbot-gitlab> gitlab # [ 0.789807] acpiphp: Slot [21] registered408vm-test-run-nixbot-gitlab> gitlab # [ 0.792778] acpiphp: Slot [22] registered409vm-test-run-nixbot-gitlab> gitlab # [ 0.795807] acpiphp: Slot [23] registered410vm-test-run-nixbot-gitlab> gitlab # [ 0.798777] acpiphp: Slot [24] registered411vm-test-run-nixbot-gitlab> gitlab # [ 0.801836] acpiphp: Slot [25] registered412vm-test-run-nixbot-gitlab> gitlab # [ 0.804778] acpiphp: Slot [26] registered413vm-test-run-nixbot-gitlab> gitlab # [ 0.807756] acpiphp: Slot [27] registered414vm-test-run-nixbot-gitlab> gitlab # [ 0.809806] acpiphp: Slot [28] registered415vm-test-run-nixbot-gitlab> gitlab # [ 0.812794] acpiphp: Slot [29] registered416vm-test-run-nixbot-gitlab> gitlab # [ 0.814755] acpiphp: Slot [30] registered417vm-test-run-nixbot-gitlab> gitlab # [ 0.817753] acpiphp: Slot [31] registered418vm-test-run-nixbot-gitlab> gitlab # [ 0.819787] PCI host bridge to bus 0000:00419vm-test-run-nixbot-gitlab> gitlab # [ 0.821690] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]420vm-test-run-nixbot-gitlab> gitlab # [ 0.823683] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]421vm-test-run-nixbot-gitlab> gitlab # [ 0.825683] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]422vm-test-run-nixbot-gitlab> gitlab # [ 0.827683] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]423vm-test-run-nixbot-gitlab> gitlab # [ 0.829689] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]424vm-test-run-nixbot-gitlab> gitlab # [ 0.831695] pci_bus 0000:00: root bus resource [bus 00-ff]425vm-test-run-nixbot-gitlab> gitlab # [ 0.834166] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint426vm-test-run-nixbot-gitlab> gitlab # [ 0.837623] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint427vm-test-run-nixbot-gitlab> gitlab # [ 0.840632] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint428vm-test-run-nixbot-gitlab> gitlab # [ 0.847818] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]429vm-test-run-nixbot-gitlab> gitlab # [ 0.850816] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk430vm-test-run-nixbot-gitlab> gitlab # [ 0.854688] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk431vm-test-run-nixbot-gitlab> gitlab # [ 0.858689] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk432vm-test-run-nixbot-gitlab> gitlab # [ 0.861683] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk433vm-test-run-nixbot-gitlab> gitlab # [ 0.864015] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint434vm-test-run-nixbot-gitlab> gitlab # [ 0.867751] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]435vm-test-run-nixbot-gitlab> gitlab # [ 0.870897] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint436vm-test-run-nixbot-gitlab> gitlab # [ 0.874326] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI437vm-test-run-nixbot-gitlab> gitlab # [ 0.875710] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB438vm-test-run-nixbot-gitlab> gitlab # [ 0.878107] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint439vm-test-run-nixbot-gitlab> gitlab # [ 0.887758] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]440vm-test-run-nixbot-gitlab> gitlab # [ 0.889710] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]441vm-test-run-nixbot-gitlab> gitlab # [ 0.891737] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]442vm-test-run-nixbot-gitlab> gitlab # [ 0.893931] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]443vm-test-run-nixbot-gitlab> gitlab # [ 0.907743] pci 0000:00:02.0: pci_fixup_video+0x0/0x100 took 13671 usecs444vm-test-run-nixbot-gitlab> gitlab # [ 0.911039] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint445vm-test-run-nixbot-gitlab> gitlab # [ 0.917698] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]446vm-test-run-nixbot-gitlab> gitlab # [ 0.919699] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]447vm-test-run-nixbot-gitlab> gitlab # [ 0.921821] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]448vm-test-run-nixbot-gitlab> gitlab # [ 0.926716] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]449vm-test-run-nixbot-gitlab> gitlab # [ 0.934764] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint450vm-test-run-nixbot-gitlab> gitlab # [ 0.941697] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]451vm-test-run-nixbot-gitlab> gitlab # [ 0.942697] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]452vm-test-run-nixbot-gitlab> gitlab # [ 0.944736] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]453vm-test-run-nixbot-gitlab> gitlab # [ 0.948696] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint454vm-test-run-nixbot-gitlab> gitlab # [ 0.953699] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]455vm-test-run-nixbot-gitlab> gitlab # [ 0.955697] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]456vm-test-run-nixbot-gitlab> gitlab # [ 0.957736] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]457vm-test-run-nixbot-gitlab> gitlab # [ 0.962271] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint458vm-test-run-nixbot-gitlab> gitlab # [ 0.966697] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]459vm-test-run-nixbot-gitlab> gitlab # [ 0.967697] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]460vm-test-run-nixbot-gitlab> gitlab # [ 0.969735] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]461vm-test-run-nixbot-gitlab> gitlab # [ 0.974845] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint462vm-test-run-nixbot-gitlab> gitlab # [ 0.980698] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]463vm-test-run-nixbot-gitlab> gitlab # [ 0.982698] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]464vm-test-run-nixbot-gitlab> gitlab # [ 0.984736] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]465vm-test-run-nixbot-gitlab> gitlab # [ 0.988710] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint466vm-test-run-nixbot-gitlab> gitlab # [ 0.994697] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]467vm-test-run-nixbot-gitlab> gitlab # [ 0.995697] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]468vm-test-run-nixbot-gitlab> gitlab # [ 0.997737] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]469vm-test-run-nixbot-gitlab> gitlab # [ 1.001749] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint470vm-test-run-nixbot-gitlab> gitlab # [ 1.006697] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]471vm-test-run-nixbot-gitlab> gitlab # [ 1.008697] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]472vm-test-run-nixbot-gitlab> gitlab # [ 1.009743] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]473vm-test-run-nixbot-gitlab> gitlab # [ 1.012697] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]474vm-test-run-nixbot-gitlab> gitlab # [ 1.016675] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint475vm-test-run-nixbot-gitlab> gitlab # [ 1.020710] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]476vm-test-run-nixbot-gitlab> gitlab # [ 1.022737] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]477vm-test-run-nixbot-gitlab> gitlab # [ 1.026761] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint478vm-test-run-nixbot-gitlab> gitlab # [ 1.031696] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]479vm-test-run-nixbot-gitlab> gitlab # [ 1.032697] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]480vm-test-run-nixbot-gitlab> gitlab # [ 1.035742] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]481vm-test-run-nixbot-gitlab> gitlab # [ 1.042314] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint482vm-test-run-nixbot-gitlab> gitlab # [ 1.057726] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]483vm-test-run-nixbot-gitlab> gitlab # [ 1.062728] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]484vm-test-run-nixbot-gitlab> gitlab # [ 1.066823] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]485vm-test-run-nixbot-gitlab> gitlab # [ 1.090604] ACPI: PCI: Interrupt link LNKA configured for IRQ 10486vm-test-run-nixbot-gitlab> gitlab # [ 1.095186] ACPI: PCI: Interrupt link LNKB configured for IRQ 10487vm-test-run-nixbot-gitlab> gitlab # [ 1.099080] ACPI: PCI: Interrupt link LNKC configured for IRQ 11488vm-test-run-nixbot-gitlab> gitlab # [ 1.103081] ACPI: PCI: Interrupt link LNKD configured for IRQ 11489vm-test-run-nixbot-gitlab> gitlab # [ 1.106932] ACPI: PCI: Interrupt link LNKS configured for IRQ 9490vm-test-run-nixbot-gitlab> gitlab # [ 1.111014] iommu: Default domain type: Translated491vm-test-run-nixbot-gitlab> gitlab # [ 1.112682] iommu: DMA domain TLB invalidation policy: lazy mode492vm-test-run-nixbot-gitlab> gitlab # [ 1.114958] ACPI: bus type USB registered493vm-test-run-nixbot-gitlab> gitlab # [ 1.115779] usbcore: registered new interface driver usbfs494vm-test-run-nixbot-gitlab> gitlab # [ 1.117702] usbcore: registered new interface driver hub495vm-test-run-nixbot-gitlab> gitlab # [ 1.119694] usbcore: registered new device driver usb496vm-test-run-nixbot-gitlab> gitlab # [ 1.122166] NetLabel: Initializing497vm-test-run-nixbot-gitlab> gitlab # [ 1.123683] NetLabel: domain hash size = 128498vm-test-run-nixbot-gitlab> gitlab # [ 1.124682] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO499vm-test-run-nixbot-gitlab> gitlab # [ 1.126752] NetLabel: unlabeled traffic allowed by default500vm-test-run-nixbot-gitlab> gitlab # [ 1.127698] PCI: Using ACPI for IRQ routing501vm-test-run-nixbot-gitlab> gitlab # [ 1.131746] pci 0000:00:02.0: vgaarb: setting as boot VGA device502vm-test-run-nixbot-gitlab> gitlab # [ 1.132677] pci 0000:00:02.0: vgaarb: bridge control possible503vm-test-run-nixbot-gitlab> gitlab # [ 1.132677] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none504vm-test-run-nixbot-gitlab> gitlab # [ 1.138687] vgaarb: loaded505vm-test-run-nixbot-gitlab> gitlab # [ 1.139839] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0506vm-test-run-nixbot-gitlab> gitlab # [ 1.141683] hpet0: 3 comparators, 64-bit 100.000000 MHz counter507vm-test-run-nixbot-gitlab> gitlab # [ 1.145771] clocksource: Switched to clocksource kvm-clock508vm-test-run-nixbot-gitlab> gitlab # [ 1.149098] VFS: Disk quotas dquot_6.6.0509vm-test-run-nixbot-gitlab> gitlab # [ 1.150357] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)510vm-test-run-nixbot-gitlab> gitlab # [ 1.152723] pnp: PnP ACPI init511vm-test-run-nixbot-gitlab> gitlab # [ 1.154414] pnp: PnP ACPI: found 6 devices512vm-test-run-nixbot-gitlab> gitlab # [ 1.165254] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns513vm-test-run-nixbot-gitlab> gitlab # [ 1.171745] clocksource: Switched to clocksource acpi_pm514vm-test-run-nixbot-gitlab> gitlab # [ 1.176341] NET: Registered PF_INET protocol family515vm-test-run-nixbot-gitlab> gitlab # [ 1.183436] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)516vm-test-run-nixbot-gitlab> gitlab # [ 1.212092] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)517vm-test-run-nixbot-gitlab> gitlab # [ 1.214676] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)518vm-test-run-nixbot-gitlab> gitlab # [ 1.217108] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)519vm-test-run-nixbot-gitlab> gitlab # [ 1.221924] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)520vm-test-run-nixbot-gitlab> gitlab # [ 1.224209] TCP: Hash tables configured (established 65536 bind 65536)521vm-test-run-nixbot-gitlab> gitlab # [ 1.226232] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)522vm-test-run-nixbot-gitlab> gitlab # [ 1.228708] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)523vm-test-run-nixbot-gitlab> gitlab # [ 1.231207] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)524vm-test-run-nixbot-gitlab> gitlab # [ 1.233562] NET: Registered PF_UNIX/PF_LOCAL protocol family525vm-test-run-nixbot-gitlab> gitlab # [ 1.235373] NET: Registered PF_XDP protocol family526vm-test-run-nixbot-gitlab> gitlab # [ 1.236929] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]527vm-test-run-nixbot-gitlab> gitlab # [ 1.238754] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]528vm-test-run-nixbot-gitlab> gitlab # [ 1.240649] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]529vm-test-run-nixbot-gitlab> gitlab # [ 1.242704] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]530vm-test-run-nixbot-gitlab> gitlab # [ 1.244741] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]531vm-test-run-nixbot-gitlab> gitlab # [ 1.247094] pci 0000:00:01.0: PIIX3: Enabling Passive Release532vm-test-run-nixbot-gitlab> gitlab # [ 1.248908] pci 0000:00:00.0: Limiting direct PCI/PCI transfers533vm-test-run-nixbot-gitlab> gitlab # [ 1.252328] ACPI: \_SB_.LNKD: Enabled at IRQ 11534vm-test-run-nixbot-gitlab> gitlab # [ 1.255722] PCI: CLS 0 bytes, default 64535vm-test-run-nixbot-gitlab> gitlab # [ 1.257153] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)536vm-test-run-nixbot-gitlab> gitlab # [ 1.257763] Trying to unpack rootfs image as initramfs...537vm-test-run-nixbot-gitlab> gitlab # [ 1.259048] software IO TLB: mapped [mem 0x00000000ba4e0000-0x00000000be4e0000] (64MB)538vm-test-run-nixbot-gitlab> gitlab # [ 1.259174] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns539vm-test-run-nixbot-gitlab> gitlab # [ 1.286068] Initialise system trusted keyrings540vm-test-run-nixbot-gitlab> gitlab # [ 1.288191] workingset: timestamp_bits=40 max_order=21 bucket_order=0541vm-test-run-nixbot-gitlab> gitlab # [ 1.301052] Key type asymmetric registered542vm-test-run-nixbot-gitlab> gitlab # [ 1.302361] Asymmetric key parser 'x509' registered543vm-test-run-nixbot-gitlab> gitlab # [ 1.303980] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)544vm-test-run-nixbot-gitlab> gitlab # [ 1.306625] io scheduler mq-deadline registered545vm-test-run-nixbot-gitlab> gitlab # [ 1.308075] io scheduler kyber registered546vm-test-run-nixbot-gitlab> gitlab # [ 1.312778] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled547vm-test-run-nixbot-gitlab> gitlab # [ 1.315136] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A548vm-test-run-nixbot-gitlab> gitlab # [ 1.319411] Linux agpgart interface v0.103549vm-test-run-nixbot-gitlab> gitlab # [ 1.320801] ACPI: bus type drm_connector registered550vm-test-run-nixbot-gitlab> gitlab # [ 1.325590] usbcore: registered new interface driver usbserial_generic551vm-test-run-nixbot-gitlab> gitlab # [ 1.327588] usbserial: USB Serial support registered for generic552vm-test-run-nixbot-gitlab> gitlab # [ 1.329554] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.553vm-test-run-nixbot-gitlab> gitlab # [ 1.329554] Please enable it if your BIOS has the CPPC option.554vm-test-run-nixbot-gitlab> gitlab # [ 1.339514] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled555vm-test-run-nixbot-gitlab> gitlab # [ 1.345684] drop_monitor: Initializing network drop monitor service556vm-test-run-nixbot-gitlab> gitlab # [ 1.351056] NET: Registered PF_INET6 protocol family557vm-test-run-nixbot-gitlab> gitlab # [ 1.357438] Segment Routing with IPv6558vm-test-run-nixbot-gitlab> gitlab # [ 1.358694] In-situ OAM (IOAM) with IPv6559vm-test-run-nixbot-gitlab> gitlab # [ 1.361989] IPI shorthand broadcast: enabled560vm-test-run-nixbot-gitlab> gitlab # [ 1.367020] sched_clock: Marking stable (1104022889, 262835560)->(1446330381, -79471932)561vm-test-run-nixbot-gitlab> gitlab # [ 1.370127] registered taskstats version 1562vm-test-run-nixbot-gitlab> gitlab # [ 1.371742] Loading compiled-in X.509 certificates563vm-test-run-nixbot-gitlab> gitlab # [ 1.382364] Demotion targets for Node 0: null564vm-test-run-nixbot-gitlab> gitlab # [ 1.384280] Key type .fscrypt registered565vm-test-run-nixbot-gitlab> gitlab # [ 1.385527] Key type fscrypt-provisioning registered566vm-test-run-nixbot-gitlab> gitlab # [ 1.387162] ima: No TPM chip found, activating TPM-bypass!567vm-test-run-nixbot-gitlab> gitlab # [ 1.388804] ima: Allocated hash algorithm: sha1568vm-test-run-nixbot-gitlab> gitlab # [ 1.390292] ima: No architecture policies found569vm-test-run-nixbot-gitlab> gitlab # [ 1.392172] PM: Magic number: 2:671:844570vm-test-run-nixbot-gitlab> gitlab # [ 1.394361] RAS: Correctable Errors collector initialized.571vm-test-run-nixbot-gitlab> gitlab # [ 1.399694] clk: Disabling unused clocks572vm-test-run-nixbot-gitlab> gitlab # [ 1.400989] PM: genpd: Disabling unused power domains573vm-test-run-nixbot-gitlab> gitlab # [ 1.565250] Freeing initrd memory: 27584K574vm-test-run-nixbot-gitlab> gitlab # [ 1.574002] Freeing unused decrypted memory: 2028K575vm-test-run-nixbot-gitlab> gitlab # [ 1.582583] Freeing unused kernel image (initmem) memory: 3644K576vm-test-run-nixbot-gitlab> gitlab # [ 1.587282] Write protecting the kernel read-only data: 32768k577vm-test-run-nixbot-gitlab> gitlab # [ 1.594686] Freeing unused kernel image (text/rodata gap) memory: 1332K578vm-test-run-nixbot-gitlab> gitlab # [ 1.601180] Freeing unused kernel image (rodata/data gap) memory: 816K579vm-test-run-nixbot-gitlab> gitlab # [ 1.665082] x86/mm: Checked W+X mappings: passed, no W+X pages found.580vm-test-run-nixbot-gitlab> gitlab # [ 1.667064] Run /init as init process581vm-test-run-nixbot-gitlab> gitlab # [ 1.680346] systemd[1]: Inserted module 'autofs4'582vm-test-run-nixbot-gitlab> gitlab # [ 1.708174] fuse: init (API version 7.45)583vm-test-run-nixbot-gitlab> gitlab # [ 1.718025] ACPI: \_SB_.LNKC: Enabled at IRQ 10584vm-test-run-nixbot-gitlab> gitlab # [ 1.727580] ACPI: \_SB_.LNKA: Enabled at IRQ 10585vm-test-run-nixbot-gitlab> gitlab # [ 1.733528] ACPI: \_SB_.LNKB: Enabled at IRQ 11586vm-test-run-nixbot-gitlab> gitlab # [ 1.798610] systemd[1]: Successfully made /usr/ read-only.587vm-test-run-nixbot-gitlab> gitlab # [ 2.138790] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)588vm-test-run-nixbot-gitlab> gitlab # [ 2.160721] systemd[1]: Detected virtualization kvm.589vm-test-run-nixbot-gitlab> gitlab # [ 2.164763] systemd[1]: Detected architecture x86-64.590vm-test-run-nixbot-gitlab> gitlab # [ 2.168975] systemd[1]: Running in initrd.591vm-test-run-nixbot-gitlab> gitlab # [ 2.173237] systemd[1]: Initializing machine ID from random generator.592vm-test-run-nixbot-gitlab> gitlab # [ 2.178472] systemd[1]: Hostname set to <gitlab>.593vm-test-run-nixbot-gitlab> gitlab # [ 2.258441] systemd[1]: Queued start job for default target Initrd Default Target.594vm-test-run-nixbot-gitlab> gitlab # [ 2.428768] systemd[1]: Created slice Slice /system/modprobe.595vm-test-run-nixbot-gitlab> gitlab # [ 2.434080] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.596vm-test-run-nixbot-gitlab> gitlab # [ 2.440246] systemd[1]: Expecting device /dev/disk/by-label/nix-store...597vm-test-run-nixbot-gitlab> gitlab # [ 2.445369] systemd[1]: Expecting device /dev/disk/by-label/nixos...598vm-test-run-nixbot-gitlab> gitlab # [ 2.450341] systemd[1]: Reached target Path Units.599vm-test-run-nixbot-gitlab> gitlab # [ 2.454065] systemd[1]: Reached target Slice Units.600vm-test-run-nixbot-gitlab> gitlab # [ 2.457223] systemd[1]: Reached target Swaps.601vm-test-run-nixbot-gitlab> gitlab # [ 2.460090] systemd[1]: Reached target Timer Units.602vm-test-run-nixbot-gitlab> gitlab # [ 2.463478] systemd[1]: Listening on D-Bus System Message Bus Socket.603vm-test-run-nixbot-gitlab> gitlab # [ 2.467690] systemd[1]: Listening on Journal Socket (/dev/log).604vm-test-run-nixbot-gitlab> gitlab # [ 2.471355] systemd[1]: Listening on Journal Sockets.605vm-test-run-nixbot-gitlab> gitlab # [ 2.473123] systemd[1]: Listening on udev Control Socket.606vm-test-run-nixbot-gitlab> gitlab # [ 2.475050] systemd[1]: Listening on udev Kernel Socket.607vm-test-run-nixbot-gitlab> gitlab # [ 2.476768] systemd[1]: Reached target Socket Units.608vm-test-run-nixbot-gitlab> gitlab # [ 2.483098] systemd[1]: Starting Create List of Static Device Nodes...609vm-test-run-nixbot-gitlab> gitlab # [ 2.489254] systemd[1]: Starting Load Kernel Module 9pnet_virtio...610vm-test-run-nixbot-gitlab> gitlab # [ 2.502477] systemd[1]: Starting Load Kernel Module configfs...611vm-test-run-nixbot-gitlab> gitlab # [ 2.507772] systemd[1]: Starting Journal Service...612vm-test-run-nixbot-gitlab> gitlab # [ 2.518303] systemd[1]: Starting Load Kernel Modules...613vm-test-run-nixbot-gitlab> gitlab # [ 2.522649] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki614vm-test-run-nixbot-gitlab> gitlab # [ 2.535481] systemd[1]: Starting Coldplug All udev Devices...615vm-test-run-nixbot-gitlab> gitlab # [ 2.555464] netfs: FS-Cache loaded616vm-test-run-nixbot-gitlab> gitlab # [ 2.555596] systemd-journald[151]: Collecting audit messages is disabled.617vm-test-run-nixbot-gitlab> gitlab # [ 2.560994] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.618vm-test-run-nixbot-gitlab> gitlab # [ 2.566634] 9pnet: Installing 9P2000 support619vm-test-run-nixbot-gitlab> gitlab # [ 2.571028] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev620vm-test-run-nixbot-gitlab> gitlab # [ 2.574778] systemd[1]: Finished Create List of Static Device Nodes.621vm-test-run-nixbot-gitlab> gitlab # [ 2.577775] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.622vm-test-run-nixbot-gitlab> gitlab # [ 2.582167] systemd[1]: Finished Load Kernel Module 9pnet_virtio.623vm-test-run-nixbot-gitlab> gitlab # [ 2.586744] systemd[1]: modprobe@configfs.service: Deactivated successfully.624vm-test-run-nixbot-gitlab> gitlab # [ 2.590676] systemd[1]: Finished Load Kernel Module configfs.625vm-test-run-nixbot-gitlab> gitlab # [ 2.596785] systemd[1]: Finished Load Kernel Modules.626vm-test-run-nixbot-gitlab> gitlab # [ 2.599353] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config627vm-test-run-nixbot-gitlab> gitlab # [ 2.605027] systemd[1]: Starting Apply Kernel Variables...628vm-test-run-nixbot-gitlab> gitlab # [ 2.608714] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...629vm-test-run-nixbot-gitlab> gitlab # [ 2.625029] systemd[1]: Started Journal Service.630vm-test-run-nixbot-gitlab> gitlab # [ 2.363389] systemd-modules-load[154]: Using 4 probe threads631vm-test-run-nixbot-gitlab> gitlab # [ 2.366125] systemd-modules-load[154]: Inserted module 'virtio_balloon'632vm-test-run-nixbot-gitlab> gitlab # [ 2.368057] systemd-modules-load[154]: Inserted module 'virtio_gpu'633vm-test-run-nixbot-gitlab> gitlab # [ 2.369849] systemd-modules-load[154]: Inserted module 'dm_mod'634vm-test-run-nixbot-gitlab> gitlab # [ 2.371502] systemd[1]: Finished Apply Kernel Variables.635vm-test-run-nixbot-gitlab> gitlab # [ 2.373317] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.636vm-test-run-nixbot-gitlab> gitlab # [ 2.377845] systemd[1]: Starting Create Static Device Nodes in /dev...637vm-test-run-nixbot-gitlab> gitlab # [ 2.399796] systemd[1]: Finished Create Static Device Nodes in /dev.638vm-test-run-nixbot-gitlab> gitlab # [ 2.401354] systemd[1]: Reached target Preparation for Local File Systems.639vm-test-run-nixbot-gitlab> gitlab # [ 2.402982] systemd[1]: Reached target Local File Systems.640vm-test-run-nixbot-gitlab> gitlab # [ 2.404444] systemd[1]: Starting Create System Files and Directories...641vm-test-run-nixbot-gitlab> gitlab # [ 2.406675] systemd[1]: Starting Rule-based Manager for Device Events and Files...642vm-test-run-nixbot-gitlab> gitlab # [ 2.421741] systemd[1]: Finished Create System Files and Directories.643vm-test-run-nixbot-gitlab> gitlab # [ 2.428444] systemd-udevd[194]: Using default interface naming scheme 'v260'.644vm-test-run-nixbot-gitlab> gitlab # [ 2.445249] systemd[1]: Started Rule-based Manager for Device Events and Files.645vm-test-run-nixbot-gitlab> gitlab # [ 2.485258] systemd[1]: Finished Coldplug All udev Devices.646vm-test-run-nixbot-gitlab> gitlab # [ 2.488093] systemd[1]: Reached target System Initialization.647vm-test-run-nixbot-gitlab> gitlab # [ 2.489670] systemd[1]: Reached target Basic System.648vm-test-run-nixbot-gitlab> gitlab # [ 2.873788] uhci_hcd 0000:00:01.2: UHCI Host Controller649vm-test-run-nixbot-gitlab> gitlab # [ 2.874497] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12650vm-test-run-nixbot-gitlab> gitlab # [ 2.875332] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1651vm-test-run-nixbot-gitlab> gitlab # [ 2.879080] serio: i8042 KBD port at 0x60,0x64 irq 1652vm-test-run-nixbot-gitlab> gitlab # [ 2.879599] uhci_hcd 0000:00:01.2: detected 2 ports653vm-test-run-nixbot-gitlab> gitlab # [ 2.879880] serio: i8042 AUX port at 0x60,0x64 irq 12654vm-test-run-nixbot-gitlab> gitlab # [ 2.880354] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140655vm-test-run-nixbot-gitlab> gitlab # [ 2.886971] SCSI subsystem initialized656vm-test-run-nixbot-gitlab> gitlab # [ 2.888628] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18657vm-test-run-nixbot-gitlab> gitlab # [ 2.890673] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1658vm-test-run-nixbot-gitlab> gitlab # [ 2.894517] usb usb1: Product: UHCI Host Controller659vm-test-run-nixbot-gitlab> gitlab # [ 2.895743] usb usb1: Manufacturer: Linux 6.18.34 uhci_hcd660vm-test-run-nixbot-gitlab> gitlab # [ 2.897171] usb usb1: SerialNumber: 0000:00:01.2661vm-test-run-nixbot-gitlab> gitlab # [ 2.902061] hub 1-0:1.0: USB hub found662vm-test-run-nixbot-gitlab> gitlab # [ 2.903086] hub 1-0:1.0: 2 ports detected663vm-test-run-nixbot-gitlab> gitlab # [ 2.904740] virtio_blk virtio4: 4/0/0 default/read/poll queues664vm-test-run-nixbot-gitlab> gitlab # [ 2.924102] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)665vm-test-run-nixbot-gitlab> gitlab # [ 2.936078] virtio_blk virtio5: 4/0/0 default/read/poll queues666vm-test-run-nixbot-gitlab> gitlab # [ 2.953522] virtio_blk virtio5: [vdb] 11449896 512-byte logical blocks (5.86 GB/5.46 GiB)667vm-test-run-nixbot-gitlab> gitlab # [ 2.970157] scsi host0: ata_piix668vm-test-run-nixbot-gitlab> gitlab # [ 2.971487] scsi host1: ata_piix669vm-test-run-nixbot-gitlab> gitlab # [ 2.982824] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0670vm-test-run-nixbot-gitlab> gitlab # [ 2.984703] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0671vm-test-run-nixbot-gitlab> gitlab # [ 2.727833] systemd[1]: Starting Virtual Console Setup...672vm-test-run-nixbot-gitlab> gitlab # [ 2.731386] (udev-worker)[207]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.673vm-test-run-nixbot-gitlab> gitlab # [ 2.736788] (udev-worker)[207]: Network interface NamePolicy= disabled on kernel command line.674vm-test-run-nixbot-gitlab> gitlab # [ 2.739919] (udev-worker)[223]: Network interface NamePolicy= disabled on kernel command line.675vm-test-run-nixbot-gitlab> gitlab # [ 2.749108] systemd[1]: Found device /dev/disk/by-label/nixos.676vm-test-run-nixbot-gitlab> gitlab # [ 2.752617] systemd[1]: Found device /dev/disk/by-label/nix-store.677vm-test-run-nixbot-gitlab> gitlab # [ 2.754287] systemd[1]: Reached target Initrd Root Device.678vm-test-run-nixbot-gitlab> gitlab # [ 2.755792] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...679vm-test-run-nixbot-gitlab> gitlab # [ 2.757979] systemd-vconsole-setup[233]: Configuration of first virtual console was skipped, ignoring remaining ones.680vm-test-run-nixbot-gitlab> gitlab # [ 2.760772] systemd[1]: Finished Virtual Console Setup.681vm-test-run-nixbot-gitlab> gitlab # [ 2.777354] systemd-fsck[242]: nixos: clean, 12/65536 files, 13019/262144 blocks682vm-test-run-nixbot-gitlab> gitlab # [ 2.783774] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.683vm-test-run-nixbot-gitlab> gitlab # [ 3.122081] usb 1-1: new full-speed USB device number 2 using uhci_hcd684vm-test-run-nixbot-gitlab> gitlab # [ 3.138534] ata2: found unknown device (class 0)685vm-test-run-nixbot-gitlab> gitlab # [ 3.143814] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100686vm-test-run-nixbot-gitlab> gitlab # [ 3.151160] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5687vm-test-run-nixbot-gitlab> gitlab # [ 3.183089] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0688vm-test-run-nixbot-gitlab> gitlab # [ 3.224122] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray689vm-test-run-nixbot-gitlab> gitlab # [ 3.259556] cdrom: Uniform CD-ROM driver Revision: 3.20690vm-test-run-nixbot-gitlab> gitlab # [ 3.292062] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00691vm-test-run-nixbot-gitlab> gitlab # [ 3.297022] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10692vm-test-run-nixbot-gitlab> gitlab # [ 3.301404] usb 1-1: Product: QEMU USB Tablet693vm-test-run-nixbot-gitlab> gitlab # [ 3.304189] usb 1-1: Manufacturer: QEMU694vm-test-run-nixbot-gitlab> gitlab # [ 3.306780] usb 1-1: SerialNumber: 28754-0000:00:01.2-1695vm-test-run-nixbot-gitlab> gitlab # [ 3.345721] hid: raw HID events driver (C) Jiri Kosina696vm-test-run-nixbot-gitlab> gitlab # [ 3.360775] usbcore: registered new interface driver usbhid697vm-test-run-nixbot-gitlab> gitlab # [ 3.364264] usbhid: USB HID core driver698vm-test-run-nixbot-gitlab> gitlab # [ 3.378739] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2699vm-test-run-nixbot-gitlab> gitlab # [ 3.385439] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0700vm-test-run-nixbot-gitlab> gitlab # [ 3.314179] systemd[1]: Mounting /sysroot...701vm-test-run-nixbot-gitlab> gitlab # [ 3.752338] EXT4-fs (vda): mounted filesystem b527a1d4-7540-451b-bdf2-cac13a488acb r/w with ordered data mode. Quota mode: none.702vm-test-run-nixbot-gitlab> gitlab # [ 3.495591] systemd[1]: Mounted /sysroot.703vm-test-run-nixbot-gitlab> gitlab # [ 3.496992] systemd[1]: Reached target Initrd Root File System.704vm-test-run-nixbot-gitlab> gitlab # [ 3.502068] systemd[1]: Mounting /sysroot/nix/.ro-store...705vm-test-run-nixbot-gitlab> gitlab # [ 3.512902] systemd[1]: Mounting /sysroot/nix/.rw-store...706vm-test-run-nixbot-gitlab> gitlab # [ 3.517424] systemd[1]: Mounting /sysroot/run...707vm-test-run-nixbot-gitlab> gitlab # [ 3.531880] systemd[1]: Mounting /sysroot/tmp/shared...708vm-test-run-nixbot-gitlab> gitlab # [ 3.795431] erofs (device vdb): mounted with root inode @ nid 128.709vm-test-run-nixbot-gitlab> gitlab # [ 3.535870] systemd[1]: Mounting /sysroot/tmp/xchg...710vm-test-run-nixbot-gitlab> gitlab # [ 3.539438] systemd[1]: Starting Mountpoints Configured in the Real Root...711vm-test-run-nixbot-gitlab> gitlab # [ 3.547303] systemd[1]: Mounted /sysroot/nix/.ro-store.712vm-test-run-nixbot-gitlab> gitlab # [ 3.548658] systemd[1]: Mounted /sysroot/nix/.rw-store.713vm-test-run-nixbot-gitlab> gitlab # [ 3.550049] systemd[1]: Mounted /sysroot/run.714vm-test-run-nixbot-gitlab> gitlab # [ 3.551483] systemd-sysroot-fstab-check[272]: /sysroot should be mounted in the initrd, will request daemon-reload.715vm-test-run-nixbot-gitlab> gitlab # [ 3.553906] systemd[1]: Reload requested from client PID 272 ('systemd-sysroot') (unit initrd-parse-etc.service)...716vm-test-run-nixbot-gitlab> gitlab # [ 3.556529] systemd[1]: Reloading...717vm-test-run-nixbot-gitlab> gitlab # [ 3.820540] 9p: Installing v9fs 9p2000 file system support718vm-test-run-nixbot-gitlab> gitlab # [ 3.789242] systemd[1]: Reloading finished in 236 ms.719vm-test-run-nixbot-gitlab> gitlab # [ 3.842637] systemd-sysroot-fstab-check[272]: Requesting initrd-fs.target/start/replace...720vm-test-run-nixbot-gitlab> gitlab # [ 3.996962] systemd[1]: Mounted /sysroot/tmp/shared.721vm-test-run-nixbot-gitlab> gitlab # [ 4.000465] systemd[1]: Mounted /sysroot/tmp/xchg.722vm-test-run-nixbot-gitlab> gitlab # [ 4.004616] systemd-sysroot-fstab-check[272]: Requesting swap.target/start/replace...723vm-test-run-nixbot-gitlab> gitlab # [ 4.011464] systemd[1]: Starting rw-sysroot-nix-store.service...724vm-test-run-nixbot-gitlab> gitlab # [ 4.015133] systemd[1]: initrd-parse-etc.service: Deactivated successfully.725vm-test-run-nixbot-gitlab> gitlab # [ 4.028780] systemd[1]: Finished Mountpoints Configured in the Real Root.726vm-test-run-nixbot-gitlab> gitlab # [ 4.032963] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.727vm-test-run-nixbot-gitlab> gitlab # [ 4.041595] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.728vm-test-run-nixbot-gitlab> gitlab # [ 4.049922] systemd[1]: Finished rw-sysroot-nix-store.service.729vm-test-run-nixbot-gitlab> gitlab # [ 4.315522] systemd[1]: Mounting /sysroot/nix/store...730vm-test-run-nixbot-gitlab> gitlab # [ 4.380109] systemd[1]: Mounted /sysroot/nix/store.731vm-test-run-nixbot-gitlab> gitlab # [ 4.384689] systemd[1]: Reached target Initrd File Systems.732vm-test-run-nixbot-gitlab> gitlab # [ 4.393568] systemd[1]: Starting Find NixOS closure...733vm-test-run-nixbot-gitlab> gitlab # [ 4.402232] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...734vm-test-run-nixbot-gitlab> gitlab # [ 4.431708] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.735vm-test-run-nixbot-gitlab> gitlab # [ 4.436518] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.736vm-test-run-nixbot-gitlab> gitlab # [ 4.457302] systemd[1]: Finished Find NixOS closure.737vm-test-run-nixbot-gitlab> gitlab # [ 4.460502] systemd[1]: Reached target Initrd Default Target.738vm-test-run-nixbot-gitlab> gitlab # [ 4.467711] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...739vm-test-run-nixbot-gitlab> gitlab # [ 4.504531] systemd[1]: Stopped target Initrd Default Target.740vm-test-run-nixbot-gitlab> gitlab # [ 4.508587] systemd[1]: Stopped target Basic System.741vm-test-run-nixbot-gitlab> gitlab # [ 4.511501] systemd[1]: Stopped target Initrd Root Device.742vm-test-run-nixbot-gitlab> gitlab # [ 4.514601] systemd[1]: Stopped target Path Units.743vm-test-run-nixbot-gitlab> gitlab # [ 4.517419] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.744vm-test-run-nixbot-gitlab> gitlab # [ 4.521332] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.745vm-test-run-nixbot-gitlab> gitlab # [ 4.525113] systemd[1]: Stopped target Slice Units.746vm-test-run-nixbot-gitlab> gitlab # [ 4.527449] systemd[1]: Stopped target Socket Units.747vm-test-run-nixbot-gitlab> gitlab # [ 4.529798] systemd[1]: Stopped target System Initialization.748vm-test-run-nixbot-gitlab> gitlab # [ 4.532515] systemd[1]: Stopped target Swaps.749vm-test-run-nixbot-gitlab> gitlab # [ 4.534592] systemd[1]: Stopped target Timer Units.750vm-test-run-nixbot-gitlab> gitlab # [ 4.536733] systemd[1]: dbus.socket: Deactivated successfully.751vm-test-run-nixbot-gitlab> gitlab # [ 4.539056] systemd[1]: Closed D-Bus System Message Bus Socket.752vm-test-run-nixbot-gitlab> gitlab # [ 4.541403] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.753vm-test-run-nixbot-gitlab> gitlab # [ 4.544374] systemd[1]: Stopped Find NixOS closure.754vm-test-run-nixbot-gitlab> gitlab # [ 4.546309] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio755vm-test-run-nixbot-gitlab> gitlab # [ 4.555003] systemd[1]: Starting rw-sysroot-nix-store.service...756vm-test-run-nixbot-gitlab> gitlab # [ 4.557403] systemd[1]: systemd-sysctl.service: Deactivated successfully.757vm-test-run-nixbot-gitlab> gitlab # [ 4.560063] systemd[1]: Stopped Apply Kernel Variables.758vm-test-run-nixbot-gitlab> gitlab # [ 4.562094] systemd[1]: systemd-modules-load.service: Deactivated successfully.759vm-test-run-nixbot-gitlab> gitlab # [ 4.563851] systemd[1]: Stopped Load Kernel Modules.760vm-test-run-nixbot-gitlab> gitlab # [ 4.570711] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.761vm-test-run-nixbot-gitlab> gitlab # [ 4.572602] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.762vm-test-run-nixbot-gitlab> gitlab # [ 4.575849] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.763vm-test-run-nixbot-gitlab> gitlab # [ 4.578450] systemd[1]: Stopped Create System Files and Directories.764vm-test-run-nixbot-gitlab> gitlab # [ 4.582377] systemd[1]: Stopped target Local File Systems.765vm-test-run-nixbot-gitlab> gitlab # [ 4.584592] systemd[1]: Stopped target Preparation for Local File Systems.766vm-test-run-nixbot-gitlab> gitlab # [ 4.587006] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.767vm-test-run-nixbot-gitlab> gitlab # [ 4.590422] systemd[1]: Stopped Coldplug All udev Devices.768vm-test-run-nixbot-gitlab> gitlab # [ 4.593251] systemd[1]: Stopping Rule-based Manager for Device Events and Files...769vm-test-run-nixbot-gitlab> gitlab # [ 4.595398] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.770vm-test-run-nixbot-gitlab> gitlab # [ 4.597873] systemd[1]: Stopped Virtual Console Setup.771vm-test-run-nixbot-gitlab> gitlab # [ 4.605331] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.772vm-test-run-nixbot-gitlab> gitlab # [ 4.610567] systemd[1]: Finished rw-sysroot-nix-store.service.773vm-test-run-nixbot-gitlab> gitlab # [ 4.615244] systemd[1]: systemd-udevd.service: Deactivated successfully.774vm-test-run-nixbot-gitlab> gitlab # [ 4.619835] systemd[1]: Stopped Rule-based Manager for Device Events and Files.775vm-test-run-nixbot-gitlab> gitlab # [ 4.622173] systemd[1]: systemd-udevd.service: Consumed 1.096s CPU time over 2.208s wall clock time, 27.9M memory peak.776vm-test-run-nixbot-gitlab> gitlab # [ 4.630572] systemd[1]: initrd-cleanup.service: Deactivated successfully.777vm-test-run-nixbot-gitlab> gitlab # [ 4.634390] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.778vm-test-run-nixbot-gitlab> gitlab # [ 4.644408] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.779vm-test-run-nixbot-gitlab> gitlab # [ 4.646634] systemd[1]: Closed udev Control Socket.780vm-test-run-nixbot-gitlab> gitlab # [ 4.652589] systemd[1]: Starting Cleanup udev Database...781vm-test-run-nixbot-gitlab> gitlab # [ 4.654515] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.782vm-test-run-nixbot-gitlab> gitlab # [ 4.656860] systemd[1]: Stopped Create Static Device Nodes in /dev.783vm-test-run-nixbot-gitlab> gitlab # [ 4.658885] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.784vm-test-run-nixbot-gitlab> gitlab # [ 4.661363] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.785vm-test-run-nixbot-gitlab> gitlab # [ 4.665482] systemd[1]: kmod-static-nodes.service: Deactivated successfully.786vm-test-run-nixbot-gitlab> gitlab # [ 4.667654] systemd[1]: Stopped Create List of Static Device Nodes.787vm-test-run-nixbot-gitlab> gitlab # [ 4.673343] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.788vm-test-run-nixbot-gitlab> gitlab # [ 4.677778] systemd[1]: Finished Cleanup udev Database.789vm-test-run-nixbot-gitlab> gitlab # [ 4.684151] systemd[1]: Reached target Switch Root.790vm-test-run-nixbot-gitlab> gitlab # [ 4.688958] systemd[1]: Starting NixOS Activation...791vm-test-run-nixbot-gitlab> gitlab # [ 4.785956] initrd-nixos-activation-start[567]: booting system configuration /nix/store/9f1l5ayb691nmqcrbgnh3mi0zkc22l7c-nixos-system-gitlab-test792vm-test-run-nixbot-gitlab> gitlab # [ 4.825426] initrd-nixos-activation-start[567]: running activation script...793vm-test-run-nixbot-gitlab> gitlab # [ 5.055765] initrd-nixos-activation-start[590]: setting up /etc...794vm-test-run-nixbot-gitlab> gitlab # [ 5.175670] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.795vm-test-run-nixbot-gitlab> gitlab # [ 5.181446] systemd[1]: Finished NixOS Activation.796vm-test-run-nixbot-gitlab> gitlab # [ 5.197639] systemd[1]: Starting Switch Root...797vm-test-run-nixbot-gitlab> gitlab # [ 5.216398] systemd[1]: Switching root.798vm-test-run-nixbot-gitlab> gitlab # [ 5.803019] systemd-journald[151]: Received SIGTERM from PID 1 (systemd).799vm-test-run-nixbot-gitlab> gitlab # [ 5.961079] NET: Registered PF_VSOCK protocol family800vm-test-run-nixbot-gitlab> gitlab # [ 6.328290] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)801vm-test-run-nixbot-gitlab> gitlab # [ 6.341052] systemd[1]: Detected virtualization kvm.802vm-test-run-nixbot-gitlab> gitlab # [ 6.344169] systemd[1]: Detected architecture x86-64.803vm-test-run-nixbot-gitlab> gitlab # [ 6.347440] systemd[1]: Detected first boot.804vm-test-run-nixbot-gitlab> gitlab # [ 6.351453] systemd[1]: Initializing machine ID from random generator.805vm-test-run-nixbot-gitlab> gitlab # [ 6.511274] systemd[1]: bpf-restrict-fs: LSM BPF program attached806vm-test-run-nixbot-gitlab> gitlab # [ 6.583774] systemd[1]: Applying preset policy.807vm-test-run-nixbot-gitlab> gitlab # [ 6.741606] systemd[1]: Populated /etc with preset unit settings.808vm-test-run-nixbot-gitlab> gitlab # [ 6.857811] systemd[1]: initrd-switch-root.service: Deactivated successfully.809vm-test-run-nixbot-gitlab> gitlab # [ 6.860223] systemd[1]: Stopped initrd-switch-root.service.810vm-test-run-nixbot-gitlab> gitlab # [ 6.863502] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.811vm-test-run-nixbot-gitlab> gitlab # [ 6.866993] systemd[1]: Created slice Slice /system/getty.812vm-test-run-nixbot-gitlab> gitlab # [ 6.869264] systemd[1]: Created slice GitLab DevOps Platform Slice.813vm-test-run-nixbot-gitlab> gitlab # [ 6.871515] systemd[1]: Created slice User and Session Slice.814vm-test-run-nixbot-gitlab> gitlab # [ 6.873199] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.815vm-test-run-nixbot-gitlab> gitlab # [ 6.875235] systemd[1]: Started Forward Password Requests to Wall Directory Watch.816vm-test-run-nixbot-gitlab> gitlab # [ 6.877161] systemd[1]: Expecting device /dev/hvc0...817vm-test-run-nixbot-gitlab> gitlab # [ 6.878465] systemd[1]: Expecting device /dev/ttyS0...818vm-test-run-nixbot-gitlab> gitlab # [ 6.879810] systemd[1]: Reached target Local Encrypted Volumes.819vm-test-run-nixbot-gitlab> gitlab # [ 6.881334] systemd[1]: Stopped target initrd-fs.target.820vm-test-run-nixbot-gitlab> gitlab # [ 6.882738] systemd[1]: Stopped target initrd-root-fs.target.821vm-test-run-nixbot-gitlab> gitlab # [ 6.884212] systemd[1]: Stopped target initrd-switch-root.target.822vm-test-run-nixbot-gitlab> gitlab # [ 6.885767] systemd[1]: Reached target Virtual Machines and Containers.823vm-test-run-nixbot-gitlab> gitlab # [ 6.887430] systemd[1]: Reached target Path Units.824vm-test-run-nixbot-gitlab> gitlab # [ 6.888733] systemd[1]: Reached target Remote File Systems.825vm-test-run-nixbot-gitlab> gitlab # [ 6.890198] systemd[1]: Reached target Slice Units.826vm-test-run-nixbot-gitlab> gitlab # [ 6.891485] systemd[1]: Reached target Swaps.827vm-test-run-nixbot-gitlab> gitlab # [ 6.893766] systemd[1]: Listening on Process Core Dump Socket.828vm-test-run-nixbot-gitlab> gitlab # [ 6.895995] systemd[1]: Listening on Credential Encryption/Decryption.829vm-test-run-nixbot-gitlab> gitlab # [ 6.899373] systemd[1]: Starting Journal Log Access Socket...830vm-test-run-nixbot-gitlab> gitlab # [ 6.901589] systemd[1]: Listening on Journal Audit Socket.831vm-test-run-nixbot-gitlab> gitlab # [ 6.903348] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.832vm-test-run-nixbot-gitlab> gitlab # [ 6.905202] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki833vm-test-run-nixbot-gitlab> gitlab # [ 6.907638] systemd[1]: Listening on udev Control Socket.834vm-test-run-nixbot-gitlab> gitlab # [ 6.913146] systemd[1]: Mounting Huge Pages File System...835vm-test-run-nixbot-gitlab> gitlab # [ 6.916120] systemd[1]: Mounting POSIX Message Queue File System...836vm-test-run-nixbot-gitlab> gitlab # [ 6.919313] systemd[1]: Mounting Kernel Debug File System...837vm-test-run-nixbot-gitlab> gitlab # [ 6.923952] systemd[1]: Mounting Kernel Trace File System...838vm-test-run-nixbot-gitlab> gitlab # [ 6.930635] systemd[1]: Starting Create List of Static Device Nodes...839vm-test-run-nixbot-gitlab> gitlab # [ 6.935356] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio840vm-test-run-nixbot-gitlab> gitlab # [ 6.946596] systemd[1]: Starting Load Kernel Module configfs...841vm-test-run-nixbot-gitlab> gitlab # [ 6.948162] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm842vm-test-run-nixbot-gitlab> gitlab # [ 6.950588] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore843vm-test-run-nixbot-gitlab> gitlab # [ 6.953226] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse844vm-test-run-nixbot-gitlab> gitlab # [ 6.957274] systemd[1]: Mounting FUSE Control File System...845vm-test-run-nixbot-gitlab> gitlab # [ 6.958774] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67846vm-test-run-nixbot-gitlab> gitlab # [ 6.965255] systemd[1]: Starting Journal Service...847vm-test-run-nixbot-gitlab> gitlab # [ 6.968069] systemd[1]: Starting Load Kernel Modules...848vm-test-run-nixbot-gitlab> gitlab # [ 6.976146] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...849vm-test-run-nixbot-gitlab> gitlab # [ 6.999039] systemd[1]: Starting Remount Root and Kernel File Systems...850vm-test-run-nixbot-gitlab> gitlab # [ 7.000880] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki851vm-test-run-nixbot-gitlab> gitlab # [ 7.008959] systemd[1]: Starting Coldplug All udev Devices...852vm-test-run-nixbot-gitlab> gitlab # [ 7.013887] systemd[1]: Listening on Journal Log Access Socket.853vm-test-run-nixbot-gitlab> gitlab # [ 7.018164] systemd[1]: Mounted Huge Pages File System.854vm-test-run-nixbot-gitlab> gitlab # [ 7.020014] systemd[1]: Mounted POSIX Message Queue File System.855vm-test-run-nixbot-gitlab> gitlab # [ 7.021772] systemd[1]: Mounted Kernel Debug File System.856vm-test-run-nixbot-gitlab> gitlab # [ 7.023428] systemd[1]: Mounted Kernel Trace File System.857vm-test-run-nixbot-gitlab> gitlab # [ 7.024810] systemd-journald[784]: Collecting audit messages is enabled.858vm-test-run-nixbot-gitlab> gitlab # [ 7.025674] systemd[1]: Finished Create List of Static Device Nodes.859vm-test-run-nixbot-gitlab> gitlab # [ 7.028469] systemd[1]: modprobe@configfs.service: Deactivated successfully.860vm-test-run-nixbot-gitlab> gitlab # [ 7.030752] systemd[1]: Finished Load Kernel Module configfs.861vm-test-run-nixbot-gitlab> gitlab # [ 7.032773] systemd[1]: Mounted FUSE Control File System.862vm-test-run-nixbot-gitlab> gitlab # [ 7.036350] loop: module loaded863vm-test-run-nixbot-gitlab> gitlab # [ 7.038496] EXT4-fs (vda): re-mounted b527a1d4-7540-451b-bdf2-cac13a488acb.864vm-test-run-nixbot-gitlab> gitlab # [ 7.042336] systemd[1]: Mounting Kernel Configuration File System...865vm-test-run-nixbot-gitlab> gitlab # [ 6.783780] systemd[1]: Queued start job for default target Multi-User System.866vm-test-run-nixbot-gitlab> gitlab # [ 7.048486] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...867vm-test-run-nixbot-gitlab> gitlab # [ 6.788661] systemd[1]: Unnecessary job was r[ 7.051695] systemd[1]: Started Journal Service.868vm-test-run-nixbot-gitlab> gitlab # emoved for /dev/vdb.869vm-test-run-nixbot-gitlab> gitlab # [ 6.791582] systemd[1]: systemd-journald.service: Deactivated successfully.870vm-test-run-nixbot-gitlab> gitlab # [ 6.793765] systemd-modules-load[785]: Using 3 probe threads871vm-test-run-nixbot-gitlab> gitlab # [ 6.795467] systemd-modules-load[785]: Inserted module 'tls'872vm-test-run-nixbot-gitlab> gitlab # [ 6.797781] systemd-modules-load[785]: Inserted module 'loop'873vm-test-run-nixbot-gitlab> gitlab # [ 6.799487] systemd[1]: Finished Load Kernel Modules.874vm-test-run-nixbot-gitlab> gitlab # [ 6.803752] systemd-oomd[786]: No swap; memory pressure usage will be degraded875vm-test-run-nixbot-gitlab> gitlab # [ 6.806491] systemd[1]: Finished Remount Root and Kernel File Systems.876vm-test-run-nixbot-gitlab> gitlab # [ 6.808514] systemd[1]: Starting Firewall...877vm-test-run-nixbot-gitlab> gitlab # [ 6.810213] systemd[1]: Starting Flush Journal to Persistent Storage...878vm-test-run-nixbot-gitlab> gitlab # [ 6.812360] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore879vm-test-run-nixbot-gitlab> gitlab # [ 6.815654] systemd[1]: Starting Load/Save OS Random Seed...880vm-test-run-nixbot-gitlab> gitlab # [ 6.820821] systemd[1]: Starting Apply Kernel Variables...881vm-test-run-nixbot-gitlab> gitlab # [ 6.822536] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki882vm-test-run-nixbot-gitlab> gitlab # [ 6.825352] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.883vm-test-run-nixbot-gitlab> gitlab # [ 7.092199] systemd-journald[784]: Received client request to flush runtime journal.884vm-test-run-nixbot-gitlab> gitlab # [ 6.904824] systemd[1]: Mounted Kernel Configuration File System.885vm-test-run-nixbot-gitlab> gitlab # [ 6.907476] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.886vm-test-run-nixbot-gitlab> gitlab # [ 6.909809] systemd[1]: Starting Create Static Device Nodes in /dev...887vm-test-run-nixbot-gitlab> gitlab # [ 6.911874] systemd[1]: Finished Apply Kernel Variables.888vm-test-run-nixbot-gitlab> gitlab # [ 6.913597] systemd[1]: Finished Load/Save OS Random Seed.889vm-test-run-nixbot-gitlab> gitlab # [ 6.915387] systemd[1]: Reached target First Boot Complete.890vm-test-run-nixbot-gitlab> gitlab # [ 6.917192] systemd[1]: Finished Create Static Device Nodes in /dev.891vm-test-run-nixbot-gitlab> gitlab # [ 6.919150] systemd[1]: Reached target Preparation for Local File Systems.892vm-test-run-nixbot-gitlab> gitlab # [ 6.921109] systemd[1]: Starting Rule-based Manager for Device Events and Files...893vm-test-run-nixbot-gitlab> gitlab # [ 6.923482] systemd-udevd[819]: Using default interface naming scheme 'v260'.894vm-test-run-nixbot-gitlab> gitlab # [ 6.925467] systemd[1]: Finished Flush Journal to Persistent Storage.895vm-test-run-nixbot-gitlab> gitlab # [ 6.944278] systemd[1]: Started Rule-based Manager for Device Events and Files.896vm-test-run-nixbot-gitlab> gitlab # [ 6.974216] systemd[1]: Finished Coldplug All udev Devices.897vm-test-run-nixbot-gitlab> gitlab # [ 7.072601] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse898vm-test-run-nixbot-gitlab> gitlab # [ 7.080247] systemd[1]: Finished Firewall.899vm-test-run-nixbot-gitlab> gitlab # [ 7.108227] (udev-worker)[917]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.900vm-test-run-nixbot-gitlab> gitlab # [ 7.115050] (udev-worker)[917]: Network interface NamePolicy= disabled on kernel command line.901vm-test-run-nixbot-gitlab> gitlab # [ 7.117136] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.902vm-test-run-nixbot-gitlab> gitlab # [ 7.119469] (udev-worker)[912]: Network interface NamePolicy= disabled on kernel command line.903vm-test-run-nixbot-gitlab> gitlab # [ 7.125167] systemd[1]: Condition check resulted in Virtio network device being skipped.904vm-test-run-nixbot-gitlab> gitlab # [ 7.127216] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore905vm-test-run-nixbot-gitlab> gitlab # [ 7.129766] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67906vm-test-run-nixbot-gitlab> gitlab # [ 7.133429] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore907vm-test-run-nixbot-gitlab> gitlab # [ 7.136100] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki908vm-test-run-nixbot-gitlab> gitlab # [ 7.138261] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki909vm-test-run-nixbot-gitlab> gitlab # [ 7.145620] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.910vm-test-run-nixbot-gitlab> gitlab # [ 7.448045] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3911vm-test-run-nixbot-gitlab> gitlab # [ 7.455494] mousedev: PS/2 mouse device common for all mice912vm-test-run-nixbot-gitlab> gitlab # [ 7.460946] ACPI: button: Power Button [PWRF]913vm-test-run-nixbot-gitlab> gitlab # [ 7.470259] Floppy drive(s): fd0 is 2.88M AMI BIOS914vm-test-run-nixbot-gitlab> gitlab # [ 7.472418] rtc_cmos 00:05: RTC can wake from S4915vm-test-run-nixbot-gitlab> gitlab # [ 7.480748] rtc_cmos 00:05: registered as rtc0916vm-test-run-nixbot-gitlab> gitlab # [ 7.482065] rtc_cmos 00:05: setting system clock to 2026-07-01T17:50:13 UTC (1782928213)917vm-test-run-nixbot-gitlab> gitlab # [ 7.484773] FDC 0 is a S82078B918vm-test-run-nixbot-gitlab> gitlab # [ 7.485064] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs919vm-test-run-nixbot-gitlab> gitlab # [ 7.508962] parport_pc 00:03: reported by Plug and Play ACPI920vm-test-run-nixbot-gitlab> gitlab # [ 7.510866] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]921vm-test-run-nixbot-gitlab> gitlab # [ 7.518419] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console922vm-test-run-nixbot-gitlab> gitlab # [ 7.526133] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0923vm-test-run-nixbot-gitlab> gitlab # [ 7.526208] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD924vm-test-run-nixbot-gitlab> gitlab # [ 7.533477] Console: switching to colour dummy device 80x25925vm-test-run-nixbot-gitlab> gitlab # [ 7.539466] [drm] Found bochs VGA, ID 0xb0c5.926vm-test-run-nixbot-gitlab> gitlab # [ 7.539468] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.927vm-test-run-nixbot-gitlab> gitlab # [ 7.546565] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic928vm-test-run-nixbot-gitlab> gitlab # [ 7.548181] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0929vm-test-run-nixbot-gitlab> gitlab # [ 7.551578] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5930vm-test-run-nixbot-gitlab> gitlab # [ 7.555294] fbcon: bochs-drmdrmfb (fb0) is primary device931vm-test-run-nixbot-gitlab> gitlab # [ 7.565495] Console: switching to colour frame buffer device 160x50932vm-test-run-nixbot-gitlab> gitlab # [ 7.569027] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device933vm-test-run-nixbot-gitlab> gitlab # [ 7.571328] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4934vm-test-run-nixbot-gitlab> gitlab # [ 7.574176] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6935vm-test-run-nixbot-gitlab> gitlab # [ 7.371540] systemd[1]: Starting Virtual Console Setup...936vm-test-run-nixbot-gitlab> gitlab # [ 7.669041] ppdev: user-space parallel port driver937vm-test-run-nixbot-gitlab> gitlab # [ 7.414178] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.938vm-test-run-nixbot-gitlab> gitlab # [ 7.416144] systemd[1]: Stopped Virtual Console Setup.939vm-test-run-nixbot-gitlab> gitlab # [ 7.424448] systemd[1]: Starting Virtual Console Setup...940vm-test-run-nixbot-gitlab> gitlab # [ 7.434216] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.941vm-test-run-nixbot-gitlab> gitlab # [ 7.438101] systemd[1]: Stopped Virtual Console Setup.942vm-test-run-nixbot-gitlab> gitlab # [ 7.443267] systemd[1]: Starting Virtual Console Setup...943vm-test-run-nixbot-gitlab> gitlab # [ 7.737449] kvm_amd: TSC scaling supported944vm-test-run-nixbot-gitlab> gitlab # [ 7.738529] kvm_amd: Nested Virtualization enabled945vm-test-run-nixbot-gitlab> gitlab # [ 7.739782] kvm_amd: Nested Paging enabled946vm-test-run-nixbot-gitlab> gitlab # [ 7.740853] kvm_amd: LBR virtualization supported947vm-test-run-nixbot-gitlab> gitlab # [ 7.742019] kvm_amd: Virtual VMLOAD VMSAVE supported948vm-test-run-nixbot-gitlab> gitlab # [ 7.743290] kvm_amd: Virtual GIF supported949vm-test-run-nixbot-gitlab> gitlab # [ 7.744343] kvm_amd: Virtual NMI enabled950vm-test-run-nixbot-gitlab> gitlab # [ 7.793759] EDAC MC: Ver: 3.0.0951vm-test-run-nixbot-gitlab> gitlab # [ 7.535994] systemd-vconsole-setup[957]: Configuration of first virtual console was skipped, ignoring remaining ones.952vm-test-run-nixbot-gitlab> gitlab # [ 7.538947] systemd[1]: Finished Virtual Console Setup.953vm-test-run-nixbot-gitlab> gitlab # [ 7.597083] systemd[1]: Mounting /run/wrappers...954vm-test-run-nixbot-gitlab> gitlab # [ 7.620595] systemd[1]: Mounted /run/wrappers.955vm-test-run-nixbot-gitlab> gitlab # [ 7.622823] systemd[1]: Reached target Local File Systems.956vm-test-run-nixbot-gitlab> gitlab # [ 7.625391] systemd[1]: Listening on Boot Loader Control Service Socket.957vm-test-run-nixbot-gitlab> gitlab # [ 7.628629] systemd[1]: Starting register-nix-paths.service...958vm-test-run-nixbot-gitlab> gitlab # [ 7.631407] systemd[1]: Starting Create SUID/SGID Wrappers...959vm-test-run-nixbot-gitlab> gitlab # [ 7.634149] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.960vm-test-run-nixbot-gitlab> gitlab # [ 7.640298] systemd[1]: Starting Save Transient machine-id to Disk...961vm-test-run-nixbot-gitlab> gitlab # [ 7.643869] systemd[1]: Starting Create System Files and Directories...962vm-test-run-nixbot-gitlab> gitlab # [ 7.678101] systemd[1]: Finished Create System Files and Directories.963vm-test-run-nixbot-gitlab> gitlab # [ 7.680793] systemd[1]: Starting Rebuild Journal Catalog...964vm-test-run-nixbot-gitlab> gitlab # [ 7.684570] systemd[1]: Starting Record System Boot/Shutdown in UTMP...965vm-test-run-nixbot-gitlab> gitlab # [ 7.686407] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.966vm-test-run-nixbot-gitlab> gitlab # [ 7.688440] systemd[1]: Finished Save Transient machine-id to Disk.967vm-test-run-nixbot-gitlab> gitlab # [ 7.706078] systemd[1]: Finished Record System Boot/Shutdown in UTMP.968vm-test-run-nixbot-gitlab> gitlab # [ 7.712235] systemd[1]: Finished Rebuild Journal Catalog.969vm-test-run-nixbot-gitlab> gitlab # [ 7.714213] systemd[1]: Starting Update is Completed...970vm-test-run-nixbot-gitlab> gitlab # [ 7.731768] systemd[1]: Finished Update is Completed.971vm-test-run-nixbot-gitlab> gitlab # [ 7.772238] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.972vm-test-run-nixbot-gitlab> gitlab # [ 7.774144] systemd[1]: Finished Create SUID/SGID Wrappers.973vm-test-run-nixbot-gitlab> gitlab # [ 7.775557] systemd[1]: suid-sgid-wrappers.service: Consumed 118ms CPU time over 146ms wall clock time, 4.8M memory peak, 1.1M read from disk.974vm-test-run-nixbot-gitlab> gitlab # [ 8.018733] systemd[1]: Finished register-nix-paths.service.975vm-test-run-nixbot-gitlab> gitlab # [ 8.022523] systemd[1]: Reached target System Initialization.976vm-test-run-nixbot-gitlab> gitlab # [ 8.026226] systemd[1]: Started Discard unused filesystem blocks once a week.977vm-test-run-nixbot-gitlab> gitlab # [ 8.030617] systemd[1]: Started logrotate.timer.978vm-test-run-nixbot-gitlab> gitlab # [ 8.033652] systemd[1]: Started Daily Cleanup of Temporary Directories.979vm-test-run-nixbot-gitlab> gitlab # [ 8.037731] systemd[1]: Reached target Timer Units.980vm-test-run-nixbot-gitlab> gitlab # [ 8.040955] systemd[1]: Listening on D-Bus System Message Bus Socket.981vm-test-run-nixbot-gitlab> gitlab # [ 8.044918] systemd[1]: Listening on Nix Daemon Socket.982vm-test-run-nixbot-gitlab> gitlab # [ 8.048546] systemd[1]: Starting nixbot CI service socket...983vm-test-run-nixbot-gitlab> gitlab # [ 8.052452] systemd[1]: Listening on Hostname Service Socket.984vm-test-run-nixbot-gitlab> gitlab # [ 8.057230] systemd[1]: Listening on nixbot CI service socket.985vm-test-run-nixbot-gitlab> gitlab # [ 8.062688] systemd[1]: Reached target Socket Units.986vm-test-run-nixbot-gitlab> gitlab # [ 8.070185] systemd[1]: Starting D-Bus System Message Bus...987vm-test-run-nixbot-gitlab> gitlab # [ 8.138874] dbus-broker-launch[1047]: Looking up NSS user entry for 'systemd-timesync'...988vm-test-run-nixbot-gitlab> gitlab # [ 8.144524] dbus-broker-launch[1047]: NSS returned no entry for 'systemd-timesync'989vm-test-run-nixbot-gitlab> gitlab # [ 8.149392] dbus-broker-launch[1047]: Invalid user-name in /nix/store/89zj9nmrajvcy9c3c08wv0ir9ww7lgmq-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"990vm-test-run-nixbot-gitlab> gitlab # [ 8.158714] systemd[1]: Started D-Bus System Message Bus.991vm-test-run-nixbot-gitlab> gitlab # [ 8.162651] dbus-broker-launch[1047]: Ready992vm-test-run-nixbot-gitlab> gitlab # [ 8.165818] systemd[1]: Reached target Basic System.993vm-test-run-nixbot-gitlab> gitlab # [ 8.168937] systemd[1]: Started backdoor.service.994vm-test-run-nixbot-gitlab> gitlab # [ 8.172111] systemd[1]: Starting gitlab-config.service...995vm-test-run-nixbot-gitlab> gitlab # [ 8.175545] systemd[1]: Starting Import lastlog data into lastlog2 database...996vm-test-run-nixbot-gitlab> gitlab # [ 8.179802] systemd[1]: Starting Logrotate configuration check...997vm-test-run-nixbot-gitlab> gitlab # [ 8.189492] systemd[1]: Starting Name Service Cache Daemon (nsncd)...998vm-test-run-nixbot-gitlab> gitlab # [ 8.195207] systemd[1]: Starting Post-Boot Actions...999vm-test-run-nixbot-gitlab> gitlab # [ 8.198425] systemd[1]: Started Reset console on configuration changes.1000vm-test-run-nixbot-gitlab> gitlab # [ 8.205495] logrotate[1052]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.1001vm-test-run-nixbot-gitlab> gitlab # [ 8.210932] logrotate[1052]: reading config file /nix/store/sn4bd2nqi3yg4r51djm9i2rmfgbwvmhb-logrotate.conf1002vm-test-run-nixbot-gitlab> gitlab # connecting to host...1003vm-test-run-nixbot-gitlab> gitlab # [ 8.213822] logrotate[1052]: note: 'monthly' overrides previously specified 'weekly'1004vm-test-run-nixbot-gitlab> gitlab # [ 8.215780] logrotate[1052]: Reading state from file: /var/lib/logrotate.status1005vm-test-run-nixbot-gitlab> gitlab # [ 8.217599] logrotate[1052]: state file /var/lib/logrotate.status does not exist1006vm-test-run-nixbot-gitlab> gitlab # [ 8.219605] logrotate[1052]: Allocating hash table for state file, size 64 entries1007vm-test-run-nixbot-gitlab> gitlab # [ 8.221569] logrotate[1052]: Handling 4 logs1008vm-test-run-nixbot-gitlab> gitlab # [ 8.222897] systemd[1]: Starting resolvconf update...1009vm-test-run-nixbot-gitlab> gitlab: Guest shell says: b'Spawning backdoor root shell...\n'1010vm-test-run-nixbot-gitlab> gitlab: connected to guest root shell1011vm-test-run-nixbot-gitlab> gitlab: (connecting took 9.07 seconds)1012vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for the VM to finish booting, in 9.07 seconds)1013vm-test-run-nixbot-gitlab> gitlab # [ 8.224456] logrotate[1052]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed1014vm-test-run-nixbot-gitlab> gitlab # [ 8.228556] logrotate[1052]: considering log /var/log/btmp1015vm-test-run-nixbot-gitlab> gitlab # [ 8.229907] logrotate[1052]: Creating new state1016vm-test-run-nixbot-gitlab> gitlab # [ 8.231106] logrotate[1052]: Now: 2026-07-01 17:501017vm-test-run-nixbot-gitlab> gitlab # [ 8.232414] logrotate[1052]: Last rotated at 2026-07-01 17:001018vm-test-run-nixbot-gitlab> gitlab # [ 8.233969] logrotate[1052]: log does not need rotating (log has already been rotated)1019vm-test-run-nixbot-gitlab> gitlab # [ 8.235873] logrotate[1052]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed1020vm-test-run-nixbot-gitlab> gitlab # [ 8.239933] logrotate[1052]: considering log /var/log/wtmp1021vm-test-run-nixbot-gitlab> gitlab # [ 8.241225] logrotate[1052]: Creating new state1022vm-test-run-nixbot-gitlab> gitlab # [ 8.242264] logrotate[1052]: Now: 2026-07-01 17:501023vm-test-run-nixbot-gitlab> gitlab # [ 8.243457] logrotate[1052]: Last rotated at 2026-07-01 17:001024vm-test-run-nixbot-gitlab> gitlab # [ 8.244445] logrotate[1052]: log does not need rotating (log has already been rotated)1025vm-test-run-nixbot-gitlab> gitlab # [ 8.245800] logrotate[1052]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed1026vm-test-run-nixbot-gitlab> gitlab # [ 8.246789] logrotate[1052]: switching euid from 0 to 165 and egid from 0 to 165 (pid 1052)1027vm-test-run-nixbot-gitlab> gitlab # [ 8.247698] logrotate[1052]: considering log /var/gitlab/state/log/*.log1028vm-test-run-nixbot-gitlab> gitlab # [ 8.248852] logrotate[1052]: log /var/gitlab/state/log/*.log does not exist -- skipping1029vm-test-run-nixbot-gitlab> gitlab # [ 8.249960] logrotate[1052]: Creating new state1030vm-test-run-nixbot-gitlab> gitlab # [ 8.251328] logrotate[1052]: switching euid from 165 to 0 and egid from 165 to 0 (pid 1052)1031vm-test-run-nixbot-gitlab> gitlab # [ 8.252366] logrotate[1052]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed1032vm-test-run-nixbot-gitlab> gitlab # [ 8.253335] logrotate[1052]: switching euid from 0 to 60 and egid from 0 to 60 (pid 1052)1033vm-test-run-nixbot-gitlab> gitlab # [ 8.254274] logrotate[1052]: considering log /var/log/nginx/*.log1034vm-test-run-nixbot-gitlab> gitlab # [ 8.255182] logrotate[1052]: log /var/log/nginx/*.log does not exist -- skipping1035vm-test-run-nixbot-gitlab> gitlab # [ 8.256088] logrotate[1052]: Creating new state1036vm-test-run-nixbot-gitlab> gitlab # [ 8.256926] logrotate[1052]: switching euid from 60 to 0 and egid from 60 to 0 (pid 1052)1037vm-test-run-nixbot-gitlab> gitlab # [ 8.258603] systemd[1]: Finished Logrotate configuration check.1038vm-test-run-nixbot-gitlab> gitlab # [ 8.260295] systemd[1]: Finished Post-Boot Actions.1039vm-test-run-nixbot-gitlab> gitlab # [ 8.261614] systemd[1]: Finished Import lastlog data into lastlog2 database.1040vm-test-run-nixbot-gitlab> gitlab # [ 8.263097] nsncd[1053]: Jul 01 17:50:14.526 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"1041vm-test-run-nixbot-gitlab> gitlab # [ 8.264279] systemd[1]: Started Name Service Cache Daemon (nsncd).1042vm-test-run-nixbot-gitlab> gitlab # [ 8.265403] systemd[1]: Reached target Host and Network Name Lookups.1043vm-test-run-nixbot-gitlab> gitlab # [ 8.266457] systemd[1]: Reached target User and Group Name Lookups.1044vm-test-run-nixbot-gitlab> gitlab # [ 8.267517] systemd[1]: Starting User Login Management...1045vm-test-run-nixbot-gitlab> gitlab # [ 8.311204] systemd[1]: Stopped target Host and Network Name Lookups.1046vm-test-run-nixbot-gitlab> gitlab # [ 8.313483] systemd[1]: Stopping Host and Network Name Lookups...1047vm-test-run-nixbot-gitlab> gitlab # [ 8.314953] systemd[1]: Stopped target User and Group Name Lookups.1048vm-test-run-nixbot-gitlab> gitlab # [ 8.317217] systemd[1]: Stopping User and Group Name Lookups...1049vm-test-run-nixbot-gitlab> gitlab # [ 8.318356] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...1050vm-test-run-nixbot-gitlab> gitlab # [ 8.321687] systemd[1]: nscd.service: Deactivated successfully.1051vm-test-run-nixbot-gitlab> gitlab # [ 8.325087] systemd[1]: Stopped Name Service Cache Daemon (nsncd).1052vm-test-run-nixbot-gitlab> gitlab # [ 8.327885] systemd[1]: nscd.service: Consumed 23ms CPU time over 131ms wall clock time, 7.6M memory peak, 5.7M read from disk.1053vm-test-run-nixbot-gitlab> gitlab # [ 8.331162] systemd-logind[1090]: New seat seat0.1054vm-test-run-nixbot-gitlab> gitlab # [ 8.333076] systemd-logind[1090]: Watching system buttons on /dev/input/event2 (Power Button)1055vm-test-run-nixbot-gitlab> gitlab # [ 8.334332] systemd-logind[1090]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard)1056vm-test-run-nixbot-gitlab> gitlab # [ 8.336098] systemd-logind[1090]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)1057vm-test-run-nixbot-gitlab> gitlab # [ 8.340411] systemd[1]: Starting Name Service Cache Daemon (nsncd)...1058vm-test-run-nixbot-gitlab> gitlab # [ 8.342187] systemd[1]: Started User Login Management.1059vm-test-run-nixbot-gitlab> gitlab # [ 8.348233] systemd[1]: Starting linger-users.service...1060vm-test-run-nixbot-gitlab> gitlab # [ 8.353837] systemd[1]: Finished resolvconf update.1061vm-test-run-nixbot-gitlab> gitlab # [ 8.357208] systemd[1]: linger-users.service: Deactivated successfully.1062vm-test-run-nixbot-gitlab> gitlab # [ 8.358687] nsncd[1144]: Jul 01 17:50:14.637 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"1063vm-test-run-nixbot-gitlab> gitlab # [ 8.359863] systemd[1]: Finished linger-users.service.1064vm-test-run-nixbot-gitlab> gitlab # [ 8.360897] systemd[1]: Started Name Service Cache Daemon (nsncd).1065vm-test-run-nixbot-gitlab> gitlab # [ 8.362069] systemd[1]: Reached target Preparation for Network.1066vm-test-run-nixbot-gitlab> gitlab # [ 8.362985] systemd[1]: Reached target Host and Network Name Lookups.1067vm-test-run-nixbot-gitlab> gitlab # [ 8.364064] systemd[1]: Reached target User and Group Name Lookups.1068vm-test-run-nixbot-gitlab> gitlab # [ 8.364920] systemd[1]: Starting DHCP Client...1069vm-test-run-nixbot-gitlab> gitlab # [ 8.367469] systemd[1]: Starting Address configuration of eth1...1070vm-test-run-nixbot-gitlab> gitlab # [ 8.370263] systemd[1]: Starting Extra networking commands....1071vm-test-run-nixbot-gitlab> gitlab # [ 8.393275] network-addresses-eth1-start[1166]: adding address 192.168.1.1/24... done1072vm-test-run-nixbot-gitlab> gitlab # [ 8.397748] network-addresses-eth1-start[1166]: adding address 2001:db8:1::1/64... done1073vm-test-run-nixbot-gitlab> gitlab # [ 8.404233] systemd[1]: Finished Address configuration of eth1.1074vm-test-run-nixbot-gitlab> gitlab # [ 8.437056] systemd[1]: Finished Extra networking commands..1075vm-test-run-nixbot-gitlab> gitlab # [ 8.438618] systemd[1]: Reached target Network.1076vm-test-run-nixbot-gitlab> gitlab # [ 8.440367] systemd[1]: Starting gitlab-workhorse.service...1077vm-test-run-nixbot-gitlab> gitlab # [ 8.442697] systemd[1]: Starting Nginx Web Server...1078vm-test-run-nixbot-gitlab> gitlab # [ 8.450948] systemd[1]: Starting PostgreSQL Server...1079vm-test-run-nixbot-gitlab> gitlab # [ 8.453105] dhcpcd[1178]: dhcpcd-10.3.2 starting1080vm-test-run-nixbot-gitlab> gitlab # [ 8.454381] systemd[1]: Starting Redis Server - redis-gitlab...1081vm-test-run-nixbot-gitlab> gitlab # [ 8.456462] systemd[1]: Starting Permit User Sessions...1082vm-test-run-nixbot-gitlab> gitlab # [ 8.459651] dhcpcd[1229]: dev: loaded udev1083vm-test-run-nixbot-gitlab> gitlab # [ 8.727541] 8021q: 802.1Q VLAN Support v1.81084vm-test-run-nixbot-gitlab> gitlab # [ 8.728730] 8021q: adding VLAN 0 to HW filter on device eth11085vm-test-run-nixbot-gitlab> gitlab # [ 8.472537] systemd[1]: Finished Permit User Sessions.1086vm-test-run-nixbot-gitlab> gitlab # [ 8.487108] systemd[1]: Started Getty on tty1.1087vm-test-run-nixbot-gitlab> gitlab # [ 8.488240] systemd[1]: Reached target Login Prompts.1088vm-test-run-nixbot-gitlab> gitlab # [ 8.497789] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.1089vm-test-run-nixbot-gitlab> gitlab # [ 8.830333] cfg80211: Loading compiled-in X.509 certificates for regulatory database1090vm-test-run-nixbot-gitlab> gitlab # [ 8.839640] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'1091vm-test-run-nixbot-gitlab> gitlab # [ 8.841069] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'1092vm-test-run-nixbot-gitlab> gitlab # [ 8.843332] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -21093vm-test-run-nixbot-gitlab> gitlab # [ 8.845210] cfg80211: failed to load regulatory.db1094vm-test-run-nixbot-gitlab> gitlab # [ 8.588674] nginx-pre-start[1251]: nginx: the configuration file /nix/store/nlpb2pnbsk0921apkv5yml2qxbm30d7w-nginx.conf syntax is ok1095vm-test-run-nixbot-gitlab> gitlab # [ 8.590043] nginx-pre-start[1251]: nginx: configuration file /nix/store/nlpb2pnbsk0921apkv5yml2qxbm30d7w-nginx.conf test is successful1096vm-test-run-nixbot-gitlab> gitlab # [ 8.598093] systemd[1]: Started Nginx Web Server.1097vm-test-run-nixbot-gitlab> gitlab # [ 8.611579] postgresql-pre-start[1250]: The files belonging to this database system will be o[ 8.876115] 8021q: adding VLAN 0 to HW filter on device eth01098vm-test-run-nixbot-gitlab> gitlab # wned by user "postgres".1099vm-test-run-nixbot-gitlab> gitlab # [ 8.615789] postgresql-pre-start[1250]: This user must also own the server process.1100vm-test-run-nixbot-gitlab> gitlab # [ 8.618609] dhcpcd[1229]: eth0: waiting for carrier1101vm-test-run-nixbot-gitlab> gitlab # [ 8.620514] dhcpcd[1229]: eth0: carrier acquired1102vm-test-run-nixbot-gitlab> gitlab # [ 8.621906] postgresql-pre-start[1250]: The database cluster will be initialized with locale "en_US.UTF-8".1103vm-test-run-nixbot-gitlab> gitlab # [ 8.627211] postgresql-pre-start[1250]: The default database encoding has accordingly been set to "UTF8".1104vm-test-run-nixbot-gitlab> gitlab # [ 8.631143] postgresql-pre-start[1250]: The default text search configuration will be set to "english".1105vm-test-run-nixbot-gitlab> gitlab # [ 8.633190] postgresql-pre-start[1250]: Data page checksums are disabled.1106vm-test-run-nixbot-gitlab> gitlab # [ 8.634416] postgresql-pre-start[1250]: fixing permissions on existing directory /var/lib/postgresql/17 ... ok1107vm-test-run-nixbot-gitlab> gitlab # [ 8.635247] postgresql-pre-start[1250]: creating subdirectories ... ok1108vm-test-run-nixbot-gitlab> gitlab # [ 8.636223] postgresql-pre-start[1250]: selecting dynamic shared memory implementation ... posix1109vm-test-run-nixbot-gitlab> gitlab # [ 8.637324] dhcpcd[1229]: DUID 00:01:00:01:31:d8:0f:d6:52:54:00:12:34:561110vm-test-run-nixbot-gitlab> gitlab # [ 8.638356] dhcpcd[1229]: eth0: IAID 00:12:34:561111vm-test-run-nixbot-gitlab> gitlab # [ 8.639352] dhcpcd[1229]: eth0: adding address fe80::5054:ff:fe12:34561112vm-test-run-nixbot-gitlab> gitlab # [ 8.656983] postgresql-pre-start[1250]: selecting default "max_connections" ... 1001113vm-test-run-nixbot-gitlab> gitlab # [ 8.661386] redis-server[1247]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.1114vm-test-run-nixbot-gitlab> gitlab # [ 8.662880] redis-server[1247]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1115vm-test-run-nixbot-gitlab> gitlab # [ 8.664469] redis-server[1247]: Redis version=8.8.0, bits=64, commit=00000000, modified=0, pid=1247, just started1116vm-test-run-nixbot-gitlab> gitlab # [ 8.667753] systemd[1]: Started Redis Server - redis-gitlab.1117vm-test-run-nixbot-gitlab> gitlab # [ 8.669484] redis-server[1247]: Configuration loaded1118vm-test-run-nixbot-gitlab> gitlab # [ 8.672306] redis[1247]: monotonic clock: POSIX clock_gettime1119vm-test-run-nixbot-gitlab> gitlab # [ 8.673513] redis[1247]: Running mode=standalone, port=0.1120vm-test-run-nixbot-gitlab> gitlab # [ 8.674589] redis[1247]: Server initialized1121vm-test-run-nixbot-gitlab> gitlab # [ 8.676824] redis[1247]: Ready to accept connections unix1122vm-test-run-nixbot-gitlab> gitlab # [ 8.678042] redis[1247]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1123vm-test-run-nixbot-gitlab> gitlab # [ 8.697220] postgresql-pre-start[1250]: selecting default "shared_buffers" ... 128MB1124vm-test-run-nixbot-gitlab> gitlab # [ 8.910665] systemd[1]: Started gitlab-workhorse.service.1125vm-test-run-nixbot-gitlab> gitlab # [ 9.079482] postgresql-pre-start[1250]: selecting default time zone ... UTC1126vm-test-run-nixbot-gitlab> gitlab # [ 9.084892] postgresql-pre-start[1250]: creating configuration files ... ok1127vm-test-run-nixbot-gitlab> gitlab # [ 9.142112] gitlab-workhorse[1284]: time="2026-07-01T17:50:15Z" level=info msg=Starting build_time=19700101.000000 version=18.11.41128vm-test-run-nixbot-gitlab> gitlab # [ 9.148896] gitlab-workhorse[1284]: time="2026-07-01T17:50:15Z" level=info msg="Using redis/go-redis"1129vm-test-run-nixbot-gitlab> gitlab # [ 9.155326] gitlab-workhorse[1284]: time="2026-07-01T17:50:15Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1130vm-test-run-nixbot-gitlab> gitlab # [ 9.243467] postgresql-pre-start[1250]: running bootstrap script ... ok1131vm-test-run-nixbot-gitlab> gitlab # [ 9.701532] postgresql-pre-start[1250]: performing post-bootstrap initialization ... ok1132vm-test-run-nixbot-gitlab> gitlab # [ 10.117491] postgresql-pre-start[1250]: syncing data to disk ... ok1133vm-test-run-nixbot-gitlab> gitlab # [ 10.121723] postgresql-pre-start[1250]: initdb: warning: enabling "trust" authentication for local connections1134vm-test-run-nixbot-gitlab> gitlab # [ 10.127848] postgresql-pre-start[1250]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1135vm-test-run-nixbot-gitlab> gitlab # [ 10.137298] postgresql-pre-start[1250]: Success. You can now start the database server using:1136vm-test-run-nixbot-gitlab> gitlab # [ 10.142515] postgresql-pre-start[1250]: pg_ctl -D /var/lib/postgresql/17 -l logfile start1137vm-test-run-nixbot-gitlab> gitlab # [ 10.165980] dhcpcd[1229]: eth0: soliciting a DHCP lease1138vm-test-run-nixbot-gitlab> gitlab # [ 10.434172] NET: Registered PF_PACKET protocol family1139vm-test-run-nixbot-gitlab> gitlab # [ 10.178666] dhcpcd[1229]: eth0: offered 10.0.2.15 from 10.0.2.21140vm-test-run-nixbot-gitlab> gitlab # [ 10.183598] dhcpcd[1229]: eth0: probing address 10.0.2.15/241141vm-test-run-nixbot-gitlab> gitlab # [ 10.243788] postgres[1308]: [1308] LOG: starting PostgreSQL 17.10 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1142vm-test-run-nixbot-gitlab> gitlab # [ 10.251194] postgres[1308]: [1308] LOG: listening on IPv6 address "::1", port 54321143vm-test-run-nixbot-gitlab> gitlab # [ 10.253966] postgres[1308]: [1308] LOG: listening on IPv4 address "127.0.0.1", port 54321144vm-test-run-nixbot-gitlab> gitlab # [ 10.263503] postgres[1308]: [1308] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1145vm-test-run-nixbot-gitlab> gitlab # [ 10.277395] postgres[1317]: [1317] LOG: database system was shut down at 2026-07-01 17:50:15 GMT1146vm-test-run-nixbot-gitlab> gitlab # [ 10.285602] postgres[1308]: [1308] LOG: database system is ready to accept connections1147vm-test-run-nixbot-gitlab> gitlab # [ 10.290919] systemd[1]: Started PostgreSQL Server.1148vm-test-run-nixbot-gitlab> gitlab # [ 10.293184] systemd[1]: Starting PostgreSQL Setup Scripts...1149vm-test-run-nixbot-gitlab> gitlab # [ 10.456865] postgresql-setup-start[1328]: CREATE DATABASE1150vm-test-run-nixbot-gitlab> gitlab # [ 10.495827] postgresql-setup-start[1346]: CREATE ROLE1151vm-test-run-nixbot-gitlab> gitlab # [ 10.501299] dhcpcd[1229]: eth0: soliciting an IPv6 router1152vm-test-run-nixbot-gitlab> gitlab # [ 10.504878] dhcpcd[1229]: eth0: Router Advertisement from fe80::21153vm-test-run-nixbot-gitlab> gitlab # [ 10.508069] dhcpcd[1229]: eth0: adding address fec0::5054:ff:fe12:3456/641154vm-test-run-nixbot-gitlab> gitlab # [ 10.510980] dhcpcd[1229]: eth0: adding route to fec0::/641155vm-test-run-nixbot-gitlab> gitlab # [ 10.513812] postgresql-setup-start[1349]: ALTER DATABASE1156vm-test-run-nixbot-gitlab> gitlab # [ 10.517184] dhcpcd[1229]: eth0: adding default route via fe80::21157vm-test-run-nixbot-gitlab> gitlab # [ 10.542563] postgresql-setup-start[1354]: CREATE ROLE1158vm-test-run-nixbot-gitlab> gitlab # [ 10.547270] systemd[1]: Finished PostgreSQL Setup Scripts.1159vm-test-run-nixbot-gitlab> gitlab # [ 10.550966] systemd[1]: Reached target PostgreSQL.1160vm-test-run-nixbot-gitlab> gitlab # [ 10.554114] systemd[1]: Starting gitlab-postgresql.service...1161vm-test-run-nixbot-gitlab> gitlab # [ 10.608279] 119c5p75zqwmpdrsjsd5cszxwrq2hgfq-gitlab-config[1344]: mkdir -p /var/gitlab/state/home/.ssh: OK1162vm-test-run-nixbot-gitlab> gitlab # [ 10.610350] 119c5p75zqwmpdrsjsd5cszxwrq2hgfq-gitlab-config[1344]: chmod 700 /var/gitlab/state/home/.ssh: OK1163vm-test-run-nixbot-gitlab> gitlab # [ 10.659151] systemd[1]: Finished gitlab-config.service.1164vm-test-run-nixbot-gitlab> gitlab # [ 10.663446] systemd[1]: Started gitaly.service.1165vm-test-run-nixbot-gitlab> gitlab # [ 10.666874] systemd[1]: Starting gitlab-db-config.service...1166vm-test-run-nixbot-gitlab> gitlab # [ 10.679411] gitlab-postgresql-start[1362]: CREATE DATABASE1167vm-test-run-nixbot-gitlab> gitlab # [ 10.714513] gitlab-postgresql-start[1382]: CREATE EXTENSION1168vm-test-run-nixbot-gitlab> gitlab # [ 10.758946] gitlab-postgresql-start[1384]: CREATE EXTENSION1169vm-test-run-nixbot-gitlab> gitlab # [ 10.763403] systemd[1]: Finished gitlab-postgresql.service.1170vm-test-run-nixbot-gitlab> gitlab # [ 11.207703] gitaly[1376]: time="2026-07-01T17:50:17.487Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/2wcq0nlg508fs5wq7jnpg1lw2pib950g-gitaly.toml' and fix the errors that are printed." pid=13761171vm-test-run-nixbot-gitlab> gitlab # [ 11.209868] gitaly[1376]: time="2026-07-01T17:50:17.488Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=13761172vm-test-run-nixbot-gitlab> gitlab # [ 11.211183] gitaly[1376]: time="2026-07-01T17:50:17.488Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=13761173vm-test-run-nixbot-gitlab> gitlab # [ 11.213764] gitaly[1376]: time="2026-07-01T17:50:17.488Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=13761174vm-test-run-nixbot-gitlab> gitlab # [ 11.236889] gitaly[1376]: time="2026-07-01T17:50:17.488Z" level=info msg="Starting Gitaly" pid=1376 version=18.11.41175vm-test-run-nixbot-gitlab> gitlab # [ 11.395626] gitaly[1376]: time="2026-07-01T17:50:17.676Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=155 pid=13761176vm-test-run-nixbot-gitlab> gitlab # [ 11.397081] gitaly[1376]: time="2026-07-01T17:50:17.676Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=13761177vm-test-run-nixbot-gitlab> gitlab # [ 11.402370] gitaly[1376]: time="2026-07-01T17:50:17.683Z" level=info msg="finished initializing command factory" duration_ms=6 pid=13761178vm-test-run-nixbot-gitlab> gitlab # [ 11.403912] gitaly[1376]: time="2026-07-01T17:50:17.683Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-1376/git-exec-2633757205.d/git pid=13761179vm-test-run-nixbot-gitlab> gitlab # [ 11.417103] gitaly[1376]: time="2026-07-01T17:50:17.697Z" level=info msg="finished detecting git version" duration_ms=14 pid=13761180vm-test-run-nixbot-gitlab> gitlab # [ 11.418143] gitaly[1376]: time="2026-07-01T17:50:17.697Z" level=info msg="using Git version" pid=1376 version=2.53.g1181vm-test-run-nixbot-gitlab> gitlab # [ 11.423295] gitaly[1376]: time="2026-07-01T17:50:17.703Z" level=info msg="clearing disk cache object folder" pid=1376 storage=default1182vm-test-run-nixbot-gitlab> gitlab # [ 11.425061] gitaly[1376]: time="2026-07-01T17:50:17.703Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1454940815 pid=1376 storage=default1183vm-test-run-nixbot-gitlab> gitlab # [ 11.426908] gitaly[1376]: time="2026-07-01T17:50:17.704Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1454940815 pid=1376 storage=default1184vm-test-run-nixbot-gitlab> gitlab # [ 11.428492] gitaly[1376]: time="2026-07-01T17:50:17.704Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=13761185vm-test-run-nixbot-gitlab> gitlab # [ 11.429061] gitaly[1376]: time="2026-07-01T17:50:17.705Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1454940815 clear_duration_ms=0 pid=1376 storage=default1186vm-test-run-nixbot-gitlab> gitlab # [ 11.444213] gitaly[1376]: time="2026-07-01T17:50:17.724Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=13761187vm-test-run-nixbot-gitlab> gitlab # [ 11.517184] gitaly[1376]: time="2026-07-01T17:50:17.797Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=13761188vm-test-run-nixbot-gitlab> gitlab # [ 11.518339] gitaly[1376]: time="2026-07-01T17:50:17.797Z" level=info msg="counting repositories" pid=13761189vm-test-run-nixbot-gitlab> gitlab # [ 11.519178] gitaly[1376]: time="2026-07-01T17:50:17.797Z" level=info msg="finished tempdir cleaner walk" pid=1376 storage=default time_ms=01190vm-test-run-nixbot-gitlab> gitlab # [ 11.520053] gitaly[1376]: time="2026-07-01T17:50:17.797Z" level=info msg="starting to count repositories" pid=1376 storage_path=/var/gitlab/state/repositories1191vm-test-run-nixbot-gitlab> gitlab # [ 11.520877] gitaly[1376]: time="2026-07-01T17:50:17.797Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=1376 storage_path=/var/gitlab/state/repositories1192vm-test-run-nixbot-gitlab> gitlab # [ 11.521462] gitaly[1376]: time="2026-07-01T17:50:17.797Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=1376 schema=unix1193vm-test-run-nixbot-gitlab> gitlab # [ 11.522369] gitaly[1376]: time="2026-07-01T17:50:17.797Z" level=info msg="completed counting all repositories" counting_duration=0 pid=13761194vm-test-run-nixbot-gitlab> gitlab # [ 11.523241] gitaly[1376]: time="2026-07-01T17:50:17.797Z" level=info msg="listening at address" address=/run/gitaly/gitaly-1376/sock.d/intern pid=1376 schema=unix1195vm-test-run-nixbot-gitlab> gitlab # [ 11.541181] gitaly[1376]: time="2026-07-01T17:50:17.821Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=13761196vm-test-run-nixbot-gitlab> gitlab # [ 11.542861] gitaly[1376]: time="2026-07-01T17:50:17.821Z" level=info msg="Started Gitaly" duration_ms=304 pid=13761197vm-test-run-nixbot-gitlab> gitlab # [ 11.543936] gitaly[1376]: time="2026-07-01T17:50:17.823Z" level=info msg="maintenance: daily scheduled" pid=1376 scheduled="2026-07-02 12:00:00 +0000 UTC"1198vm-test-run-nixbot-gitlab> gitlab # [ 12.035828] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1380]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1199vm-test-run-nixbot-gitlab> gitlab # [ 12.048485] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1380]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1200vm-test-run-nixbot-gitlab> gitlab # [ 12.060896] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1380]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1201vm-test-run-nixbot-gitlab> gitlab # [ 13.383773] gitaly[1376]: time="2026-07-01T17:50:19.663Z" level=info msg="License database preloaded" duration_ms=2174 pid=13761202vm-test-run-nixbot-gitlab> gitlab # [ 15.052723] dhcpcd[1229]: eth0: leased 10.0.2.15 for 86400 seconds1203vm-test-run-nixbot-gitlab> gitlab # [ 15.056895] dhcpcd[1229]: eth0: adding route to 10.0.2.0/241204vm-test-run-nixbot-gitlab> gitlab # [ 15.060644] dhcpcd[1229]: eth0: adding default route via 10.0.2.21205vm-test-run-nixbot-gitlab> gitlab # [ 15.182560] systemd[1]: Started DHCP Client.1206vm-test-run-nixbot-gitlab> gitlab # [ 15.187470] systemd[1]: Reached target Network is Online.1207vm-test-run-nixbot-gitlab> gitlab # [ 41.686713] postgres[1733]: [1733] ERROR: relation "feature_gates" does not exist at character 5231208vm-test-run-nixbot-gitlab> gitlab # [ 41.688190] postgres[1733]: [1733] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1209vm-test-run-nixbot-gitlab> gitlab # [ 41.690045] postgres[1733]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1210vm-test-run-nixbot-gitlab> gitlab # [ 41.692731] postgres[1733]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1211vm-test-run-nixbot-gitlab> gitlab # [ 41.696809] postgres[1733]: attidentity AS identity,1212vm-test-run-nixbot-gitlab> gitlab # [ 41.699567] postgres[1733]: attgenerated as attgenerated1213vm-test-run-nixbot-gitlab> gitlab # [ 41.703078] postgres[1733]: FROM pg_attribute a1214vm-test-run-nixbot-gitlab> gitlab # [ 41.705806] postgres[1733]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1215vm-test-run-nixbot-gitlab> gitlab # [ 41.707843] postgres[1733]: LEFT JOIN pg_type t ON a.atttypid = t.oid1216vm-test-run-nixbot-gitlab> gitlab # [ 41.711877] postgres[1733]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1217vm-test-run-nixbot-gitlab> gitlab # [ 41.715993] postgres[1733]: WHERE a.attrelid = '"feature_gates"'::regclass1218vm-test-run-nixbot-gitlab> gitlab # [ 41.718752] postgres[1733]: AND a.attnum > 0 AND NOT a.attisdropped1219vm-test-run-nixbot-gitlab> gitlab # [ 41.722099] postgres[1733]: ORDER BY a.attnum1220vm-test-run-nixbot-gitlab> gitlab # [ 41.724800] postgres[1733]:1221vm-test-run-nixbot-gitlab> gitlab # [ 41.946307] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1380]: W, [2026-07-01T17:50:48.225829 #1380] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1222vm-test-run-nixbot-gitlab> gitlab # [ 47.167830] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1788]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1223vm-test-run-nixbot-gitlab> gitlab # [ 47.171925] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1788]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1224vm-test-run-nixbot-gitlab> gitlab # [ 49.202760] gitlab-workhorse[1284]: time="2026-07-01T17:50:55Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1225vm-test-run-nixbot-gitlab> gitlab # [ 59.213179] gitlab-workhorse[1284]: time="2026-07-01T17:51:05Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1226vm-test-run-nixbot-gitlab> gitlab # [ 64.635886] postgres[1863]: [1863] ERROR: relation "table_without_models" does not exist1227vm-test-run-nixbot-gitlab> gitlab # [ 64.637833] postgres[1863]: [1863] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1228vm-test-run-nixbot-gitlab> gitlab # [ 69.222113] gitlab-workhorse[1284]: time="2026-07-01T17:51:15Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1229vm-test-run-nixbot-gitlab> gitlab # [ 78.577750] systemd[1]: Finished gitlab-db-config.service.1230vm-test-run-nixbot-gitlab> gitlab # [ 78.585717] systemd[1]: Started gitlab-sidekiq.service.1231vm-test-run-nixbot-gitlab> gitlab # [ 78.591755] systemd[1]: Starting gitlab.service...1232vm-test-run-nixbot-gitlab> gitlab # [ 78.925661] bundle[2066]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1233vm-test-run-nixbot-gitlab> gitlab # [ 78.929392] bundle[2066]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1234vm-test-run-nixbot-gitlab> gitlab # [ 78.932185] bundle[2066]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1235vm-test-run-nixbot-gitlab> gitlab # [ 79.232723] gitlab-workhorse[1284]: time="2026-07-01T17:51:25Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1236vm-test-run-nixbot-gitlab> gitlab # [ 81.763125] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-07-01T17:51:28.026Z","message":"Starting cluster with 1 processes"}1237vm-test-run-nixbot-gitlab> gitlab # [ 81.875277] bundle[2066]: {"timestamp":"2026-07-01T17:51:28.135Z","pid":2066,"message":"* Enabling systemd notification integration"}1238vm-test-run-nixbot-gitlab> gitlab # [ 81.876780] bundle[2066]: {"timestamp":"2026-07-01T17:51:28.155Z","pid":2066,"message":"Puma starting in cluster mode..."}1239vm-test-run-nixbot-gitlab> gitlab # [ 81.878212] bundle[2066]: {"timestamp":"2026-07-01T17:51:28.155Z","pid":2066,"message":"* Puma version: 7.2.0 (\"On The Corner\")"}1240vm-test-run-nixbot-gitlab> gitlab # [ 81.879081] bundle[2066]: {"timestamp":"2026-07-01T17:51:28.155Z","pid":2066,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1241vm-test-run-nixbot-gitlab> gitlab # [ 81.879877] bundle[2066]: {"timestamp":"2026-07-01T17:51:28.155Z","pid":2066,"message":"* Min threads: 0"}1242vm-test-run-nixbot-gitlab> gitlab # [ 81.880966] bundle[2066]: {"timestamp":"2026-07-01T17:51:28.155Z","pid":2066,"message":"* Max threads: 4"}1243vm-test-run-nixbot-gitlab> gitlab # [ 81.882146] bundle[2066]: {"timestamp":"2026-07-01T17:51:28.155Z","pid":2066,"message":"* Environment: production"}1244vm-test-run-nixbot-gitlab> gitlab # [ 81.882976] bundle[2066]: {"timestamp":"2026-07-01T17:51:28.155Z","pid":2066,"message":"* Master PID: 2066"}1245vm-test-run-nixbot-gitlab> gitlab # [ 81.884139] bundle[2066]: {"timestamp":"2026-07-01T17:51:28.156Z","pid":2066,"message":"* Workers: 2"}1246vm-test-run-nixbot-gitlab> gitlab # [ 81.884978] bundle[2066]: {"timestamp":"2026-07-01T17:51:28.156Z","pid":2066,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1247vm-test-run-nixbot-gitlab> gitlab # [ 81.886151] bundle[2066]: {"timestamp":"2026-07-01T17:51:28.156Z","pid":2066,"message":"* Preloading application"}1248vm-test-run-nixbot-gitlab> gitlab # [ 89.234348] gitlab-workhorse[1284]: time="2026-07-01T17:51:35Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1249vm-test-run-nixbot-gitlab> gitlab # [ 99.236162] gitlab-workhorse[1284]: time="2026-07-01T17:51:45Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1250vm-test-run-nixbot-gitlab> gitlab # [ 105.181882] bundle[2066]: W, [2026-07-01T17:51:51.462166 #2066] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1251vm-test-run-nixbot-gitlab> gitlab # [ 108.012376] sidekiq-cluster[2096]: 2026-07-01T17:51:54.291Z pid=2096 tid=tyw INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2096, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>432103424}1252vm-test-run-nixbot-gitlab> gitlab # [ 108.198486] sidekiq-cluster[2096]: W, [2026-07-01T17:51:54.478954 #2096] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1253vm-test-run-nixbot-gitlab> gitlab # [ 108.278984] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:54.559Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1254vm-test-run-nixbot-gitlab> gitlab # [ 109.237565] gitlab-workhorse[1284]: time="2026-07-01T17:51:55Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1255vm-test-run-nixbot-gitlab> gitlab # [ 110.188970] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.468Z","message":"GitLab reliable fetch activated!"}1256vm-test-run-nixbot-gitlab> gitlab # [ 110.191827] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.468Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1257vm-test-run-nixbot-gitlab> gitlab # [ 110.214315] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.494Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1258vm-test-run-nixbot-gitlab> gitlab # [ 110.218229] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.498Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1259vm-test-run-nixbot-gitlab> gitlab # [ 110.222119] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.502Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1260vm-test-run-nixbot-gitlab> gitlab # [ 110.226139] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.506Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1261vm-test-run-nixbot-gitlab> gitlab # [ 110.230113] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.510Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1262vm-test-run-nixbot-gitlab> gitlab # [ 110.233691] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.514Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1263vm-test-run-nixbot-gitlab> gitlab # [ 110.236994] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.517Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1264vm-test-run-nixbot-gitlab> gitlab # [ 110.240525] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.521Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1265vm-test-run-nixbot-gitlab> gitlab # [ 110.244104] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.524Z","message":"Cron Jobs - added job with name expire_build_artifacts_worker in the namespace default"}1266vm-test-run-nixbot-gitlab> gitlab # [ 110.247630] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.528Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1267vm-test-run-nixbot-gitlab> gitlab # [ 110.250877] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.531Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1268vm-test-run-nixbot-gitlab> gitlab # [ 110.254941] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.535Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1269vm-test-run-nixbot-gitlab> gitlab # [ 110.258163] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.538Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1270vm-test-run-nixbot-gitlab> gitlab # [ 110.260982] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.541Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1271vm-test-run-nixbot-gitlab> gitlab # [ 110.263947] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.544Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1272vm-test-run-nixbot-gitlab> gitlab # [ 110.266848] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.547Z","message":"Cron Jobs - added job with name environments_auto_delete_cron_worker in the namespace default"}1273vm-test-run-nixbot-gitlab> gitlab # [ 110.269914] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.550Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1274vm-test-run-nixbot-gitlab> gitlab # [ 110.273487] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.554Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1275vm-test-run-nixbot-gitlab> gitlab # [ 110.277351] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.557Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1276vm-test-run-nixbot-gitlab> gitlab # [ 110.280884] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.561Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1277vm-test-run-nixbot-gitlab> gitlab # [ 110.284197] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.564Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1278vm-test-run-nixbot-gitlab> gitlab # [ 110.287094] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.567Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1279vm-test-run-nixbot-gitlab> gitlab # [ 110.289597] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.570Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1280vm-test-run-nixbot-gitlab> gitlab # [ 110.292177] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.572Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1281vm-test-run-nixbot-gitlab> gitlab # [ 110.297561] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.578Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1282vm-test-run-nixbot-gitlab> gitlab # [ 110.303225] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.583Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1283vm-test-run-nixbot-gitlab> gitlab # [ 110.308334] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.588Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1284vm-test-run-nixbot-gitlab> gitlab # [ 110.312879] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.593Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1285vm-test-run-nixbot-gitlab> gitlab # [ 110.317589] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.598Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1286vm-test-run-nixbot-gitlab> gitlab # [ 110.321351] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.602Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1287vm-test-run-nixbot-gitlab> gitlab # [ 110.330665] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.611Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1288vm-test-run-nixbot-gitlab> gitlab # [ 110.333618] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.614Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1289vm-test-run-nixbot-gitlab> gitlab # [ 110.336705] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.617Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1290vm-test-run-nixbot-gitlab> gitlab # [ 110.340615] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.621Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1291vm-test-run-nixbot-gitlab> gitlab # [ 110.343653] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.624Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1292vm-test-run-nixbot-gitlab> gitlab # [ 110.347303] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.627Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1293vm-test-run-nixbot-gitlab> gitlab # [ 110.350845] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.631Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1294vm-test-run-nixbot-gitlab> gitlab # [ 110.354361] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.634Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1295vm-test-run-nixbot-gitlab> gitlab # [ 110.357885] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.638Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1296vm-test-run-nixbot-gitlab> gitlab # [ 110.361313] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.642Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1297vm-test-run-nixbot-gitlab> gitlab # [ 110.366121] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.646Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1298vm-test-run-nixbot-gitlab> gitlab # [ 110.371390] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.652Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1299vm-test-run-nixbot-gitlab> gitlab # [ 110.375253] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.654Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1300vm-test-run-nixbot-gitlab> gitlab # [ 110.379354] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.659Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1301vm-test-run-nixbot-gitlab> gitlab # [ 110.382839] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.663Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1302vm-test-run-nixbot-gitlab> gitlab # [ 110.386549] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.667Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1303vm-test-run-nixbot-gitlab> gitlab # [ 110.393421] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.674Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1304vm-test-run-nixbot-gitlab> gitlab # [ 110.399413] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.680Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1305vm-test-run-nixbot-gitlab> gitlab # [ 110.402863] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.683Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1306vm-test-run-nixbot-gitlab> gitlab # [ 110.406401] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.687Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1307vm-test-run-nixbot-gitlab> gitlab # [ 110.409774] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.690Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1308vm-test-run-nixbot-gitlab> gitlab # [ 110.413409] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.694Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1309vm-test-run-nixbot-gitlab> gitlab # [ 110.416975] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.697Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1310vm-test-run-nixbot-gitlab> gitlab # [ 110.425339] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.706Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1311vm-test-run-nixbot-gitlab> gitlab # [ 110.429132] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.709Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1312vm-test-run-nixbot-gitlab> gitlab # [ 110.432617] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.713Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1313vm-test-run-nixbot-gitlab> gitlab # [ 110.436222] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.716Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1314vm-test-run-nixbot-gitlab> gitlab # [ 110.439712] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.720Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1315vm-test-run-nixbot-gitlab> gitlab # [ 110.443401] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.724Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1316vm-test-run-nixbot-gitlab> gitlab # [ 110.446813] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.727Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1317vm-test-run-nixbot-gitlab> gitlab # [ 110.450566] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.731Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1318vm-test-run-nixbot-gitlab> gitlab # [ 110.454293] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.734Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1319vm-test-run-nixbot-gitlab> gitlab # [ 110.460199] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.740Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1320vm-test-run-nixbot-gitlab> gitlab # [ 110.463994] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.744Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1321vm-test-run-nixbot-gitlab> gitlab # [ 110.467697] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.748Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1322vm-test-run-nixbot-gitlab> gitlab # [ 110.471102] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.751Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1323vm-test-run-nixbot-gitlab> gitlab # [ 110.475075] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.755Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1324vm-test-run-nixbot-gitlab> gitlab # [ 110.478424] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.759Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1325vm-test-run-nixbot-gitlab> gitlab # [ 110.481822] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.762Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1326vm-test-run-nixbot-gitlab> gitlab # [ 110.485240] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.765Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1327vm-test-run-nixbot-gitlab> gitlab # [ 110.487860] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.768Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1328vm-test-run-nixbot-gitlab> gitlab # [ 110.491250] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.771Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1329vm-test-run-nixbot-gitlab> gitlab # [ 110.508460] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.789Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1330vm-test-run-nixbot-gitlab> gitlab # [ 110.511708] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.792Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1331vm-test-run-nixbot-gitlab> gitlab # [ 110.515055] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.795Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1332vm-test-run-nixbot-gitlab> gitlab # [ 110.517976] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.798Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1333vm-test-run-nixbot-gitlab> gitlab # [ 110.521188] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.801Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1334vm-test-run-nixbot-gitlab> gitlab # [ 110.524335] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.805Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1335vm-test-run-nixbot-gitlab> gitlab # [ 110.527302] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.807Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1336vm-test-run-nixbot-gitlab> gitlab # [ 110.530410] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.811Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1337vm-test-run-nixbot-gitlab> gitlab # [ 110.533459] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.814Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1338vm-test-run-nixbot-gitlab> gitlab # [ 110.536649] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.817Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1339vm-test-run-nixbot-gitlab> gitlab # [ 110.539912] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.820Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1340vm-test-run-nixbot-gitlab> gitlab # [ 110.543970] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.824Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1341vm-test-run-nixbot-gitlab> gitlab # [ 110.546867] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.827Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1342vm-test-run-nixbot-gitlab> gitlab # [ 110.550341] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.831Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1343vm-test-run-nixbot-gitlab> gitlab # [ 110.553360] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.834Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1344vm-test-run-nixbot-gitlab> gitlab # [ 110.556912] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.837Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1345vm-test-run-nixbot-gitlab> gitlab # [ 110.560361] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.841Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1346vm-test-run-nixbot-gitlab> gitlab # [ 110.563476] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.844Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1347vm-test-run-nixbot-gitlab> gitlab # [ 110.582335] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.862Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1348vm-test-run-nixbot-gitlab> gitlab # [ 110.585617] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.866Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1349vm-test-run-nixbot-gitlab> gitlab # [ 110.588899] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.869Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1350vm-test-run-nixbot-gitlab> gitlab # [ 110.592293] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.872Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1351vm-test-run-nixbot-gitlab> gitlab # [ 110.595884] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.876Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1352vm-test-run-nixbot-gitlab> gitlab # [ 110.599740] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.880Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1353vm-test-run-nixbot-gitlab> gitlab # [ 110.603974] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.884Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1354vm-test-run-nixbot-gitlab> gitlab # [ 110.607510] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.888Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1355vm-test-run-nixbot-gitlab> gitlab # [ 110.610991] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.891Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1356vm-test-run-nixbot-gitlab> gitlab # [ 110.621209] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.901Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1357vm-test-run-nixbot-gitlab> gitlab # [ 110.624885] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.905Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1358vm-test-run-nixbot-gitlab> gitlab # [ 110.628067] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.908Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1359vm-test-run-nixbot-gitlab> gitlab # [ 110.632429] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.913Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1360vm-test-run-nixbot-gitlab> gitlab # [ 110.636909] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.917Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1361vm-test-run-nixbot-gitlab> gitlab # [ 110.640519] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.921Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1362vm-test-run-nixbot-gitlab> gitlab # [ 110.644892] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.925Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1363vm-test-run-nixbot-gitlab> gitlab # [ 110.647950] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.928Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1364vm-test-run-nixbot-gitlab> gitlab # [ 110.651467] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.931Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1365vm-test-run-nixbot-gitlab> gitlab # [ 110.655166] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.935Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1366vm-test-run-nixbot-gitlab> gitlab # [ 110.658563] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:51:56.939Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1367vm-test-run-nixbot-gitlab> gitlab # [ 113.390536] sidekiq-cluster[2096]: InitializerConnections Query: SET client_min_messages TO 'warning'1368vm-test-run-nixbot-gitlab> gitlab # [ 113.392446] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1369vm-test-run-nixbot-gitlab> gitlab # [ 113.394127] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1370vm-test-run-nixbot-gitlab> gitlab # [ 113.395488] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1371vm-test-run-nixbot-gitlab> gitlab # [ 113.397369] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1372vm-test-run-nixbot-gitlab> gitlab # [ 113.399276] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1373vm-test-run-nixbot-gitlab> gitlab # [ 113.400935] sidekiq-cluster[2096]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1374vm-test-run-nixbot-gitlab> gitlab # [ 113.409375] sidekiq-cluster[2096]: InitializerConnections Query: SET standard_conforming_strings = on1375vm-test-run-nixbot-gitlab> gitlab # [ 113.410809] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1376vm-test-run-nixbot-gitlab> gitlab # [ 113.412295] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1377vm-test-run-nixbot-gitlab> gitlab # [ 113.413792] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1378vm-test-run-nixbot-gitlab> gitlab # [ 113.415310] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1379vm-test-run-nixbot-gitlab> gitlab # [ 113.416241] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1380vm-test-run-nixbot-gitlab> gitlab # [ 113.417430] sidekiq-cluster[2096]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1381vm-test-run-nixbot-gitlab> gitlab # [ 113.428160] sidekiq-cluster[2096]: InitializerConnections Query: SET intervalstyle = iso_86011382vm-test-run-nixbot-gitlab> gitlab # [ 113.429803] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1383vm-test-run-nixbot-gitlab> gitlab # [ 113.431532] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1384vm-test-run-nixbot-gitlab> gitlab # [ 113.432993] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1385vm-test-run-nixbot-gitlab> gitlab # [ 113.434242] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1386vm-test-run-nixbot-gitlab> gitlab # [ 113.435171] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1387vm-test-run-nixbot-gitlab> gitlab # [ 113.436384] sidekiq-cluster[2096]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1388vm-test-run-nixbot-gitlab> gitlab # [ 113.446866] sidekiq-cluster[2096]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname1389vm-test-run-nixbot-gitlab> gitlab # [ 113.448358] sidekiq-cluster[2096]: FROM pg_type as t1390vm-test-run-nixbot-gitlab> gitlab # [ 113.450211] sidekiq-cluster[2096]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz')1391vm-test-run-nixbot-gitlab> gitlab # [ 113.451863] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1392vm-test-run-nixbot-gitlab> gitlab # [ 113.453307] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1393vm-test-run-nixbot-gitlab> gitlab # [ 113.454487] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1394vm-test-run-nixbot-gitlab> gitlab # [ 113.455776] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1395vm-test-run-nixbot-gitlab> gitlab # [ 113.457290] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1396vm-test-run-nixbot-gitlab> gitlab # [ 113.458468] sidekiq-cluster[2096]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1397vm-test-run-nixbot-gitlab> gitlab # [ 113.469612] sidekiq-cluster[2096]: InitializerConnections Query: SET SESSION timezone TO 'UTC'1398vm-test-run-nixbot-gitlab> gitlab # [ 113.471093] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1399vm-test-run-nixbot-gitlab> gitlab # [ 113.472250] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1400vm-test-run-nixbot-gitlab> gitlab # [ 113.473150] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1401vm-test-run-nixbot-gitlab> gitlab # [ 113.474359] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1402vm-test-run-nixbot-gitlab> gitlab # [ 113.475771] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1403vm-test-run-nixbot-gitlab> gitlab # [ 113.477270] sidekiq-cluster[2096]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1404vm-test-run-nixbot-gitlab> gitlab # [ 113.488385] sidekiq-cluster[2096]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'per_thread_db_connection_pool_metrics'1405vm-test-run-nixbot-gitlab> gitlab # [ 113.490116] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1406vm-test-run-nixbot-gitlab> gitlab # [ 113.491478] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1407vm-test-run-nixbot-gitlab> gitlab # [ 113.492968] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1408vm-test-run-nixbot-gitlab> gitlab # [ 113.494171] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1409vm-test-run-nixbot-gitlab> gitlab # [ 113.495348] sidekiq-cluster[2096]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1410vm-test-run-nixbot-gitlab> gitlab # [ 113.496467] sidekiq-cluster[2096]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1411vm-test-run-nixbot-gitlab> gitlab # [ 119.239373] gitlab-workhorse[1284]: time="2026-07-01T17:52:05Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1412vm-test-run-nixbot-gitlab> gitlab # [ 129.242110] gitlab-workhorse[1284]: time="2026-07-01T17:52:15Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1413vm-test-run-nixbot-gitlab> gitlab # [ 131.193553] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:17.473Z","message":"Booted Rails 7.2.3 application in production environment"}1414vm-test-run-nixbot-gitlab> gitlab # [ 131.195638] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:17.474Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1415vm-test-run-nixbot-gitlab> gitlab # [ 131.197302] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:17.474Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1416vm-test-run-nixbot-gitlab> gitlab # [ 131.199089] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:17.474Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1417vm-test-run-nixbot-gitlab> gitlab # [ 131.208491] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:17.488Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1418vm-test-run-nixbot-gitlab> gitlab # [ 132.474756] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:18.754Z","message":"Cleaning working queues"}1419vm-test-run-nixbot-gitlab> gitlab # [ 132.481842] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:18.762Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"21e805ccacd3e266a5023ece","created_at":"2026-07-01T17:51:24.244Z","trace_propagation_headers":{"sentry-trace":"20dceae90a9b46bc80ef0710f36f66db-f58c6094ed2d4ee0","baggage":"sentry-trace_id=20dceae90a9b46bc80ef0710f36f66db,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"2956e0243ae704c5c63b4eb4bbf84685","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-01T17:51:24.254Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-21e805ccacd3e266a5023ece: start","job_status":"start","queue_duration_s":54.50802,"scheduling_latency_s":54.50807}1420vm-test-run-nixbot-gitlab> gitlab # [ 132.642161] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:18.922Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"21e805ccacd3e266a5023ece","created_at":"2026-07-01T17:51:24.244Z","trace_propagation_headers":{"sentry-trace":"20dceae90a9b46bc80ef0710f36f66db-f58c6094ed2d4ee0","baggage":"sentry-trace_id=20dceae90a9b46bc80ef0710f36f66db,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"2956e0243ae704c5c63b4eb4bbf84685","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-01T17:51:24.254Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-21e805ccacd3e266a5023ece: done: 0.160121 sec","job_status":"done","queue_duration_s":54.50802,"scheduling_latency_s":54.50807,"redis_calls":30,"redis_duration_s":0.007156,"redis_read_bytes":410,"redis_write_bytes":3701,"redis_feature_flag_calls":19,"redis_feature_flag_duration_s":0.004346,"redis_feature_flag_read_bytes":400,"redis_feature_flag_write_bytes":2454,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001743,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001067,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07258632,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.160121,"completed_at":"2026-07-01T17:52:18.922Z","load_balancing_strategy":"primary","db_duration_s":0.055169,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1421vm-test-run-nixbot-gitlab> gitlab # [ 132.738651] bundle[2066]: {"timestamp":"2026-07-01T17:52:18.947Z","pid":2066,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1422vm-test-run-nixbot-gitlab> gitlab # [ 132.741746] bundle[2066]: {"timestamp":"2026-07-01T17:52:18.947Z","pid":2066,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1423vm-test-run-nixbot-gitlab> gitlab # [ 132.744611] bundle[2066]: {"timestamp":"2026-07-01T17:52:18.947Z","pid":2066,"message":"! #\u003cThread:0x00007068b06c8ae8 /nix/store/g5qraa51hgg5fl7n3da89ygf00qfv95x-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/g5qraa51hgg5fl7n3da89ygf00qfv95x-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1424vm-test-run-nixbot-gitlab> gitlab # [ 132.752891] bundle[2066]: {"timestamp":"2026-07-01T17:52:18.947Z","pid":2066,"message":"! #\u003cThread:0x00007068b08f8a48 /nix/store/wg5r0zmy3rh1kga7z4z7mbs298p0wxli-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/wg5r0zmy3rh1kga7z4z7mbs298p0wxli-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1425vm-test-run-nixbot-gitlab> gitlab # [ 132.761388] bundle[2066]: {"timestamp":"2026-07-01T17:52:18.947Z","pid":2066,"message":"Use Ctrl-C to stop"}1426vm-test-run-nixbot-gitlab> gitlab # [ 132.763647] bundle[2066]: {"timestamp":"2026-07-01T17:52:18.948Z","pid":2066,"message":"Sending status to systemd every 1.0 sec"}1427vm-test-run-nixbot-gitlab> gitlab # [ 133.017422] bundle[2066]: {"timestamp":"2026-07-01T17:52:19.297Z","pid":2066,"message":"- Worker 0 (PID: 2597) booted in 0.31s, phase: 0"}1428vm-test-run-nixbot-gitlab> gitlab # [ 133.046391] bundle[2066]: {"timestamp":"2026-07-01T17:52:19.326Z","pid":2066,"message":"- Worker 1 (PID: 2601) booted in 0.32s, phase: 0"}1429vm-test-run-nixbot-gitlab> gitlab # [ 133.053991] systemd[1]: Started gitlab.service.1430vm-test-run-nixbot-gitlab> gitlab # [ 133.057463] systemd[1]: Reached target Common target for all GitLab services..1431vm-test-run-nixbot-gitlab> gitlab # [ 133.061988] systemd[1]: Starting setup-gitlab.service...1432vm-test-run-nixbot-gitlab> gitlab # [ 133.073382] setup-gitlab-start[2625]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1433vm-test-run-nixbot-gitlab> gitlab # [ 135.342334] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:52:21 +0000] "GET /users/sign_in HTTP/1.1" 200 10624 "" "curl/8.20.0" 22371434vm-test-run-nixbot-gitlab> gitlab # [ 135.351982] setup-gitlab-start[2644]: ++ curl -fs -X POST -H 'Content-Type: application/json' -d '{"grant_type":"password","username":"root","password":"notproduction"}' http://gitlab/oauth/token1435vm-test-run-nixbot-gitlab> gitlab # [ 135.354344] setup-gitlab-start[2645]: ++ jq -r .access_token1436vm-test-run-nixbot-gitlab> gitlab # [ 136.629463] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:52:22 +0000] "POST /oauth/token HTTP/1.1" 200 244 "" "curl/8.20.0" 12521437vm-test-run-nixbot-gitlab> gitlab # [ 136.643324] setup-gitlab-start[2625]: + BEARER=47cf3424e7aa4257d32ec7e0b849c707c7674b6da0c9fe6041338d1cdf941c661438vm-test-run-nixbot-gitlab> gitlab # [ 136.645864] setup-gitlab-start[2625]: + AUTH='Authorization: Bearer 47cf3424e7aa4257d32ec7e0b849c707c7674b6da0c9fe6041338d1cdf941c66'1439vm-test-run-nixbot-gitlab> gitlab # [ 136.649324] setup-gitlab-start[2625]: + curl -fs -X PUT -H 'Authorization: Bearer 47cf3424e7aa4257d32ec7e0b849c707c7674b6da0c9fe6041338d1cdf941c66' 'http://gitlab/api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true'1440vm-test-run-nixbot-gitlab> gitlab # [ 137.403684] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:52:23 +0000] "PUT /api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true HTTP/1.1" 200 17133 "" "curl/8.20.0" 7471441vm-test-run-nixbot-gitlab> gitlab # [ 137.407059] setup-gitlab-start[2625]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner Rails.cache.clear1442vm-test-run-nixbot-gitlab> gitlab # [ 137.434436] runuser[2667]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1443vm-test-run-nixbot-gitlab> gitlab # [ 137.785331] setup-gitlab-start[2668]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1444vm-test-run-nixbot-gitlab> gitlab # [ 137.788192] setup-gitlab-start[2668]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1445vm-test-run-nixbot-gitlab> gitlab # [ 137.791252] setup-gitlab-start[2668]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1446vm-test-run-nixbot-gitlab> gitlab # [ 138.363177] setup-gitlab-start[2668]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1447vm-test-run-nixbot-gitlab> gitlab # [ 138.365966] setup-gitlab-start[2668]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1448vm-test-run-nixbot-gitlab> gitlab # [ 138.369358] setup-gitlab-start[2668]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1449vm-test-run-nixbot-gitlab> gitlab # [ 146.883692] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:33.163Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"5ec73336db43516f9805ce10","created_at":"2026-07-01T17:52:33.126Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"423b5ed54ef3c3123e133b85ded09d2a","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.160Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-5ec73336db43516f9805ce10: start","job_status":"start","queue_duration_s":0.002948,"scheduling_latency_s":0.002995}1450vm-test-run-nixbot-gitlab> gitlab # [ 147.069339] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:33.348Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"5ec73336db43516f9805ce10","created_at":"2026-07-01T17:52:33.126Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"423b5ed54ef3c3123e133b85ded09d2a","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.160Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-5ec73336db43516f9805ce10: done: 0.185397 sec","job_status":"done","queue_duration_s":0.002948,"scheduling_latency_s":0.002995,"redis_calls":16,"redis_duration_s":0.029641,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.021646,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00606,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001935,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00120099,"duration_s":0.185397,"completed_at":"2026-07-01T17:52:33.348Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018955,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451vm-test-run-nixbot-gitlab> gitlab # [ 147.077373] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:33.351Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"9cd9556a0a31e82d62721424","created_at":"2026-07-01T17:52:33.235Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2768b77d6a9466992fd1a3feb2786bdc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.257Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-9cd9556a0a31e82d62721424: start","job_status":"start","queue_duration_s":0.093848,"scheduling_latency_s":0.093872}1452vm-test-run-nixbot-gitlab> gitlab # [ 147.129780] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:33.408Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"9cd9556a0a31e82d62721424","created_at":"2026-07-01T17:52:33.235Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2768b77d6a9466992fd1a3feb2786bdc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.257Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-9cd9556a0a31e82d62721424: done: 0.057555 sec","job_status":"done","queue_duration_s":0.093848,"scheduling_latency_s":0.093872,"redis_calls":12,"redis_duration_s":0.00827,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001177,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004538,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002555,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000496153,"exclusive_lock_hold_duration_s":0.028213640999999998,"duration_s":0.057555,"completed_at":"2026-07-01T17:52:33.408Z","load_balancing_strategy":"primary","db_duration_s":0.02697,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453vm-test-run-nixbot-gitlab> gitlab # [ 147.222132] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:33.416Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"b9ea092c08be6738971f62fb","created_at":"2026-07-01T17:52:33.291Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"4d7c01dc130340112541996a54c00462","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.335Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-b9ea092c08be6738971f62fb: start","job_status":"start","queue_duration_s":0.080387,"scheduling_latency_s":0.080409}1454vm-test-run-nixbot-gitlab> gitlab # [ 147.223956] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:33.438Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"b9ea092c08be6738971f62fb","created_at":"2026-07-01T17:52:33.291Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"4d7c01dc130340112541996a54c00462","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.335Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-b9ea092c08be6738971f62fb: done: 0.022514 sec","job_status":"done","queue_duration_s":0.080387,"scheduling_latency_s":0.080409,"redis_calls":10,"redis_duration_s":0.002222,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00046,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001317,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000445,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000340825,"duration_s":0.022514,"completed_at":"2026-07-01T17:52:33.438Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002341,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455vm-test-run-nixbot-gitlab> gitlab # [ 147.256523] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:33.440Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"b8a65dd6b5a5412b23ed0223","created_at":"2026-07-01T17:52:33.348Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2178d21cdc815f157e8fd2d5b8cee3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.359Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-b8a65dd6b5a5412b23ed0223: start","job_status":"start","queue_duration_s":0.080706,"scheduling_latency_s":0.080726}1456vm-test-run-nixbot-gitlab> gitlab # [ 147.837225] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:34.117Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"b8a65dd6b5a5412b23ed0223","created_at":"2026-07-01T17:52:33.348Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2178d21cdc815f157e8fd2d5b8cee3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.359Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-b8a65dd6b5a5412b23ed0223: done: 0.677162 sec","job_status":"done","queue_duration_s":0.080706,"scheduling_latency_s":0.080726,"redis_calls":574,"redis_duration_s":0.331341,"redis_read_bytes":573,"redis_write_bytes":49866,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003135,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.017663,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.310543,"redis_shared_state_read_bytes":567,"redis_shared_state_write_bytes":49017,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.359648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000574096,"duration_s":0.677162,"completed_at":"2026-07-01T17:52:34.117Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006584,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457vm-test-run-nixbot-gitlab> gitlab # [ 147.905166] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:34.184Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"ea357f2041c46f45f79faa6f","created_at":"2026-07-01T17:52:33.364Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9adf792810b4ffa70e4bc22a285a9fa0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.373Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-ea357f2041c46f45f79faa6f: start","job_status":"start","queue_duration_s":0.810871,"scheduling_latency_s":0.810908}1458vm-test-run-nixbot-gitlab> gitlab # [ 147.972931] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:34.252Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"ea357f2041c46f45f79faa6f","created_at":"2026-07-01T17:52:33.364Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9adf792810b4ffa70e4bc22a285a9fa0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.373Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-ea357f2041c46f45f79faa6f: done: 0.068313 sec","job_status":"done","queue_duration_s":0.810871,"scheduling_latency_s":0.810908,"redis_calls":12,"redis_duration_s":0.007275,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002601,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00311,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001564,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000916596,"duration_s":0.068313,"completed_at":"2026-07-01T17:52:34.252Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001335,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459vm-test-run-nixbot-gitlab> gitlab # [ 148.042601] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:34.322Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"29bbaf24af7bbd14fa2ceb99","created_at":"2026-07-01T17:52:33.380Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7cf213efacf844c1a69e1306758712b0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.384Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-29bbaf24af7bbd14fa2ceb99: start","job_status":"start","queue_duration_s":0.938114,"scheduling_latency_s":0.938199}1460vm-test-run-nixbot-gitlab> gitlab # [ 148.480991] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:34.761Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"29bbaf24af7bbd14fa2ceb99","created_at":"2026-07-01T17:52:33.380Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7cf213efacf844c1a69e1306758712b0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.384Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-29bbaf24af7bbd14fa2ceb99: done: 0.438736 sec","job_status":"done","queue_duration_s":0.938114,"scheduling_latency_s":0.938199,"redis_calls":14,"redis_duration_s":0.007474,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001673,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003547,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002254,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":125,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":125,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.061,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":125,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":80,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.061,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.332899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001058794,"exclusive_lock_hold_duration_s":0.393270933,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.438736,"completed_at":"2026-07-01T17:52:34.761Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.096884,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461vm-test-run-nixbot-gitlab> gitlab # [ 148.579767] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:34.859Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"0b991165bd4a8e5aa3eedf4e","created_at":"2026-07-01T17:52:33.387Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd89420d3110eb9bdbb37c7d72f08226","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-01T17:52:33.391Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-0b991165bd4a8e5aa3eedf4e: start","job_status":"start","queue_duration_s":1.467623,"scheduling_latency_s":1.467692}1462vm-test-run-nixbot-gitlab> gitlab # [ 148.624914] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:34.905Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1463vm-test-run-nixbot-gitlab> gitlab # [ 148.644949] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:34.924Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"0b991165bd4a8e5aa3eedf4e","created_at":"2026-07-01T17:52:33.387Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd89420d3110eb9bdbb37c7d72f08226","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-01T17:52:33.391Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-0b991165bd4a8e5aa3eedf4e: done: 0.065009 sec","job_status":"done","queue_duration_s":1.467623,"scheduling_latency_s":1.467692,"redis_calls":10,"redis_duration_s":0.007134000000000001,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000735,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005655,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000744,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000740317,"duration_s":0.065009,"completed_at":"2026-07-01T17:52:34.924Z","load_balancing_strategy":"primary","db_duration_s":0.000782,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464vm-test-run-nixbot-gitlab> gitlab # [ 148.711596] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:34.991Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"118ab463d4945535d97edad3","created_at":"2026-07-01T17:52:33.397Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d7951c9deacaf75fea69a9065beb76a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-01T17:52:33.407Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-118ab463d4945535d97edad3: start","job_status":"start","queue_duration_s":1.583967,"scheduling_latency_s":1.584034}1465vm-test-run-nixbot-gitlab> gitlab # [ 148.756387] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.036Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1466vm-test-run-nixbot-gitlab> gitlab # [ 148.774707] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.054Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"118ab463d4945535d97edad3","created_at":"2026-07-01T17:52:33.397Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d7951c9deacaf75fea69a9065beb76a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-01T17:52:33.407Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-118ab463d4945535d97edad3: done: 0.063204 sec","job_status":"done","queue_duration_s":1.583967,"scheduling_latency_s":1.584034,"redis_calls":10,"redis_duration_s":0.007236,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000734,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00564,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000862,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024402,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000741715,"duration_s":0.063204,"completed_at":"2026-07-01T17:52:35.054Z","load_balancing_strategy":"primary","db_duration_s":0.000798,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467vm-test-run-nixbot-gitlab> gitlab # [ 148.842589] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.122Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"4f02d5b1757cda785b517133","created_at":"2026-07-01T17:52:33.413Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d4c006da1ac86b04a19c0d7a41eb0b59","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.425Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-4f02d5b1757cda785b517133: start","job_status":"start","queue_duration_s":1.697038,"scheduling_latency_s":1.697112}1468vm-test-run-nixbot-gitlab> gitlab # [ 148.882983] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.163Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1469vm-test-run-nixbot-gitlab> gitlab # [ 148.901460] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.180Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"4f02d5b1757cda785b517133","created_at":"2026-07-01T17:52:33.413Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d4c006da1ac86b04a19c0d7a41eb0b59","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.425Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-4f02d5b1757cda785b517133: done: 0.058093 sec","job_status":"done","queue_duration_s":1.697038,"scheduling_latency_s":1.697112,"redis_calls":10,"redis_duration_s":0.005037,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001175,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002879,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000985042,"duration_s":0.058093,"completed_at":"2026-07-01T17:52:35.180Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001014,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470vm-test-run-nixbot-gitlab> gitlab # [ 148.972996] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.252Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"fadb9c3486022eb58b5580ba","created_at":"2026-07-01T17:52:33.430Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b23d1f080851bca5c5492d354e9d795","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.442Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-fadb9c3486022eb58b5580ba: start","job_status":"start","queue_duration_s":1.80965,"scheduling_latency_s":1.809714}1471vm-test-run-nixbot-gitlab> gitlab # [ 149.002805] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.283Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1472vm-test-run-nixbot-gitlab> gitlab # [ 149.020213] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.299Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"fadb9c3486022eb58b5580ba","created_at":"2026-07-01T17:52:33.430Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b23d1f080851bca5c5492d354e9d795","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.442Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-fadb9c3486022eb58b5580ba: done: 0.047503 sec","job_status":"done","queue_duration_s":1.80965,"scheduling_latency_s":1.809714,"redis_calls":10,"redis_duration_s":0.006,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001223,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00355,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001227,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025238,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000917714,"duration_s":0.047503,"completed_at":"2026-07-01T17:52:35.299Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002294,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473vm-test-run-nixbot-gitlab> gitlab # [ 149.022802] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.302Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"ad8187cc0df13d131cf0735f","created_at":"2026-07-01T17:52:33.448Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d71209df6282d40abcc02ebd7e0b8400","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.459Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-ad8187cc0df13d131cf0735f: start","job_status":"start","queue_duration_s":1.843506,"scheduling_latency_s":1.843547}1474vm-test-run-nixbot-gitlab> gitlab # [ 149.118243] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.398Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1475vm-test-run-nixbot-gitlab> gitlab # [ 149.135601] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.415Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"ad8187cc0df13d131cf0735f","created_at":"2026-07-01T17:52:33.448Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d71209df6282d40abcc02ebd7e0b8400","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.459Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-ad8187cc0df13d131cf0735f: done: 0.112568 sec","job_status":"done","queue_duration_s":1.843506,"scheduling_latency_s":1.843547,"redis_calls":10,"redis_duration_s":0.00414,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000753,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002496,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.078,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.078,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000935873,"duration_s":0.112568,"completed_at":"2026-07-01T17:52:35.415Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.077736,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476vm-test-run-nixbot-gitlab> gitlab # [ 149.205282] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.485Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"1db9a29806c5040f8dd77d28","created_at":"2026-07-01T17:52:33.473Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"05e2b828ee7321a1ee9152a564743aea","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-01T17:52:33.480Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-1db9a29806c5040f8dd77d28: start","job_status":"start","queue_duration_s":2.004439,"scheduling_latency_s":2.004477}1477vm-test-run-nixbot-gitlab> gitlab # [ 149.297444] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.577Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"1db9a29806c5040f8dd77d28","created_at":"2026-07-01T17:52:33.473Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"05e2b828ee7321a1ee9152a564743aea","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-01T17:52:33.480Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-1db9a29806c5040f8dd77d28: done: 0.091763 sec","job_status":"done","queue_duration_s":2.004439,"scheduling_latency_s":2.004477,"redis_calls":10,"redis_duration_s":0.006107,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001343,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003608,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001156,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000938946,"duration_s":0.091763,"completed_at":"2026-07-01T17:52:35.577Z","load_balancing_strategy":"primary","db_duration_s":0.007413,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478vm-test-run-nixbot-gitlab> gitlab # [ 149.387773] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.667Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"3a58c2e735d5ae10e9fac93d","created_at":"2026-07-01T17:52:33.487Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d11db210501cd8f2035e410d5a0cfa4","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.495Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-3a58c2e735d5ae10e9fac93d: start","job_status":"start","queue_duration_s":2.172369,"scheduling_latency_s":2.172434}1479vm-test-run-nixbot-gitlab> gitlab # [ 149.459915] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.739Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"3a58c2e735d5ae10e9fac93d","created_at":"2026-07-01T17:52:33.487Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d11db210501cd8f2035e410d5a0cfa4","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.495Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-3a58c2e735d5ae10e9fac93d: done: 0.072304 sec","job_status":"done","queue_duration_s":2.172369,"scheduling_latency_s":2.172434,"redis_calls":10,"redis_duration_s":0.006054,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001317,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003685,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000890616,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.072304,"completed_at":"2026-07-01T17:52:35.739Z","load_balancing_strategy":"primary","db_duration_s":0.024059,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480vm-test-run-nixbot-gitlab> gitlab # [ 149.462713] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.742Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"7a75a5deb758ca76d10ed1cd","created_at":"2026-07-01T17:52:33.503Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"05b96cfd344240ec2a0aa72815283f0a","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.512Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-7a75a5deb758ca76d10ed1cd: start","job_status":"start","queue_duration_s":2.229864,"scheduling_latency_s":2.229984}1481vm-test-run-nixbot-gitlab> gitlab # [ 149.489258] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.769Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"7a75a5deb758ca76d10ed1cd","created_at":"2026-07-01T17:52:33.503Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"05b96cfd344240ec2a0aa72815283f0a","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.512Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-7a75a5deb758ca76d10ed1cd: done: 0.026951 sec","job_status":"done","queue_duration_s":2.229864,"scheduling_latency_s":2.229984,"redis_calls":10,"redis_duration_s":0.002551,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000464,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001612,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000475,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000331047,"duration_s":0.026951,"completed_at":"2026-07-01T17:52:35.769Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005176,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482vm-test-run-nixbot-gitlab> gitlab # [ 149.587102] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.771Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"2f1c5b60a128405d60469604","created_at":"2026-07-01T17:52:33.525Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"126e6ea3bf7d49d9f082b7031712fa24","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.585Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-2f1c5b60a128405d60469604: start","job_status":"start","queue_duration_s":2.18538,"scheduling_latency_s":2.185401}1483vm-test-run-nixbot-gitlab> gitlab # [ 149.588264] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.794Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"2f1c5b60a128405d60469604","created_at":"2026-07-01T17:52:33.525Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"126e6ea3bf7d49d9f082b7031712fa24","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.585Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-2f1c5b60a128405d60469604: done: 0.022952 sec","job_status":"done","queue_duration_s":2.18538,"scheduling_latency_s":2.185401,"redis_calls":12,"redis_duration_s":0.0030239999999999998,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000597,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00138,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001047,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000458159,"exclusive_lock_hold_duration_s":0.004502806,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.022952,"completed_at":"2026-07-01T17:52:35.793Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004279,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484vm-test-run-nixbot-gitlab> gitlab # [ 149.673978] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.795Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"acb88e316bb54c6a16f5f677","created_at":"2026-07-01T17:52:33.590Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.598Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-acb88e316bb54c6a16f5f677: start","job_status":"start","queue_duration_s":2.197099,"scheduling_latency_s":2.19712}1485vm-test-run-nixbot-gitlab> gitlab # [ 149.675375] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.888Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"acb88e316bb54c6a16f5f677","created_at":"2026-07-01T17:52:33.590Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.598Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-acb88e316bb54c6a16f5f677: done: 0.093039 sec","job_status":"done","queue_duration_s":2.197099,"scheduling_latency_s":2.19712,"redis_calls":71,"redis_duration_s":0.016902999999999998,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002316,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000666,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.013234,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000687,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000361219,"duration_s":0.093039,"completed_at":"2026-07-01T17:52:35.888Z","load_balancing_strategy":"primary","db_duration_s":0.001874,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486vm-test-run-nixbot-gitlab> gitlab # [ 149.728061] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.889Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"c614b5e784115f5d72754f5b","created_at":"2026-07-01T17:52:33.607Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55068cf9feb71ec2cfe3f171d7ea53c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.616Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-c614b5e784115f5d72754f5b: start","job_status":"start","queue_duration_s":2.272892,"scheduling_latency_s":2.272955}1487vm-test-run-nixbot-gitlab> gitlab # [ 149.816487] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.921Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"c614b5e784115f5d72754f5b","created_at":"2026-07-01T17:52:33.607Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55068cf9feb71ec2cfe3f171d7ea53c4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.616Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-c614b5e784115f5d72754f5b: done: 0.031857 sec","job_status":"done","queue_duration_s":2.272892,"scheduling_latency_s":2.272955,"redis_calls":12,"redis_duration_s":0.002923,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00045,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001418,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00070428,"exclusive_lock_hold_duration_s":0.008317257,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.031857,"completed_at":"2026-07-01T17:52:35.921Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008902,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488vm-test-run-nixbot-gitlab> gitlab # [ 149.822863] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.923Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"89feff71ebc0ee71aa6ac62f","created_at":"2026-07-01T17:52:33.625Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"be4a89915d6681c39506698ed086013a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.642Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-89feff71ebc0ee71aa6ac62f: start","job_status":"start","queue_duration_s":2.280487,"scheduling_latency_s":2.280508}1489vm-test-run-nixbot-gitlab> gitlab # [ 149.900143] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.942Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"89feff71ebc0ee71aa6ac62f","created_at":"2026-07-01T17:52:33.625Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"be4a89915d6681c39506698ed086013a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.642Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-89feff71ebc0ee71aa6ac62f: done: 0.019155 sec","job_status":"done","queue_duration_s":2.280487,"scheduling_latency_s":2.280508,"redis_calls":10,"redis_duration_s":0.002199,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00041,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001371,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000332723,"duration_s":0.019155,"completed_at":"2026-07-01T17:52:35.942Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00168,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490vm-test-run-nixbot-gitlab> gitlab # [ 149.908443] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.943Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"2eb57e166e2653aff4fef0c3","created_at":"2026-07-01T17:52:33.658Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"32508bfbf65012d3f3196237669ebb3f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.665Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-2eb57e166e2653aff4fef0c3: start","job_status":"start","queue_duration_s":2.277725,"scheduling_latency_s":2.277746}1491vm-test-run-nixbot-gitlab> gitlab # [ 149.932066] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.983Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"2eb57e166e2653aff4fef0c3","created_at":"2026-07-01T17:52:33.658Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"32508bfbf65012d3f3196237669ebb3f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.665Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-2eb57e166e2653aff4fef0c3: done: 0.040273 sec","job_status":"done","queue_duration_s":2.277725,"scheduling_latency_s":2.277746,"redis_calls":14,"redis_duration_s":0.005376000000000001,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002906,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001374,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001096,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000589461,"exclusive_lock_hold_duration_s":0.015480738,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.040273,"completed_at":"2026-07-01T17:52:35.983Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012248,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492vm-test-run-nixbot-gitlab> gitlab # [ 150.019663] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:35.985Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"de5370bda9692e4d3cbde06e","created_at":"2026-07-01T17:52:33.674Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"10faabf100a01c5350336cb03a00271e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.682Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-de5370bda9692e4d3cbde06e: start","job_status":"start","queue_duration_s":2.302865,"scheduling_latency_s":2.302886}1493vm-test-run-nixbot-gitlab> gitlab # [ 150.023090] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.013Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"de5370bda9692e4d3cbde06e","created_at":"2026-07-01T17:52:33.674Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"10faabf100a01c5350336cb03a00271e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.682Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-de5370bda9692e4d3cbde06e: done: 0.028085 sec","job_status":"done","queue_duration_s":2.302865,"scheduling_latency_s":2.302886,"redis_calls":19,"redis_duration_s":0.004219,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00089,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000288,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002385,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000656,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037826,"duration_s":0.028085,"completed_at":"2026-07-01T17:52:36.013Z","load_balancing_strategy":"primary","db_duration_s":0.001713,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494vm-test-run-nixbot-gitlab> gitlab # [ 150.095094] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.014Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"33dd7c0ec0b988b386b4507f","created_at":"2026-07-01T17:52:33.691Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"acc84cbd31ea70ac244e92ee69748d74","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.697Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-33dd7c0ec0b988b386b4507f: start","job_status":"start","queue_duration_s":2.317114,"scheduling_latency_s":2.317134}1495vm-test-run-nixbot-gitlab> gitlab # [ 150.112875] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.032Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"33dd7c0ec0b988b386b4507f","created_at":"2026-07-01T17:52:33.691Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"acc84cbd31ea70ac244e92ee69748d74","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.697Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-33dd7c0ec0b988b386b4507f: done: 0.017845 sec","job_status":"done","queue_duration_s":2.317114,"scheduling_latency_s":2.317134,"redis_calls":10,"redis_duration_s":0.002265,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000415,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001393,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000457,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009922,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000384127,"duration_s":0.017845,"completed_at":"2026-07-01T17:52:36.032Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000926,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496vm-test-run-nixbot-gitlab> gitlab # [ 150.181558] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.034Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"52879028532333ffa8a2b966","created_at":"2026-07-01T17:52:33.706Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2eb91ccace6ea9550f788032fe7f17e6","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.714Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-52879028532333ffa8a2b966: start","job_status":"start","queue_duration_s":2.319456,"scheduling_latency_s":2.319477}1497vm-test-run-nixbot-gitlab> gitlab # [ 150.204350] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.054Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"52879028532333ffa8a2b966","created_at":"2026-07-01T17:52:33.706Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2eb91ccace6ea9550f788032fe7f17e6","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.714Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-52879028532333ffa8a2b966: done: 0.02008 sec","job_status":"done","queue_duration_s":2.319456,"scheduling_latency_s":2.319477,"redis_calls":12,"redis_duration_s":0.002943,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000515,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001452,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000485257,"exclusive_lock_hold_duration_s":0.003198172,"duration_s":0.02008,"completed_at":"2026-07-01T17:52:36.054Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001781,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498vm-test-run-nixbot-gitlab> gitlab # [ 150.273331] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.055Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c61bd633d946a8d37902b49e","created_at":"2026-07-01T17:52:33.725Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c48657e85a6b6bee7c59ce47107afbc5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.732Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c61bd633d946a8d37902b49e: start","job_status":"start","queue_duration_s":2.323141,"scheduling_latency_s":2.323161}1499vm-test-run-nixbot-gitlab> gitlab # [ 150.296344] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.066Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1500vm-test-run-nixbot-gitlab> gitlab # [ 150.302856] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.072Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c61bd633d946a8d37902b49e","created_at":"2026-07-01T17:52:33.725Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c48657e85a6b6bee7c59ce47107afbc5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.732Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c61bd633d946a8d37902b49e: done: 0.017276 sec","job_status":"done","queue_duration_s":2.323141,"scheduling_latency_s":2.323161,"redis_calls":10,"redis_duration_s":0.002495,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000429,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001546,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00052,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000564317,"duration_s":0.017276,"completed_at":"2026-07-01T17:52:36.072Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000341,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501vm-test-run-nixbot-gitlab> gitlab # [ 150.394409] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.074Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"1adcf290aa330fd0e28605b0","created_at":"2026-07-01T17:52:33.748Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9f55d6fdaadbea007cf6ba1ae4f0395","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.760Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-1adcf290aa330fd0e28605b0: start","job_status":"start","queue_duration_s":2.313559,"scheduling_latency_s":2.313579}1502vm-test-run-nixbot-gitlab> gitlab # [ 150.396254] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.091Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"1adcf290aa330fd0e28605b0","created_at":"2026-07-01T17:52:33.748Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9f55d6fdaadbea007cf6ba1ae4f0395","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.760Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-1adcf290aa330fd0e28605b0: done: 0.017112 sec","job_status":"done","queue_duration_s":2.313559,"scheduling_latency_s":2.313579,"redis_calls":12,"redis_duration_s":0.002755,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000506,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000426,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001317,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000506,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010263,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000499226,"duration_s":0.017112,"completed_at":"2026-07-01T17:52:36.091Z","load_balancing_strategy":"primary","db_duration_s":0.000348,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503vm-test-run-nixbot-gitlab> gitlab # [ 150.514047] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.092Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"5d079b3294f8c69b5808bc7d","created_at":"2026-07-01T17:52:33.767Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e13197a0a2d131cdb4b6a3e782c5146d","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.779Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-5d079b3294f8c69b5808bc7d: start","job_status":"start","queue_duration_s":2.313044,"scheduling_latency_s":2.313064}1504vm-test-run-nixbot-gitlab> gitlab # [ 150.515242] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.125Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"5d079b3294f8c69b5808bc7d","created_at":"2026-07-01T17:52:33.767Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e13197a0a2d131cdb4b6a3e782c5146d","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-01T17:52:33.779Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-5d079b3294f8c69b5808bc7d: done: 0.032658 sec","job_status":"done","queue_duration_s":2.313044,"scheduling_latency_s":2.313064,"redis_calls":13,"redis_duration_s":0.008266,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000989,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002349,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004928,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.008541869,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.032658,"completed_at":"2026-07-01T17:52:36.125Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004539,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1505vm-test-run-nixbot-gitlab> gitlab # [ 150.602263] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0694b959ecc2a3da9b2026b8","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0694b959ecc2a3da9b2026b8: start","job_status":"start","queue_duration_s":0.246268,"scheduling_latency_s":0.24629}1506vm-test-run-nixbot-gitlab> gitlab # [ 150.603731] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0694b959ecc2a3da9b2026b8","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0694b959ecc2a3da9b2026b8: done: 0.020194 sec","job_status":"done","queue_duration_s":0.246268,"scheduling_latency_s":0.24629,"redis_calls":16,"redis_duration_s":0.003722,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000449,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001006,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002267,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000322108,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020194,"completed_at":"2026-07-01T17:52:36.146Z","load_balancing_strategy":"primary","db_duration_s":0.000349,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507vm-test-run-nixbot-gitlab> gitlab # [ 150.679593] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e97ac6af08a1835eb7737c47","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e97ac6af08a1835eb7737c47: start","job_status":"start","queue_duration_s":0.267862,"scheduling_latency_s":0.267882}1508vm-test-run-nixbot-gitlab> gitlab # [ 150.680951] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.163Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e97ac6af08a1835eb7737c47","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e97ac6af08a1835eb7737c47: done: 0.015206 sec","job_status":"done","queue_duration_s":0.267862,"scheduling_latency_s":0.267882,"redis_calls":13,"redis_duration_s":0.002737,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000886,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001851,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010384,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015206,"completed_at":"2026-07-01T17:52:36.163Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509vm-test-run-nixbot-gitlab> gitlab # [ 150.716913] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.164Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff49f8ac6a7901dbe612a459","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff49f8ac6a7901dbe612a459: start","job_status":"start","queue_duration_s":0.284422,"scheduling_latency_s":0.284488}1510vm-test-run-nixbot-gitlab> gitlab # [ 150.735153] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff49f8ac6a7901dbe612a459","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff49f8ac6a7901dbe612a459: done: 0.015201 sec","job_status":"done","queue_duration_s":0.284422,"scheduling_latency_s":0.284488,"redis_calls":13,"redis_duration_s":0.003031,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010136,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015201,"completed_at":"2026-07-01T17:52:36.179Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511vm-test-run-nixbot-gitlab> gitlab # [ 150.822484] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.184Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c232696f2e9c40b51a4932e","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c232696f2e9c40b51a4932e: start","job_status":"start","queue_duration_s":0.304416,"scheduling_latency_s":0.304438}1512vm-test-run-nixbot-gitlab> gitlab # [ 150.824185] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c232696f2e9c40b51a4932e","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c232696f2e9c40b51a4932e: done: 0.015699 sec","job_status":"done","queue_duration_s":0.304416,"scheduling_latency_s":0.304438,"redis_calls":13,"redis_duration_s":0.003222,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002252,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015699,"completed_at":"2026-07-01T17:52:36.200Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513vm-test-run-nixbot-gitlab> gitlab # [ 150.917866] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c21d6b94931a8ba900db6bc6","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c21d6b94931a8ba900db6bc6: start","job_status":"start","queue_duration_s":0.321426,"scheduling_latency_s":0.321486}1514vm-test-run-nixbot-gitlab> gitlab # [ 150.919223] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c21d6b94931a8ba900db6bc6","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c21d6b94931a8ba900db6bc6: done: 0.062672 sec","job_status":"done","queue_duration_s":0.321426,"scheduling_latency_s":0.321486,"redis_calls":13,"redis_duration_s":0.003316,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001081,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002235,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.062672,"completed_at":"2026-07-01T17:52:36.264Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515vm-test-run-nixbot-gitlab> gitlab # [ 150.956424] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ced0f67ac6b419f888654825","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ced0f67ac6b419f888654825: start","job_status":"start","queue_duration_s":0.385513,"scheduling_latency_s":0.385536}1516vm-test-run-nixbot-gitlab> gitlab # [ 151.024908] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ced0f67ac6b419f888654825","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ced0f67ac6b419f888654825: done: 0.016164 sec","job_status":"done","queue_duration_s":0.385513,"scheduling_latency_s":0.385536,"redis_calls":13,"redis_duration_s":0.003303,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002369,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016164,"completed_at":"2026-07-01T17:52:36.281Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517vm-test-run-nixbot-gitlab> gitlab # [ 151.098226] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0dfa95affd9e6cac6d35c1b8","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0dfa95affd9e6cac6d35c1b8: start","job_status":"start","queue_duration_s":0.402896,"scheduling_latency_s":0.402918}1518vm-test-run-nixbot-gitlab> gitlab # [ 151.099904] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0dfa95affd9e6cac6d35c1b8","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0dfa95affd9e6cac6d35c1b8: done: 0.014852 sec","job_status":"done","queue_duration_s":0.402896,"scheduling_latency_s":0.402918,"redis_calls":13,"redis_duration_s":0.0031,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002173,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014852,"completed_at":"2026-07-01T17:52:36.298Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519vm-test-run-nixbot-gitlab> gitlab # [ 151.117149] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"072e065c55bf36b2cb4bb466","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-072e065c55bf36b2cb4bb466: start","job_status":"start","queue_duration_s":0.419303,"scheduling_latency_s":0.419325}1520vm-test-run-nixbot-gitlab> gitlab # [ 151.193932] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"072e065c55bf36b2cb4bb466","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-072e065c55bf36b2cb4bb466: done: 0.015355 sec","job_status":"done","queue_duration_s":0.419303,"scheduling_latency_s":0.419325,"redis_calls":13,"redis_duration_s":0.0029890000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015355,"completed_at":"2026-07-01T17:52:36.314Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521vm-test-run-nixbot-gitlab> gitlab # [ 151.197718] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"777f75bb0a8d66c42da60676","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-777f75bb0a8d66c42da60676: start","job_status":"start","queue_duration_s":0.436037,"scheduling_latency_s":0.436058}1522vm-test-run-nixbot-gitlab> gitlab # [ 151.217817] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"777f75bb0a8d66c42da60676","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-777f75bb0a8d66c42da60676: done: 0.015185 sec","job_status":"done","queue_duration_s":0.436037,"scheduling_latency_s":0.436058,"redis_calls":13,"redis_duration_s":0.0030559999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015185,"completed_at":"2026-07-01T17:52:36.331Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523vm-test-run-nixbot-gitlab> gitlab # [ 151.281207] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a56d85e9713b9b7e01b7a74","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a56d85e9713b9b7e01b7a74: start","job_status":"start","queue_duration_s":0.452587,"scheduling_latency_s":0.452608}1524vm-test-run-nixbot-gitlab> gitlab # [ 151.350041] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a56d85e9713b9b7e01b7a74","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a56d85e9713b9b7e01b7a74: done: 0.01499 sec","job_status":"done","queue_duration_s":0.452587,"scheduling_latency_s":0.452608,"redis_calls":13,"redis_duration_s":0.002966,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000908,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009613,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01499,"completed_at":"2026-07-01T17:52:36.347Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525vm-test-run-nixbot-gitlab> gitlab # [ 151.361165] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"329c75d48c9798544d2e41fd","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-329c75d48c9798544d2e41fd: start","job_status":"start","queue_duration_s":0.469141,"scheduling_latency_s":0.469161}1526vm-test-run-nixbot-gitlab> gitlab # [ 151.445223] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"329c75d48c9798544d2e41fd","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-329c75d48c9798544d2e41fd: done: 0.015139 sec","job_status":"done","queue_duration_s":0.469141,"scheduling_latency_s":0.469161,"redis_calls":13,"redis_duration_s":0.003334,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001274,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00206,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015139,"completed_at":"2026-07-01T17:52:36.364Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527vm-test-run-nixbot-gitlab> gitlab # [ 151.447082] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d41808a13d5893ceb269139c","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d41808a13d5893ceb269139c: start","job_status":"start","queue_duration_s":0.48564,"scheduling_latency_s":0.485661}1528vm-test-run-nixbot-gitlab> gitlab # [ 151.461313] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d41808a13d5893ceb269139c","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d41808a13d5893ceb269139c: done: 0.015555 sec","job_status":"done","queue_duration_s":0.48564,"scheduling_latency_s":0.485661,"redis_calls":13,"redis_duration_s":0.003575,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001322,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002253,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015555,"completed_at":"2026-07-01T17:52:36.381Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529vm-test-run-nixbot-gitlab> gitlab # [ 151.534811] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.382Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64c4426074d99323d2e4110f","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64c4426074d99323d2e4110f: start","job_status":"start","queue_duration_s":0.502544,"scheduling_latency_s":0.502565}1530vm-test-run-nixbot-gitlab> gitlab # [ 151.542251] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.398Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64c4426074d99323d2e4110f","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64c4426074d99323d2e4110f: done: 0.015284 sec","job_status":"done","queue_duration_s":0.502544,"scheduling_latency_s":0.502565,"redis_calls":13,"redis_duration_s":0.0031799999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000933,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002247,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009722,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015284,"completed_at":"2026-07-01T17:52:36.398Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531vm-test-run-nixbot-gitlab> gitlab # [ 151.617356] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.399Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af84c35dd138bca2b0ed3123","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af84c35dd138bca2b0ed3123: start","job_status":"start","queue_duration_s":0.519092,"scheduling_latency_s":0.519113}1532vm-test-run-nixbot-gitlab> gitlab # [ 151.624314] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af84c35dd138bca2b0ed3123","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af84c35dd138bca2b0ed3123: done: 0.015599 sec","job_status":"done","queue_duration_s":0.519092,"scheduling_latency_s":0.519113,"redis_calls":13,"redis_duration_s":0.003092,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002149,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015599,"completed_at":"2026-07-01T17:52:36.415Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533vm-test-run-nixbot-gitlab> gitlab # [ 151.685472] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbacde6acb7ef676b96b7b01","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbacde6acb7ef676b96b7b01: start","job_status":"start","queue_duration_s":0.535987,"scheduling_latency_s":0.536007}1534vm-test-run-nixbot-gitlab> gitlab # [ 151.759336] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.431Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbacde6acb7ef676b96b7b01","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbacde6acb7ef676b96b7b01: done: 0.015216 sec","job_status":"done","queue_duration_s":0.535987,"scheduling_latency_s":0.536007,"redis_calls":13,"redis_duration_s":0.0033929999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000966,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002427,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015216,"completed_at":"2026-07-01T17:52:36.431Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535vm-test-run-nixbot-gitlab> gitlab # [ 151.767409] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af22fc4f3aa6dfb445673859","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af22fc4f3aa6dfb445673859: start","job_status":"start","queue_duration_s":0.552558,"scheduling_latency_s":0.552579}1536vm-test-run-nixbot-gitlab> gitlab # [ 151.787474] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af22fc4f3aa6dfb445673859","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af22fc4f3aa6dfb445673859: done: 0.01527 sec","job_status":"done","queue_duration_s":0.552558,"scheduling_latency_s":0.552579,"redis_calls":13,"redis_duration_s":0.003212,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002296,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01527,"completed_at":"2026-07-01T17:52:36.448Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537vm-test-run-nixbot-gitlab> gitlab # [ 151.860258] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.449Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9229824ec70e7df456cb93aa","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9229824ec70e7df456cb93aa: start","job_status":"start","queue_duration_s":0.569084,"scheduling_latency_s":0.569105}1538vm-test-run-nixbot-gitlab> gitlab # [ 151.868266] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.466Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9229824ec70e7df456cb93aa","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9229824ec70e7df456cb93aa: done: 0.017507 sec","job_status":"done","queue_duration_s":0.569084,"scheduling_latency_s":0.569105,"redis_calls":13,"redis_duration_s":0.005267,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001576,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003691,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017507,"completed_at":"2026-07-01T17:52:36.466Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539vm-test-run-nixbot-gitlab> gitlab # [ 151.967127] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.468Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4c304f9e9fa8a0e02295963","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4c304f9e9fa8a0e02295963: start","job_status":"start","queue_duration_s":0.588486,"scheduling_latency_s":0.588507}1540vm-test-run-nixbot-gitlab> gitlab # [ 151.968298] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.484Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4c304f9e9fa8a0e02295963","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4c304f9e9fa8a0e02295963: done: 0.015711 sec","job_status":"done","queue_duration_s":0.588486,"scheduling_latency_s":0.588507,"redis_calls":13,"redis_duration_s":0.00358,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002532,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015711,"completed_at":"2026-07-01T17:52:36.484Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541vm-test-run-nixbot-gitlab> gitlab # [ 152.037314] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"745bb893f0631fb9d64192f0","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-745bb893f0631fb9d64192f0: start","job_status":"start","queue_duration_s":0.605487,"scheduling_latency_s":0.605509}1542vm-test-run-nixbot-gitlab> gitlab # [ 152.038568] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.501Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"745bb893f0631fb9d64192f0","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-745bb893f0631fb9d64192f0: done: 0.015333 sec","job_status":"done","queue_duration_s":0.605487,"scheduling_latency_s":0.605509,"redis_calls":13,"redis_duration_s":0.003231,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002353,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015333,"completed_at":"2026-07-01T17:52:36.501Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543vm-test-run-nixbot-gitlab> gitlab # [ 152.108381] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c63f782e656dabef6140514","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c63f782e656dabef6140514: start","job_status":"start","queue_duration_s":0.622048,"scheduling_latency_s":0.62207}1544vm-test-run-nixbot-gitlab> gitlab # [ 152.109460] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c63f782e656dabef6140514","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c63f782e656dabef6140514: done: 0.015247 sec","job_status":"done","queue_duration_s":0.622048,"scheduling_latency_s":0.62207,"redis_calls":13,"redis_duration_s":0.002969,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000882,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002087,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015247,"completed_at":"2026-07-01T17:52:36.517Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545vm-test-run-nixbot-gitlab> gitlab # [ 152.188116] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.519Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd1eb84959a52c40a7b9cce4","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd1eb84959a52c40a7b9cce4: start","job_status":"start","queue_duration_s":0.638698,"scheduling_latency_s":0.638719}1546vm-test-run-nixbot-gitlab> gitlab # [ 152.189791] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd1eb84959a52c40a7b9cce4","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd1eb84959a52c40a7b9cce4: done: 0.01597 sec","job_status":"done","queue_duration_s":0.638698,"scheduling_latency_s":0.638719,"redis_calls":13,"redis_duration_s":0.003066,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002136,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01597,"completed_at":"2026-07-01T17:52:36.534Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547vm-test-run-nixbot-gitlab> gitlab # [ 152.252974] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.536Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"092ec39378f68ee77c407866","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-092ec39378f68ee77c407866: start","job_status":"start","queue_duration_s":0.655974,"scheduling_latency_s":0.655996}1548vm-test-run-nixbot-gitlab> gitlab # [ 152.335986] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"092ec39378f68ee77c407866","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-092ec39378f68ee77c407866: done: 0.015354 sec","job_status":"done","queue_duration_s":0.655974,"scheduling_latency_s":0.655996,"redis_calls":13,"redis_duration_s":0.0031030000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002145,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015354,"completed_at":"2026-07-01T17:52:36.551Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549vm-test-run-nixbot-gitlab> gitlab # [ 152.338050] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.553Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58ae6a6edc42618426e3bac8","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58ae6a6edc42618426e3bac8: start","job_status":"start","queue_duration_s":0.672675,"scheduling_latency_s":0.672697}1550vm-test-run-nixbot-gitlab> gitlab # [ 152.353214] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.568Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58ae6a6edc42618426e3bac8","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58ae6a6edc42618426e3bac8: done: 0.015249 sec","job_status":"done","queue_duration_s":0.672675,"scheduling_latency_s":0.672697,"redis_calls":13,"redis_duration_s":0.003371,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001256,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002115,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015249,"completed_at":"2026-07-01T17:52:36.568Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551vm-test-run-nixbot-gitlab> gitlab # [ 152.416895] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f841e141e34b02414dc884e","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f841e141e34b02414dc884e: start","job_status":"start","queue_duration_s":0.689175,"scheduling_latency_s":0.689205}1552vm-test-run-nixbot-gitlab> gitlab # [ 152.489422] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f841e141e34b02414dc884e","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f841e141e34b02414dc884e: done: 0.015786 sec","job_status":"done","queue_duration_s":0.689175,"scheduling_latency_s":0.689205,"redis_calls":13,"redis_duration_s":0.003184,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002223,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015786,"completed_at":"2026-07-01T17:52:36.585Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553vm-test-run-nixbot-gitlab> gitlab # [ 152.498834] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0581a37c7dea1026e446a3e","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0581a37c7dea1026e446a3e: start","job_status":"start","queue_duration_s":0.706227,"scheduling_latency_s":0.706248}1554vm-test-run-nixbot-gitlab> gitlab # [ 152.518398] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0581a37c7dea1026e446a3e","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0581a37c7dea1026e446a3e: done: 0.015547 sec","job_status":"done","queue_duration_s":0.706227,"scheduling_latency_s":0.706248,"redis_calls":13,"redis_duration_s":0.003104,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00218,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009299,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015547,"completed_at":"2026-07-01T17:52:36.602Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555vm-test-run-nixbot-gitlab> gitlab # [ 152.596091] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23a719d0c8edc3e7c5fe5b0b","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23a719d0c8edc3e7c5fe5b0b: start","job_status":"start","queue_duration_s":0.723068,"scheduling_latency_s":0.723089}1556vm-test-run-nixbot-gitlab> gitlab # [ 152.598348] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.619Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23a719d0c8edc3e7c5fe5b0b","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23a719d0c8edc3e7c5fe5b0b: done: 0.015656 sec","job_status":"done","queue_duration_s":0.723068,"scheduling_latency_s":0.723089,"redis_calls":13,"redis_duration_s":0.003073,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002153,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015656,"completed_at":"2026-07-01T17:52:36.619Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557vm-test-run-nixbot-gitlab> gitlab # [ 152.683316] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c15103ee927b6cb842f71303","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c15103ee927b6cb842f71303: start","job_status":"start","queue_duration_s":0.740027,"scheduling_latency_s":0.740049}1558vm-test-run-nixbot-gitlab> gitlab # [ 152.684423] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c15103ee927b6cb842f71303","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c15103ee927b6cb842f71303: done: 0.015584 sec","job_status":"done","queue_duration_s":0.740027,"scheduling_latency_s":0.740049,"redis_calls":13,"redis_duration_s":0.003068,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015584,"completed_at":"2026-07-01T17:52:36.635Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559vm-test-run-nixbot-gitlab> gitlab # [ 152.763945] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.637Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"efc7af9a4ea560d25ef1ba44","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-efc7af9a4ea560d25ef1ba44: start","job_status":"start","queue_duration_s":0.756881,"scheduling_latency_s":0.756902}1560vm-test-run-nixbot-gitlab> gitlab # [ 152.765095] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.652Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"efc7af9a4ea560d25ef1ba44","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-efc7af9a4ea560d25ef1ba44: done: 0.015456 sec","job_status":"done","queue_duration_s":0.756881,"scheduling_latency_s":0.756902,"redis_calls":13,"redis_duration_s":0.0029830000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015456,"completed_at":"2026-07-01T17:52:36.652Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561vm-test-run-nixbot-gitlab> gitlab # [ 152.843109] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.654Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72a076831965015e9da23ee9","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72a076831965015e9da23ee9: start","job_status":"start","queue_duration_s":0.773784,"scheduling_latency_s":0.773805}1562vm-test-run-nixbot-gitlab> gitlab # [ 152.844441] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72a076831965015e9da23ee9","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72a076831965015e9da23ee9: done: 0.014916 sec","job_status":"done","queue_duration_s":0.773784,"scheduling_latency_s":0.773805,"redis_calls":13,"redis_duration_s":0.002765,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000843,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014916,"completed_at":"2026-07-01T17:52:36.669Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563vm-test-run-nixbot-gitlab> gitlab # [ 152.942211] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eaf4ed44c2cd0e145441f61b","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eaf4ed44c2cd0e145441f61b: start","job_status":"start","queue_duration_s":0.790227,"scheduling_latency_s":0.790248}1564vm-test-run-nixbot-gitlab> gitlab # [ 152.943873] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eaf4ed44c2cd0e145441f61b","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eaf4ed44c2cd0e145441f61b: done: 0.025248 sec","job_status":"done","queue_duration_s":0.790227,"scheduling_latency_s":0.790248,"redis_calls":13,"redis_duration_s":0.011158999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008622,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025248,"completed_at":"2026-07-01T17:52:36.695Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565vm-test-run-nixbot-gitlab> gitlab # [ 153.031839] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5cb17d69f2a1255315156b4","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5cb17d69f2a1255315156b4: start","job_status":"start","queue_duration_s":0.817391,"scheduling_latency_s":0.817418}1566vm-test-run-nixbot-gitlab> gitlab # [ 153.033243] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5cb17d69f2a1255315156b4","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5cb17d69f2a1255315156b4: done: 0.015822 sec","job_status":"done","queue_duration_s":0.817391,"scheduling_latency_s":0.817418,"redis_calls":13,"redis_duration_s":0.002904,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015822,"completed_at":"2026-07-01T17:52:36.713Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567vm-test-run-nixbot-gitlab> gitlab # [ 153.061539] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.715Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1186b912c5b49f07f74896ca","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1186b912c5b49f07f74896ca: start","job_status":"start","queue_duration_s":0.834629,"scheduling_latency_s":0.834651}1568vm-test-run-nixbot-gitlab> gitlab # [ 153.137248] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1186b912c5b49f07f74896ca","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1186b912c5b49f07f74896ca: done: 0.049264 sec","job_status":"done","queue_duration_s":0.834629,"scheduling_latency_s":0.834651,"redis_calls":13,"redis_duration_s":0.032758999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.008947,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.023812,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.049264,"completed_at":"2026-07-01T17:52:36.764Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569vm-test-run-nixbot-gitlab> gitlab # [ 153.205139] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:36.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14102652e9a7ee109ee29c07","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14102652e9a7ee109ee29c07: start","job_status":"start","queue_duration_s":0.885794,"scheduling_latency_s":0.885821}1570vm-test-run-nixbot-gitlab> gitlab # [ 153.491711] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2969233163 wd_nsec: 29692317711571vm-test-run-nixbot-gitlab> gitlab # [ 153.260900] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:39.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14102652e9a7ee109ee29c07","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14102652e9a7ee109ee29c07: done: 2.774943 sec","job_status":"done","queue_duration_s":0.885794,"scheduling_latency_s":0.885821,"redis_calls":13,"redis_duration_s":0.019278,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.016682,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002596,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":2.774943,"completed_at":"2026-07-01T17:52:39.541Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1572vm-test-run-nixbot-gitlab> gitlab # [ 153.332441] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:39.612Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7352d15c36ad97df1790683","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7352d15c36ad97df1790683: start","job_status":"start","queue_duration_s":3.731952,"scheduling_latency_s":3.732017}1573vm-test-run-nixbot-gitlab> gitlab # [ 153.425947] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:39.705Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7352d15c36ad97df1790683","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7352d15c36ad97df1790683: done: 0.093559 sec","job_status":"done","queue_duration_s":3.731952,"scheduling_latency_s":3.732017,"redis_calls":13,"redis_duration_s":0.027788,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.007564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.020224,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.093559,"completed_at":"2026-07-01T17:52:39.705Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1574vm-test-run-nixbot-gitlab> gitlab # [ 153.473398] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:39.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5d6b97e751ce22b6965ade6","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5d6b97e751ce22b6965ade6: start","job_status":"start","queue_duration_s":3.841211,"scheduling_latency_s":3.841275}1575vm-test-run-nixbot-gitlab> gitlab # [ 153.582398] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:39.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5d6b97e751ce22b6965ade6","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5d6b97e751ce22b6965ade6: done: 0.140608 sec","job_status":"done","queue_duration_s":3.841211,"scheduling_latency_s":3.841275,"redis_calls":13,"redis_duration_s":0.075676,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.054828,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.020848,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.140608,"completed_at":"2026-07-01T17:52:39.862Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1576vm-test-run-nixbot-gitlab> gitlab # [ 153.663362] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:39.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cfa56bf15146a232342d7a7f","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cfa56bf15146a232342d7a7f: start","job_status":"start","queue_duration_s":4.062993,"scheduling_latency_s":4.063059}1577vm-test-run-nixbot-gitlab> gitlab # [ 153.752401] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cfa56bf15146a232342d7a7f","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cfa56bf15146a232342d7a7f: done: 0.077808 sec","job_status":"done","queue_duration_s":4.062993,"scheduling_latency_s":4.063059,"redis_calls":13,"redis_duration_s":0.031714,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.010826,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.020888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.077808,"completed_at":"2026-07-01T17:52:40.021Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1578vm-test-run-nixbot-gitlab> gitlab # [ 153.800354] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"991a63d6ade0740ca2d54781","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-991a63d6ade0740ca2d54781: start","job_status":"start","queue_duration_s":4.164606,"scheduling_latency_s":4.164654}1579vm-test-run-nixbot-gitlab> gitlab # [ 153.864903] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"991a63d6ade0740ca2d54781","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-991a63d6ade0740ca2d54781: done: 0.09951 sec","job_status":"done","queue_duration_s":4.164606,"scheduling_latency_s":4.164654,"redis_calls":13,"redis_duration_s":0.048402,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.043045,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005357,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.09951,"completed_at":"2026-07-01T17:52:40.144Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1580vm-test-run-nixbot-gitlab> gitlab # [ 153.902557] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.155Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"122e4dd7dbd51760bf8dfd7d","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-122e4dd7dbd51760bf8dfd7d: start","job_status":"start","queue_duration_s":4.275279,"scheduling_latency_s":4.275341}1581vm-test-run-nixbot-gitlab> gitlab # [ 153.924800] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.204Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"122e4dd7dbd51760bf8dfd7d","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-122e4dd7dbd51760bf8dfd7d: done: 0.049249 sec","job_status":"done","queue_duration_s":4.275279,"scheduling_latency_s":4.275341,"redis_calls":13,"redis_duration_s":0.011088,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003325,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007763,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022602,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.049249,"completed_at":"2026-07-01T17:52:40.204Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1582vm-test-run-nixbot-gitlab> gitlab # [ 153.938657] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5dab40de0dbe42ac6b9f9f19","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5dab40de0dbe42ac6b9f9f19: start","job_status":"start","queue_duration_s":4.327177,"scheduling_latency_s":4.327232}1583vm-test-run-nixbot-gitlab> gitlab # [ 153.959199] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.222Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5dab40de0dbe42ac6b9f9f19","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5dab40de0dbe42ac6b9f9f19: done: 0.015336 sec","job_status":"done","queue_duration_s":4.327177,"scheduling_latency_s":4.327232,"redis_calls":13,"redis_duration_s":0.0029950000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000933,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015336,"completed_at":"2026-07-01T17:52:40.222Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1584vm-test-run-nixbot-gitlab> gitlab # [ 154.036380] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4fbce0d1554524b93605baf","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4fbce0d1554524b93605baf: start","job_status":"start","queue_duration_s":4.343886,"scheduling_latency_s":4.343907}1585vm-test-run-nixbot-gitlab> gitlab # [ 154.039457] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.239Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4fbce0d1554524b93605baf","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4fbce0d1554524b93605baf: done: 0.015257 sec","job_status":"done","queue_duration_s":4.343886,"scheduling_latency_s":4.343907,"redis_calls":13,"redis_duration_s":0.002938,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015257,"completed_at":"2026-07-01T17:52:40.239Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1586vm-test-run-nixbot-gitlab> gitlab # [ 154.113586] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"278c73f5843e1c32472d235d","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-278c73f5843e1c32472d235d: start","job_status":"start","queue_duration_s":4.360415,"scheduling_latency_s":4.360436}1587vm-test-run-nixbot-gitlab> gitlab # [ 154.119839] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.255Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"278c73f5843e1c32472d235d","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-278c73f5843e1c32472d235d: done: 0.014851 sec","job_status":"done","queue_duration_s":4.360415,"scheduling_latency_s":4.360436,"redis_calls":13,"redis_duration_s":0.0029939999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00207,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009618,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014851,"completed_at":"2026-07-01T17:52:40.255Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1588vm-test-run-nixbot-gitlab> gitlab # [ 154.183207] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.256Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d1ac5468b5a59e8051565a2","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d1ac5468b5a59e8051565a2: start","job_status":"start","queue_duration_s":4.376572,"scheduling_latency_s":4.376593}1589vm-test-run-nixbot-gitlab> gitlab # [ 154.256949] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d1ac5468b5a59e8051565a2","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d1ac5468b5a59e8051565a2: done: 0.014709 sec","job_status":"done","queue_duration_s":4.376572,"scheduling_latency_s":4.376593,"redis_calls":13,"redis_duration_s":0.002979,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014709,"completed_at":"2026-07-01T17:52:40.271Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1590vm-test-run-nixbot-gitlab> gitlab # [ 154.263248] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9ba339d43ef6ef231cb6bae","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9ba339d43ef6ef231cb6bae: start","job_status":"start","queue_duration_s":4.392571,"scheduling_latency_s":4.392592}1591vm-test-run-nixbot-gitlab> gitlab # [ 154.347372] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9ba339d43ef6ef231cb6bae","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9ba339d43ef6ef231cb6bae: done: 0.020492 sec","job_status":"done","queue_duration_s":4.392571,"scheduling_latency_s":4.392592,"redis_calls":13,"redis_duration_s":0.004588,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001211,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003377,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020492,"completed_at":"2026-07-01T17:52:40.293Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1592vm-test-run-nixbot-gitlab> gitlab # [ 154.349237] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"682c591c92a78a3523fbef18","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-682c591c92a78a3523fbef18: start","job_status":"start","queue_duration_s":4.414572,"scheduling_latency_s":4.414599}1593vm-test-run-nixbot-gitlab> gitlab # [ 154.418384] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"682c591c92a78a3523fbef18","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-682c591c92a78a3523fbef18: done: 0.015485 sec","job_status":"done","queue_duration_s":4.414572,"scheduling_latency_s":4.414599,"redis_calls":13,"redis_duration_s":0.0028859999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000894,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015485,"completed_at":"2026-07-01T17:52:40.310Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1594vm-test-run-nixbot-gitlab> gitlab # [ 154.423840] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.311Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf547919bfff7d0309ba4c7f","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf547919bfff7d0309ba4c7f: start","job_status":"start","queue_duration_s":4.431296,"scheduling_latency_s":4.431317}1595vm-test-run-nixbot-gitlab> gitlab # [ 154.443353] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.327Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf547919bfff7d0309ba4c7f","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf547919bfff7d0309ba4c7f: done: 0.016023 sec","job_status":"done","queue_duration_s":4.431296,"scheduling_latency_s":4.431317,"redis_calls":13,"redis_duration_s":0.0032,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001065,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002135,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016023,"completed_at":"2026-07-01T17:52:40.327Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1596vm-test-run-nixbot-gitlab> gitlab # [ 154.540126] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"727d343d0dcf36370cb74beb","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-727d343d0dcf36370cb74beb: start","job_status":"start","queue_duration_s":4.448734,"scheduling_latency_s":4.448755}1597vm-test-run-nixbot-gitlab> gitlab # [ 154.541457] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.344Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"727d343d0dcf36370cb74beb","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-727d343d0dcf36370cb74beb: done: 0.015187 sec","job_status":"done","queue_duration_s":4.448734,"scheduling_latency_s":4.448755,"redis_calls":13,"redis_duration_s":0.003244,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002306,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015187,"completed_at":"2026-07-01T17:52:40.344Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1598vm-test-run-nixbot-gitlab> gitlab # [ 154.626346] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1ed600059a6636daf243df3","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1ed600059a6636daf243df3: start","job_status":"start","queue_duration_s":4.4652,"scheduling_latency_s":4.465221}1599vm-test-run-nixbot-gitlab> gitlab # [ 154.627438] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1ed600059a6636daf243df3","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1ed600059a6636daf243df3: done: 0.01497 sec","job_status":"done","queue_duration_s":4.4652,"scheduling_latency_s":4.465221,"redis_calls":13,"redis_duration_s":0.002934,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000998,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009436,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01497,"completed_at":"2026-07-01T17:52:40.360Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1600vm-test-run-nixbot-gitlab> gitlab # [ 154.718472] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.361Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5ae9ce3b7f11385155bfa1b","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5ae9ce3b7f11385155bfa1b: start","job_status":"start","queue_duration_s":4.481491,"scheduling_latency_s":4.481512}1601vm-test-run-nixbot-gitlab> gitlab # [ 154.719608] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.378Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5ae9ce3b7f11385155bfa1b","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5ae9ce3b7f11385155bfa1b: done: 0.016387 sec","job_status":"done","queue_duration_s":4.481491,"scheduling_latency_s":4.481512,"redis_calls":13,"redis_duration_s":0.002992,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016387,"completed_at":"2026-07-01T17:52:40.378Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1602vm-test-run-nixbot-gitlab> gitlab # [ 154.746209] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.379Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7db633393f717ad0ea3ec3c","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7db633393f717ad0ea3ec3c: start","job_status":"start","queue_duration_s":4.499417,"scheduling_latency_s":4.499488}1603vm-test-run-nixbot-gitlab> gitlab # [ 154.820385] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7db633393f717ad0ea3ec3c","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7db633393f717ad0ea3ec3c: done: 0.021048 sec","job_status":"done","queue_duration_s":4.499417,"scheduling_latency_s":4.499488,"redis_calls":13,"redis_duration_s":0.003359,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00108,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002279,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013775,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021048,"completed_at":"2026-07-01T17:52:40.400Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1604vm-test-run-nixbot-gitlab> gitlab # [ 154.826169] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1906339a812c3cd37a582691","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1906339a812c3cd37a582691: start","job_status":"start","queue_duration_s":4.521775,"scheduling_latency_s":4.521796}1605vm-test-run-nixbot-gitlab> gitlab # [ 154.846146] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1906339a812c3cd37a582691","created_at":"2026-07-01T17:52:35.813Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-bc1bf264f0dd4c44","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"86eaf483227c1a1fd38df3df91de69c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:35.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1906339a812c3cd37a582691: done: 0.014688 sec","job_status":"done","queue_duration_s":4.521775,"scheduling_latency_s":4.521796,"redis_calls":13,"redis_duration_s":0.002933,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000966,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014688,"completed_at":"2026-07-01T17:52:40.416Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1606vm-test-run-nixbot-gitlab> gitlab # [ 154.926229] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.418Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4f2cd784dedf3c76b6421c21","created_at":"2026-07-01T17:52:35.998Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-de0634121c1c4aaf","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"10faabf100a01c5350336cb03a00271e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:36.007Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4f2cd784dedf3c76b6421c21: start","job_status":"start","queue_duration_s":4.410697,"scheduling_latency_s":4.410717}1607vm-test-run-nixbot-gitlab> gitlab # [ 154.927769] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.431Z","message":"No existing merge request to be cleaned up."}1608vm-test-run-nixbot-gitlab> gitlab # [ 154.928963] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.440Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4f2cd784dedf3c76b6421c21","created_at":"2026-07-01T17:52:35.998Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-de0634121c1c4aaf","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"10faabf100a01c5350336cb03a00271e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:36.007Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4f2cd784dedf3c76b6421c21: done: 0.022567 sec","job_status":"done","queue_duration_s":4.410697,"scheduling_latency_s":4.410717,"redis_calls":13,"redis_duration_s":0.003192,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000477,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001315,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.0014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00054979,"duration_s":0.022567,"completed_at":"2026-07-01T17:52:40.440Z","load_balancing_strategy":"primary","db_duration_s":0.002725,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1609vm-test-run-nixbot-gitlab> gitlab # [ 155.012146] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.442Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2fd9b97ff11d5919e10c3eaf","created_at":"2026-07-01T17:52:35.998Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-de0634121c1c4aaf","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"10faabf100a01c5350336cb03a00271e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:36.007Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2fd9b97ff11d5919e10c3eaf: start","job_status":"start","queue_duration_s":4.434672,"scheduling_latency_s":4.434693}1610vm-test-run-nixbot-gitlab> gitlab # [ 155.013391] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.451Z","message":"No existing merge request to be cleaned up."}1611vm-test-run-nixbot-gitlab> gitlab # [ 155.014399] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.457Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2fd9b97ff11d5919e10c3eaf","created_at":"2026-07-01T17:52:35.998Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-de0634121c1c4aaf","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"10faabf100a01c5350336cb03a00271e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:36.007Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2fd9b97ff11d5919e10c3eaf: done: 0.015137 sec","job_status":"done","queue_duration_s":4.434672,"scheduling_latency_s":4.434693,"redis_calls":10,"redis_duration_s":0.002501,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000875,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001626,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015137,"completed_at":"2026-07-01T17:52:40.457Z","load_balancing_strategy":"primary","db_duration_s":0.001294,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1612vm-test-run-nixbot-gitlab> gitlab # [ 155.094915] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.458Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2955895b60e420e9ac93c0f4","created_at":"2026-07-01T17:52:35.998Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-de0634121c1c4aaf","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"10faabf100a01c5350336cb03a00271e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:36.007Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2955895b60e420e9ac93c0f4: start","job_status":"start","queue_duration_s":4.451106,"scheduling_latency_s":4.451136}1613vm-test-run-nixbot-gitlab> gitlab # [ 155.096235] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.467Z","message":"No existing merge request to be cleaned up."}1614vm-test-run-nixbot-gitlab> gitlab # [ 155.097213] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.473Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2955895b60e420e9ac93c0f4","created_at":"2026-07-01T17:52:35.998Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-de0634121c1c4aaf","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"10faabf100a01c5350336cb03a00271e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:36.007Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2955895b60e420e9ac93c0f4: done: 0.014963 sec","job_status":"done","queue_duration_s":4.451106,"scheduling_latency_s":4.451136,"redis_calls":10,"redis_duration_s":0.002312,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001385,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014963,"completed_at":"2026-07-01T17:52:40.473Z","load_balancing_strategy":"primary","db_duration_s":0.001364,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1615vm-test-run-nixbot-gitlab> gitlab # [ 155.178790] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.474Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9471a3e226f579931828af39","created_at":"2026-07-01T17:52:35.998Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-de0634121c1c4aaf","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"10faabf100a01c5350336cb03a00271e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:36.007Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9471a3e226f579931828af39: start","job_status":"start","queue_duration_s":4.467375,"scheduling_latency_s":4.467438}1616vm-test-run-nixbot-gitlab> gitlab # [ 155.179991] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.483Z","message":"No existing merge request to be cleaned up."}1617vm-test-run-nixbot-gitlab> gitlab # [ 155.180902] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:52:40.489Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9471a3e226f579931828af39","created_at":"2026-07-01T17:52:35.998Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-de0634121c1c4aaf","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"10faabf100a01c5350336cb03a00271e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:52:36.007Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9471a3e226f579931828af39: done: 0.014891 sec","job_status":"done","queue_duration_s":4.467375,"scheduling_latency_s":4.467438,"redis_calls":10,"redis_duration_s":0.002299,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001386,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014891,"completed_at":"2026-07-01T17:52:40.489Z","load_balancing_strategy":"primary","db_duration_s":0.001379,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1618vm-test-run-nixbot-gitlab> gitlab # [ 164.418632] setup-gitlab-start[2668]: W, [2026-07-01T17:52:50.698247 #2668] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1619vm-test-run-nixbot-gitlab> gitlab # [ 176.450208] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:02.729Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"ce5055c6cdfac15a2db81127","created_at":"2026-07-01T17:53:02.668Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a77bc897279b0d317547a7e7c19fa32","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:02.726Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-ce5055c6cdfac15a2db81127: start","job_status":"start","queue_duration_s":0.003188,"scheduling_latency_s":0.003253}1620vm-test-run-nixbot-gitlab> gitlab # [ 176.617990] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:02.897Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"ce5055c6cdfac15a2db81127","created_at":"2026-07-01T17:53:02.668Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a77bc897279b0d317547a7e7c19fa32","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:02.726Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-ce5055c6cdfac15a2db81127: done: 0.168709 sec","job_status":"done","queue_duration_s":0.003188,"scheduling_latency_s":0.003253,"redis_calls":7,"redis_duration_s":0.009258,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006151,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003107,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.168709,"completed_at":"2026-07-01T17:53:02.897Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.067928,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621vm-test-run-nixbot-gitlab> gitlab # [ 176.701710] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:02.904Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"ed2c4bb2b1f2443a67cd1c15","created_at":"2026-07-01T17:53:02.798Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2357a31ed90ce77b46c6d4998154f95c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:02.812Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-ed2c4bb2b1f2443a67cd1c15: start","job_status":"start","queue_duration_s":0.092651,"scheduling_latency_s":0.092699}1622vm-test-run-nixbot-gitlab> gitlab # [ 176.722713] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:02.942Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"ed2c4bb2b1f2443a67cd1c15","created_at":"2026-07-01T17:53:02.798Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2357a31ed90ce77b46c6d4998154f95c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:02.812Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-ed2c4bb2b1f2443a67cd1c15: done: 0.03777 sec","job_status":"done","queue_duration_s":0.092651,"scheduling_latency_s":0.092699,"redis_calls":9,"redis_duration_s":0.007051,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005368,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001683,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010292,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001156293,"exclusive_lock_hold_duration_s":0.004662045,"duration_s":0.03777,"completed_at":"2026-07-01T17:53:02.942Z","load_balancing_strategy":"primary","db_duration_s":0.00294,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623vm-test-run-nixbot-gitlab> gitlab # [ 176.784264] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:02.944Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"46bc4f91e21bb54861732cf1","created_at":"2026-07-01T17:53:02.846Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4c0073ce7b34afc4888f999c1c6f9a27","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:02.850Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-46bc4f91e21bb54861732cf1: start","job_status":"start","queue_duration_s":0.094125,"scheduling_latency_s":0.094147}1624vm-test-run-nixbot-gitlab> gitlab # [ 177.245778] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.526Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"46bc4f91e21bb54861732cf1","created_at":"2026-07-01T17:53:02.846Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4c0073ce7b34afc4888f999c1c6f9a27","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:02.850Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-46bc4f91e21bb54861732cf1: done: 0.581596 sec","job_status":"done","queue_duration_s":0.094125,"scheduling_latency_s":0.094147,"redis_calls":571,"redis_duration_s":0.287949,"redis_read_bytes":569,"redis_write_bytes":49487,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004106,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.283843,"redis_shared_state_read_bytes":565,"redis_shared_state_write_bytes":49017,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.320306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.581596,"completed_at":"2026-07-01T17:53:03.525Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1625vm-test-run-nixbot-gitlab> gitlab # [ 177.348460] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.527Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"a7209e594b1870194ea92076","created_at":"2026-07-01T17:53:02.860Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed64a2f4255fc38e5340afe8c33049b4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:02.863Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-a7209e594b1870194ea92076: start","job_status":"start","queue_duration_s":0.66448,"scheduling_latency_s":0.664508}1626vm-test-run-nixbot-gitlab> gitlab # [ 177.370965] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.546Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"a7209e594b1870194ea92076","created_at":"2026-07-01T17:53:02.860Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed64a2f4255fc38e5340afe8c33049b4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:02.863Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-a7209e594b1870194ea92076: done: 0.018679 sec","job_status":"done","queue_duration_s":0.66448,"scheduling_latency_s":0.664508,"redis_calls":8,"redis_duration_s":0.0030889999999999997,"redis_read_bytes":133,"redis_write_bytes":901,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000448,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001878,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000763,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010473,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018679,"completed_at":"2026-07-01T17:53:03.546Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1627vm-test-run-nixbot-gitlab> gitlab # [ 177.406968] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.549Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"15bf735d741560da721634e1","created_at":"2026-07-01T17:53:02.877Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"219e2dd5cfba0caf1530b020b9b76001","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:02.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-15bf735d741560da721634e1: start","job_status":"start","queue_duration_s":0.669068,"scheduling_latency_s":0.669115}1628vm-test-run-nixbot-gitlab> gitlab # [ 177.589603] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.868Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"15bf735d741560da721634e1","created_at":"2026-07-01T17:53:02.877Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"219e2dd5cfba0caf1530b020b9b76001","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:02.880Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-15bf735d741560da721634e1: done: 0.319317 sec","job_status":"done","queue_duration_s":0.669068,"scheduling_latency_s":0.669115,"redis_calls":9,"redis_duration_s":0.003265,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001564,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001701,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":123,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":123,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.128,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":123,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":80,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.128,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.172354,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00051012,"exclusive_lock_hold_duration_s":0.301635544,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.319317,"completed_at":"2026-07-01T17:53:03.868Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.153931,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1629vm-test-run-nixbot-gitlab> gitlab # [ 177.594547] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.870Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"12aef300f0043cbd97e6d782","created_at":"2026-07-01T17:53:02.889Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"07eb330ed954bac1b7a168e07a7d5d83","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-01T17:53:02.893Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-12aef300f0043cbd97e6d782: start","job_status":"start","queue_duration_s":0.976647,"scheduling_latency_s":0.976669}1630vm-test-run-nixbot-gitlab> gitlab # [ 177.699234] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.878Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1631vm-test-run-nixbot-gitlab> gitlab # [ 177.700667] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.882Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"12aef300f0043cbd97e6d782","created_at":"2026-07-01T17:53:02.889Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"07eb330ed954bac1b7a168e07a7d5d83","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-01T17:53:02.893Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-12aef300f0043cbd97e6d782: done: 0.012088 sec","job_status":"done","queue_duration_s":0.976647,"scheduling_latency_s":0.976669,"redis_calls":7,"redis_duration_s":0.001739,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001155,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000584,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007226,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012088,"completed_at":"2026-07-01T17:53:03.882Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1632vm-test-run-nixbot-gitlab> gitlab # [ 177.705262] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.884Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"7c214e9208062e5844005d54","created_at":"2026-07-01T17:53:02.905Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"498b2fe7fbebf2fcafdae2038d917081","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-01T17:53:02.910Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-7c214e9208062e5844005d54: start","job_status":"start","queue_duration_s":0.97368,"scheduling_latency_s":0.973701}1633vm-test-run-nixbot-gitlab> gitlab # [ 177.789163] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.891Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1634vm-test-run-nixbot-gitlab> gitlab # [ 177.790484] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.895Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"7c214e9208062e5844005d54","created_at":"2026-07-01T17:53:02.905Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"498b2fe7fbebf2fcafdae2038d917081","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-01T17:53:02.910Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-7c214e9208062e5844005d54: done: 0.011425 sec","job_status":"done","queue_duration_s":0.97368,"scheduling_latency_s":0.973701,"redis_calls":7,"redis_duration_s":0.001629,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001198,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000431,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011425,"completed_at":"2026-07-01T17:53:03.895Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1635vm-test-run-nixbot-gitlab> gitlab # [ 177.792206] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.896Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"fdf3cf102d20f6e0316052a9","created_at":"2026-07-01T17:53:02.920Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12363725b4630873664a67dfdaea45b7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:02.923Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-fdf3cf102d20f6e0316052a9: start","job_status":"start","queue_duration_s":0.973435,"scheduling_latency_s":0.973456}1636vm-test-run-nixbot-gitlab> gitlab # [ 177.814276] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.904Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1637vm-test-run-nixbot-gitlab> gitlab # [ 177.883724] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.908Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"fdf3cf102d20f6e0316052a9","created_at":"2026-07-01T17:53:02.920Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12363725b4630873664a67dfdaea45b7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:02.923Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-fdf3cf102d20f6e0316052a9: done: 0.011381 sec","job_status":"done","queue_duration_s":0.973435,"scheduling_latency_s":0.973456,"redis_calls":7,"redis_duration_s":0.001545,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001099,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000446,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011381,"completed_at":"2026-07-01T17:53:03.908Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1638vm-test-run-nixbot-gitlab> gitlab # [ 177.886066] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.909Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"d66c9692087827e230ccfb06","created_at":"2026-07-01T17:53:02.927Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"65662d56d5d897c5e73aeed4881b6be2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:02.932Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-d66c9692087827e230ccfb06: start","job_status":"start","queue_duration_s":0.977184,"scheduling_latency_s":0.977204}1639vm-test-run-nixbot-gitlab> gitlab # [ 177.956364] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.916Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1640vm-test-run-nixbot-gitlab> gitlab # [ 177.959583] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.920Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"d66c9692087827e230ccfb06","created_at":"2026-07-01T17:53:02.927Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"65662d56d5d897c5e73aeed4881b6be2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:02.932Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-d66c9692087827e230ccfb06: done: 0.011236 sec","job_status":"done","queue_duration_s":0.977184,"scheduling_latency_s":0.977204,"redis_calls":7,"redis_duration_s":0.00152,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001109,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000411,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011236,"completed_at":"2026-07-01T17:53:03.920Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1641vm-test-run-nixbot-gitlab> gitlab # [ 177.977889] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.921Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"7554474b360b3ff6007e8501","created_at":"2026-07-01T17:53:02.939Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"66d55cc828eed91f49a36fce2d5a6751","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:02.941Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-7554474b360b3ff6007e8501: start","job_status":"start","queue_duration_s":0.980719,"scheduling_latency_s":0.98074}1642vm-test-run-nixbot-gitlab> gitlab # [ 178.000906] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.928Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1643vm-test-run-nixbot-gitlab> gitlab # [ 178.006086] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.933Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"7554474b360b3ff6007e8501","created_at":"2026-07-01T17:53:02.939Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"66d55cc828eed91f49a36fce2d5a6751","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:02.941Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-7554474b360b3ff6007e8501: done: 0.011194 sec","job_status":"done","queue_duration_s":0.980719,"scheduling_latency_s":0.98074,"redis_calls":7,"redis_duration_s":0.001534,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001072,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000462,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007062,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011194,"completed_at":"2026-07-01T17:53:03.933Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1644vm-test-run-nixbot-gitlab> gitlab # [ 178.117288] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.934Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"77ef8e95a0f5097ee5fc5208","created_at":"2026-07-01T17:53:02.958Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cf1a64bef7fbabfe1e862ec4bdd6bc18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:02.971Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-77ef8e95a0f5097ee5fc5208: start","job_status":"start","queue_duration_s":0.963277,"scheduling_latency_s":0.963297}1645vm-test-run-nixbot-gitlab> gitlab # [ 178.118864] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.963Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"77ef8e95a0f5097ee5fc5208","created_at":"2026-07-01T17:53:02.958Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cf1a64bef7fbabfe1e862ec4bdd6bc18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:02.971Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-77ef8e95a0f5097ee5fc5208: done: 0.029093 sec","job_status":"done","queue_duration_s":0.963277,"scheduling_latency_s":0.963297,"redis_calls":20,"redis_duration_s":0.00452,"redis_read_bytes":20,"redis_write_bytes":3248,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001671,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1346,"redis_queues_calls":2,"redis_queues_duration_s":0.000493,"redis_queues_read_bytes":3,"redis_queues_write_bytes":818,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001651,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":734,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000705,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":350,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036988,"duration_s":0.029093,"completed_at":"2026-07-01T17:53:03.963Z","load_balancing_strategy":"primary","db_duration_s":0.001467,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1646vm-test-run-nixbot-gitlab> gitlab # [ 178.215107] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.964Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"5bdb12bb09b2392f32bfdd9d","created_at":"2026-07-01T17:53:02.981Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e8ad5c3510cf2e0b7d89839ad7230a1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-01T17:53:02.984Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-5bdb12bb09b2392f32bfdd9d: start","job_status":"start","queue_duration_s":0.980787,"scheduling_latency_s":0.98081}1647vm-test-run-nixbot-gitlab> gitlab # [ 178.217177] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.982Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"5bdb12bb09b2392f32bfdd9d","created_at":"2026-07-01T17:53:02.981Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e8ad5c3510cf2e0b7d89839ad7230a1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-01T17:53:02.984Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-5bdb12bb09b2392f32bfdd9d: done: 0.017796 sec","job_status":"done","queue_duration_s":0.980787,"scheduling_latency_s":0.98081,"redis_calls":7,"redis_duration_s":0.001731,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001197,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000534,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017796,"completed_at":"2026-07-01T17:53:03.982Z","load_balancing_strategy":"primary","db_duration_s":0.000812,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1648vm-test-run-nixbot-gitlab> gitlab # [ 178.242909] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.984Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"e084a817d4e5ba35205aa782","created_at":"2026-07-01T17:53:02.993Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"624fd74a550892da9fe1b7bc5d160454","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:02.996Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-e084a817d4e5ba35205aa782: start","job_status":"start","queue_duration_s":0.987481,"scheduling_latency_s":0.987502}1649vm-test-run-nixbot-gitlab> gitlab # [ 178.265420] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.997Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"e084a817d4e5ba35205aa782","created_at":"2026-07-01T17:53:02.993Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"624fd74a550892da9fe1b7bc5d160454","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:02.996Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-e084a817d4e5ba35205aa782: done: 0.012955 sec","job_status":"done","queue_duration_s":0.987481,"scheduling_latency_s":0.987502,"redis_calls":7,"redis_duration_s":0.0016909999999999998,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001143,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000548,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.012955,"completed_at":"2026-07-01T17:53:03.997Z","load_balancing_strategy":"primary","db_duration_s":0.001088,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1650vm-test-run-nixbot-gitlab> gitlab # [ 178.372547] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:03.998Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"6609a072104407e11abf981e","created_at":"2026-07-01T17:53:03.008Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62a69949faf78c253a8f7e4721ec5f14","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:03.012Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-6609a072104407e11abf981e: start","job_status":"start","queue_duration_s":0.985956,"scheduling_latency_s":0.985977}1651vm-test-run-nixbot-gitlab> gitlab # [ 178.374113] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.011Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"6609a072104407e11abf981e","created_at":"2026-07-01T17:53:03.008Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62a69949faf78c253a8f7e4721ec5f14","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:03.012Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-6609a072104407e11abf981e: done: 0.013204 sec","job_status":"done","queue_duration_s":0.985956,"scheduling_latency_s":0.985977,"redis_calls":9,"redis_duration_s":0.002277,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001194,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001083,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000450337,"exclusive_lock_hold_duration_s":0.001352406,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.013204,"completed_at":"2026-07-01T17:53:04.011Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000452,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1652vm-test-run-nixbot-gitlab> gitlab # [ 178.479458] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.013Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"a338deede2e9de91e38d820f","created_at":"2026-07-01T17:53:03.021Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:03.024Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-a338deede2e9de91e38d820f: start","job_status":"start","queue_duration_s":0.988846,"scheduling_latency_s":0.988884}1653vm-test-run-nixbot-gitlab> gitlab # [ 178.480048] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.092Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"a338deede2e9de91e38d820f","created_at":"2026-07-01T17:53:03.021Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:03.024Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-a338deede2e9de91e38d820f: done: 0.078771 sec","job_status":"done","queue_duration_s":0.988846,"scheduling_latency_s":0.988884,"redis_calls":60,"redis_duration_s":0.014026,"redis_read_bytes":108,"redis_write_bytes":41009,"redis_queues_calls":2,"redis_queues_duration_s":0.000664,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37385,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.01256,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000802,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.078771,"completed_at":"2026-07-01T17:53:04.092Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1654vm-test-run-nixbot-gitlab> gitlab # [ 178.555224] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.093Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"11ef5a4737c45f73c269817f","created_at":"2026-07-01T17:53:03.036Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff41e447bc0cc656314321e6edd1230f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:03.039Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-11ef5a4737c45f73c269817f: start","job_status":"start","queue_duration_s":1.054216,"scheduling_latency_s":1.054254}1655vm-test-run-nixbot-gitlab> gitlab # [ 178.557256] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.118Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"11ef5a4737c45f73c269817f","created_at":"2026-07-01T17:53:03.036Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff41e447bc0cc656314321e6edd1230f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:03.039Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-11ef5a4737c45f73c269817f: done: 0.024976 sec","job_status":"done","queue_duration_s":1.054216,"scheduling_latency_s":1.054254,"redis_calls":9,"redis_duration_s":0.002222,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001162,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00106,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000490565,"exclusive_lock_hold_duration_s":0.007541461,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.024976,"completed_at":"2026-07-01T17:53:04.118Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007104,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1656vm-test-run-nixbot-gitlab> gitlab # [ 178.597443] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.119Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a9e1232bb906a235d69b405d","created_at":"2026-07-01T17:53:03.050Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4898d968373f40c20a151c5b42ec41ea","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:03.053Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a9e1232bb906a235d69b405d: start","job_status":"start","queue_duration_s":1.066315,"scheduling_latency_s":1.066378}1657vm-test-run-nixbot-gitlab> gitlab # [ 178.619228] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.131Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a9e1232bb906a235d69b405d","created_at":"2026-07-01T17:53:03.050Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4898d968373f40c20a151c5b42ec41ea","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:03.053Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a9e1232bb906a235d69b405d: done: 0.01214 sec","job_status":"done","queue_duration_s":1.066315,"scheduling_latency_s":1.066378,"redis_calls":7,"redis_duration_s":0.0015769999999999998,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001094,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000483,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01214,"completed_at":"2026-07-01T17:53:04.131Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000399,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1658vm-test-run-nixbot-gitlab> gitlab # [ 178.690787] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.133Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"8ed0426569021c1b1bcb82dd","created_at":"2026-07-01T17:53:03.088Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c635b1c0ee5d85cc493723ec7731dcdc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:03.091Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-8ed0426569021c1b1bcb82dd: start","job_status":"start","queue_duration_s":1.041884,"scheduling_latency_s":1.041905}1659vm-test-run-nixbot-gitlab> gitlab # [ 178.706604] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.156Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"8ed0426569021c1b1bcb82dd","created_at":"2026-07-01T17:53:03.088Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c635b1c0ee5d85cc493723ec7731dcdc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:03.091Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-8ed0426569021c1b1bcb82dd: done: 0.023301 sec","job_status":"done","queue_duration_s":1.041884,"scheduling_latency_s":1.041905,"redis_calls":9,"redis_duration_s":0.00215,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001145,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013848,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000477994,"exclusive_lock_hold_duration_s":0.01102263,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.023301,"completed_at":"2026-07-01T17:53:04.156Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005662,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1660vm-test-run-nixbot-gitlab> gitlab # [ 178.800610] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.158Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"33672224e1099e71cd47b1f7","created_at":"2026-07-01T17:53:03.097Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67aff5a98f48f85be5cdc59ea52fae25","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:03.099Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-33672224e1099e71cd47b1f7: start","job_status":"start","queue_duration_s":1.058652,"scheduling_latency_s":1.058672}1661vm-test-run-nixbot-gitlab> gitlab # [ 178.802533] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.177Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"33672224e1099e71cd47b1f7","created_at":"2026-07-01T17:53:03.097Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67aff5a98f48f85be5cdc59ea52fae25","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:03.099Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-33672224e1099e71cd47b1f7: done: 0.019295 sec","job_status":"done","queue_duration_s":1.058652,"scheduling_latency_s":1.058672,"redis_calls":14,"redis_duration_s":0.003108,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000265,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002135,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000708,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019295,"completed_at":"2026-07-01T17:53:04.177Z","load_balancing_strategy":"primary","db_duration_s":0.000545,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1662vm-test-run-nixbot-gitlab> gitlab # [ 178.922720] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.178Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"7195d352555a65e8fa86f550","created_at":"2026-07-01T17:53:03.107Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eba581abd268b5ac10425b405f61820e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:03.109Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-7195d352555a65e8fa86f550: start","job_status":"start","queue_duration_s":1.06895,"scheduling_latency_s":1.068972}1663vm-test-run-nixbot-gitlab> gitlab # [ 178.924624] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.190Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"7195d352555a65e8fa86f550","created_at":"2026-07-01T17:53:03.107Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eba581abd268b5ac10425b405f61820e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:03.109Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-7195d352555a65e8fa86f550: done: 0.012112 sec","job_status":"done","queue_duration_s":1.06895,"scheduling_latency_s":1.068972,"redis_calls":7,"redis_duration_s":0.001849,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001394,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000455,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012112,"completed_at":"2026-07-01T17:53:04.190Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1664vm-test-run-nixbot-gitlab> gitlab # [ 178.952299] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.191Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"12b6ea87986a2ac975c270d8","created_at":"2026-07-01T17:53:03.127Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc3e1291aca4ecd1dc6ae901bb5cb508","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:03.130Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-12b6ea87986a2ac975c270d8: start","job_status":"start","queue_duration_s":1.06177,"scheduling_latency_s":1.061791}1665vm-test-run-nixbot-gitlab> gitlab # [ 179.030187] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.198Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1666vm-test-run-nixbot-gitlab> gitlab # [ 179.032131] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.203Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"12b6ea87986a2ac975c270d8","created_at":"2026-07-01T17:53:03.127Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc3e1291aca4ecd1dc6ae901bb5cb508","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:03.130Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-12b6ea87986a2ac975c270d8: done: 0.011216 sec","job_status":"done","queue_duration_s":1.06177,"scheduling_latency_s":1.061791,"redis_calls":7,"redis_duration_s":0.001554,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001098,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000456,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011216,"completed_at":"2026-07-01T17:53:04.203Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1667vm-test-run-nixbot-gitlab> gitlab # [ 179.045973] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.204Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"dc5a3755f0f24b993a46fcf8","created_at":"2026-07-01T17:53:03.148Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bdc338592211729b45013857f098fae","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:03.154Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-dc5a3755f0f24b993a46fcf8: start","job_status":"start","queue_duration_s":1.050313,"scheduling_latency_s":1.050333}1668vm-test-run-nixbot-gitlab> gitlab # [ 179.070669] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.222Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"dc5a3755f0f24b993a46fcf8","created_at":"2026-07-01T17:53:03.148Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bdc338592211729b45013857f098fae","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:03.154Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-dc5a3755f0f24b993a46fcf8: done: 0.017634 sec","job_status":"done","queue_duration_s":1.050313,"scheduling_latency_s":1.050333,"redis_calls":10,"redis_duration_s":0.0032979999999999997,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002038,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00126,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.003379759,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.017634,"completed_at":"2026-07-01T17:53:04.222Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002061,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1669vm-test-run-nixbot-gitlab> gitlab # [ 179.140432] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.223Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"035fbaeaf360f4c05e49624e","created_at":"2026-07-01T17:53:03.169Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a7ef6616419602a05507f1d0126466c0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:03.175Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-035fbaeaf360f4c05e49624e: start","job_status":"start","queue_duration_s":1.047907,"scheduling_latency_s":1.047927}1670vm-test-run-nixbot-gitlab> gitlab # [ 179.159612] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.280Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"035fbaeaf360f4c05e49624e","created_at":"2026-07-01T17:53:03.169Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-789e6ed987984d8d","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a7ef6616419602a05507f1d0126466c0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:03.175Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-035fbaeaf360f4c05e49624e: done: 0.056787 sec","job_status":"done","queue_duration_s":1.047907,"scheduling_latency_s":1.047927,"redis_calls":12,"redis_duration_s":0.003894,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000729,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001833,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001332,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000575492,"exclusive_lock_hold_duration_s":0.039126481,"duration_s":0.056787,"completed_at":"2026-07-01T17:53:04.280Z","load_balancing_strategy":"primary","db_duration_s":0.007654,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1671vm-test-run-nixbot-gitlab> gitlab # [ 179.226930] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"1ae8e83c3b61f83c69687631","created_at":"2026-07-01T17:53:03.949Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-9711c5b46e104dd8","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"cf1a64bef7fbabfe1e862ec4bdd6bc18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:03.955Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-1ae8e83c3b61f83c69687631: start","job_status":"start","queue_duration_s":0.326451,"scheduling_latency_s":0.326472}1672vm-test-run-nixbot-gitlab> gitlab # [ 179.247399] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"1ae8e83c3b61f83c69687631","created_at":"2026-07-01T17:53:03.949Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-9711c5b46e104dd8","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"cf1a64bef7fbabfe1e862ec4bdd6bc18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:03.955Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-1ae8e83c3b61f83c69687631: done: 0.026224 sec","job_status":"done","queue_duration_s":0.326451,"scheduling_latency_s":0.326472,"redis_calls":13,"redis_duration_s":0.003111,"redis_read_bytes":12,"redis_write_bytes":1665,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000437,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001072,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":519,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001602,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":801,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015843,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000341664,"duration_s":0.026224,"completed_at":"2026-07-01T17:53:04.308Z","load_balancing_strategy":"primary","db_duration_s":0.003264,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1673vm-test-run-nixbot-gitlab> gitlab # [ 179.341719] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:04.309Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbed8888228ac3c3b6be2c03","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbed8888228ac3c3b6be2c03: start","job_status":"start","queue_duration_s":0.22403,"scheduling_latency_s":0.224051}1674vm-test-run-nixbot-gitlab> gitlab # [ 179.427207] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:05.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbed8888228ac3c3b6be2c03","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbed8888228ac3c3b6be2c03: done: 1.396796 sec","job_status":"done","queue_duration_s":0.22403,"scheduling_latency_s":0.224051,"redis_calls":14,"redis_duration_s":1.3754270000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001467,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":10,"redis_shared_state_duration_s":1.37396,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":1.396796,"completed_at":"2026-07-01T17:53:05.706Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1675vm-test-run-nixbot-gitlab> gitlab # [ 179.490671] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:05.770Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"491a3c43a39599be4517b8f5","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-491a3c43a39599be4517b8f5: start","job_status":"start","queue_duration_s":1.685418,"scheduling_latency_s":1.685457}1676vm-test-run-nixbot-gitlab> gitlab # [ 179.511317] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:05.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"491a3c43a39599be4517b8f5","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-491a3c43a39599be4517b8f5: done: 0.020779 sec","job_status":"done","queue_duration_s":1.685418,"scheduling_latency_s":1.685457,"redis_calls":13,"redis_duration_s":0.005662,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001621,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004041,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020779,"completed_at":"2026-07-01T17:53:05.791Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1677vm-test-run-nixbot-gitlab> gitlab # [ 179.576655] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:05.856Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a6f55a4337f55d03f457920","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a6f55a4337f55d03f457920: start","job_status":"start","queue_duration_s":1.771215,"scheduling_latency_s":1.771268}1678vm-test-run-nixbot-gitlab> gitlab # [ 179.597940] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:05.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a6f55a4337f55d03f457920","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a6f55a4337f55d03f457920: done: 0.020551 sec","job_status":"done","queue_duration_s":1.771215,"scheduling_latency_s":1.771268,"redis_calls":13,"redis_duration_s":0.005292,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001704,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003588,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020551,"completed_at":"2026-07-01T17:53:05.877Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1679vm-test-run-nixbot-gitlab> gitlab # [ 179.660334] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:05.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64e1ece220c8ffff839c3420","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64e1ece220c8ffff839c3420: start","job_status":"start","queue_duration_s":1.855084,"scheduling_latency_s":1.85512}1680vm-test-run-nixbot-gitlab> gitlab # [ 179.715240] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:05.995Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64e1ece220c8ffff839c3420","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64e1ece220c8ffff839c3420: done: 0.054803 sec","job_status":"done","queue_duration_s":1.855084,"scheduling_latency_s":1.85512,"redis_calls":13,"redis_duration_s":0.005169,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001611,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003558,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.054803,"completed_at":"2026-07-01T17:53:05.995Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1681vm-test-run-nixbot-gitlab> gitlab # [ 179.752179] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:05.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc3f2621fef1e375f7c1c63a","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc3f2621fef1e375f7c1c63a: start","job_status":"start","queue_duration_s":1.91277,"scheduling_latency_s":1.912812}1682vm-test-run-nixbot-gitlab> gitlab # [ 179.753398] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc3f2621fef1e375f7c1c63a","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc3f2621fef1e375f7c1c63a: done: 0.024837 sec","job_status":"done","queue_duration_s":1.91277,"scheduling_latency_s":1.912812,"redis_calls":13,"redis_duration_s":0.005435,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001802,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003633,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014451,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024837,"completed_at":"2026-07-01T17:53:06.023Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1683vm-test-run-nixbot-gitlab> gitlab # [ 179.827606] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a43ea0f5a2c4ab13d8e4a97","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a43ea0f5a2c4ab13d8e4a97: start","job_status":"start","queue_duration_s":1.939377,"scheduling_latency_s":1.939399}1684vm-test-run-nixbot-gitlab> gitlab # [ 179.896810] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a43ea0f5a2c4ab13d8e4a97","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a43ea0f5a2c4ab13d8e4a97: done: 0.151619 sec","job_status":"done","queue_duration_s":1.939377,"scheduling_latency_s":1.939399,"redis_calls":13,"redis_duration_s":0.124756,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.122755,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023305,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.151619,"completed_at":"2026-07-01T17:53:06.176Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1685vm-test-run-nixbot-gitlab> gitlab # [ 179.963805] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca6c6555113718fb2ca2c0be","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca6c6555113718fb2ca2c0be: start","job_status":"start","queue_duration_s":2.158162,"scheduling_latency_s":2.158228}1686vm-test-run-nixbot-gitlab> gitlab # [ 180.006385] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.286Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca6c6555113718fb2ca2c0be","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca6c6555113718fb2ca2c0be: done: 0.042505 sec","job_status":"done","queue_duration_s":2.158162,"scheduling_latency_s":2.158228,"redis_calls":13,"redis_duration_s":0.007982,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002456,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005526,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.042505,"completed_at":"2026-07-01T17:53:06.286Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1687vm-test-run-nixbot-gitlab> gitlab # [ 180.072215] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27beef61861dc3dd078da912","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27beef61861dc3dd078da912: start","job_status":"start","queue_duration_s":2.266618,"scheduling_latency_s":2.266684}1688vm-test-run-nixbot-gitlab> gitlab # [ 180.116178] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27beef61861dc3dd078da912","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27beef61861dc3dd078da912: done: 0.043828 sec","job_status":"done","queue_duration_s":2.266618,"scheduling_latency_s":2.266684,"redis_calls":13,"redis_duration_s":0.008092,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005597,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.043828,"completed_at":"2026-07-01T17:53:06.395Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1689vm-test-run-nixbot-gitlab> gitlab # [ 180.182764] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.462Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08871a3f5c25ce752ea6b273","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08871a3f5c25ce752ea6b273: start","job_status":"start","queue_duration_s":2.377076,"scheduling_latency_s":2.377142}1690vm-test-run-nixbot-gitlab> gitlab # [ 180.225377] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08871a3f5c25ce752ea6b273","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08871a3f5c25ce752ea6b273: done: 0.042686 sec","job_status":"done","queue_duration_s":2.377076,"scheduling_latency_s":2.377142,"redis_calls":13,"redis_duration_s":0.008072,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002613,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005459,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.042686,"completed_at":"2026-07-01T17:53:06.505Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1691vm-test-run-nixbot-gitlab> gitlab # [ 180.287989] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.508Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91960aa3c428cbfc5e458c1e","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91960aa3c428cbfc5e458c1e: start","job_status":"start","queue_duration_s":2.423401,"scheduling_latency_s":2.423453}1692vm-test-run-nixbot-gitlab> gitlab # [ 180.308964] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.539Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91960aa3c428cbfc5e458c1e","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91960aa3c428cbfc5e458c1e: done: 0.030558 sec","job_status":"done","queue_duration_s":2.423401,"scheduling_latency_s":2.423453,"redis_calls":13,"redis_duration_s":0.006762000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002062,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0047,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030558,"completed_at":"2026-07-01T17:53:06.539Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1693vm-test-run-nixbot-gitlab> gitlab # [ 180.311478] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"925036728923af0813d902d4","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-925036728923af0813d902d4: start","job_status":"start","queue_duration_s":2.455785,"scheduling_latency_s":2.455806}1694vm-test-run-nixbot-gitlab> gitlab # [ 180.322234] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"925036728923af0813d902d4","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-925036728923af0813d902d4: done: 0.020441 sec","job_status":"done","queue_duration_s":2.455785,"scheduling_latency_s":2.455806,"redis_calls":13,"redis_duration_s":0.007732,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001804,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010392,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020441,"completed_at":"2026-07-01T17:53:06.561Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1695vm-test-run-nixbot-gitlab> gitlab # [ 180.402523] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"57c00c387f25c1d5123b91d3","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-57c00c387f25c1d5123b91d3: start","job_status":"start","queue_duration_s":2.478673,"scheduling_latency_s":2.478695}1696vm-test-run-nixbot-gitlab> gitlab # [ 180.404419] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"57c00c387f25c1d5123b91d3","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-57c00c387f25c1d5123b91d3: done: 0.01782 sec","job_status":"done","queue_duration_s":2.478673,"scheduling_latency_s":2.478695,"redis_calls":13,"redis_duration_s":0.005204,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00168,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003524,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01782,"completed_at":"2026-07-01T17:53:06.581Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1697vm-test-run-nixbot-gitlab> gitlab # [ 180.504250] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3eb6b626414f86c148489bef","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3eb6b626414f86c148489bef: start","job_status":"start","queue_duration_s":2.498239,"scheduling_latency_s":2.49826}1698vm-test-run-nixbot-gitlab> gitlab # [ 180.505847] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3eb6b626414f86c148489bef","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3eb6b626414f86c148489bef: done: 0.016356 sec","job_status":"done","queue_duration_s":2.498239,"scheduling_latency_s":2.49826,"redis_calls":13,"redis_duration_s":0.003277,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016356,"completed_at":"2026-07-01T17:53:06.600Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1699vm-test-run-nixbot-gitlab> gitlab # [ 180.595090] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.601Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00d203078c5f5bf53377a68f","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00d203078c5f5bf53377a68f: start","job_status":"start","queue_duration_s":2.515953,"scheduling_latency_s":2.515974}1700vm-test-run-nixbot-gitlab> gitlab # [ 180.596278] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00d203078c5f5bf53377a68f","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00d203078c5f5bf53377a68f: done: 0.015452 sec","job_status":"done","queue_duration_s":2.515953,"scheduling_latency_s":2.515974,"redis_calls":13,"redis_duration_s":0.003219,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002167,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009744,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015452,"completed_at":"2026-07-01T17:53:06.616Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1701vm-test-run-nixbot-gitlab> gitlab # [ 180.669790] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d3f2374108ec37931dd0c4a","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d3f2374108ec37931dd0c4a: start","job_status":"start","queue_duration_s":2.532677,"scheduling_latency_s":2.532698}1702vm-test-run-nixbot-gitlab> gitlab # [ 180.671105] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d3f2374108ec37931dd0c4a","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d3f2374108ec37931dd0c4a: done: 0.017754 sec","job_status":"done","queue_duration_s":2.532677,"scheduling_latency_s":2.532698,"redis_calls":13,"redis_duration_s":0.005361,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001593,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003768,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017754,"completed_at":"2026-07-01T17:53:06.635Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1703vm-test-run-nixbot-gitlab> gitlab # [ 180.748403] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.637Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfb9093140482054471c81ae","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfb9093140482054471c81ae: start","job_status":"start","queue_duration_s":2.552217,"scheduling_latency_s":2.552237}1704vm-test-run-nixbot-gitlab> gitlab # [ 180.749789] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfb9093140482054471c81ae","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfb9093140482054471c81ae: done: 0.017741 sec","job_status":"done","queue_duration_s":2.552217,"scheduling_latency_s":2.552237,"redis_calls":13,"redis_duration_s":0.005128,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003656,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010144,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017741,"completed_at":"2026-07-01T17:53:06.655Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1705vm-test-run-nixbot-gitlab> gitlab # [ 180.830136] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a68250aee224dfb02e2be47b","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a68250aee224dfb02e2be47b: start","job_status":"start","queue_duration_s":2.571784,"scheduling_latency_s":2.571804}1706vm-test-run-nixbot-gitlab> gitlab # [ 180.831802] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.675Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a68250aee224dfb02e2be47b","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a68250aee224dfb02e2be47b: done: 0.01826 sec","job_status":"done","queue_duration_s":2.571784,"scheduling_latency_s":2.571804,"redis_calls":13,"redis_duration_s":0.005184,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001659,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003525,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009696,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01826,"completed_at":"2026-07-01T17:53:06.675Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1707vm-test-run-nixbot-gitlab> gitlab # [ 180.903219] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.677Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b69d9991840e0d0a3d2a366","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b69d9991840e0d0a3d2a366: start","job_status":"start","queue_duration_s":2.591845,"scheduling_latency_s":2.591866}1708vm-test-run-nixbot-gitlab> gitlab # [ 180.904420] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.693Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b69d9991840e0d0a3d2a366","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b69d9991840e0d0a3d2a366: done: 0.015819 sec","job_status":"done","queue_duration_s":2.591845,"scheduling_latency_s":2.591866,"redis_calls":13,"redis_duration_s":0.0030930000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00102,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002073,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015819,"completed_at":"2026-07-01T17:53:06.693Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1709vm-test-run-nixbot-gitlab> gitlab # [ 180.984849] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.694Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ef4b992cc9129a66e35a5f1","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ef4b992cc9129a66e35a5f1: start","job_status":"start","queue_duration_s":2.608932,"scheduling_latency_s":2.608952}1710vm-test-run-nixbot-gitlab> gitlab # [ 180.986260] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ef4b992cc9129a66e35a5f1","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ef4b992cc9129a66e35a5f1: done: 0.01537 sec","job_status":"done","queue_duration_s":2.608932,"scheduling_latency_s":2.608952,"redis_calls":13,"redis_duration_s":0.00297,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000966,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002004,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01537,"completed_at":"2026-07-01T17:53:06.709Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1711vm-test-run-nixbot-gitlab> gitlab # [ 181.059305] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6534eebfcf9e3ad6f7d23010","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6534eebfcf9e3ad6f7d23010: start","job_status":"start","queue_duration_s":2.62573,"scheduling_latency_s":2.625751}1712vm-test-run-nixbot-gitlab> gitlab # [ 181.061135] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.726Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6534eebfcf9e3ad6f7d23010","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6534eebfcf9e3ad6f7d23010: done: 0.015246 sec","job_status":"done","queue_duration_s":2.62573,"scheduling_latency_s":2.625751,"redis_calls":13,"redis_duration_s":0.0029769999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002067,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015246,"completed_at":"2026-07-01T17:53:06.726Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1713vm-test-run-nixbot-gitlab> gitlab # [ 181.146488] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebb9c64b5337874797f7d79f","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebb9c64b5337874797f7d79f: start","job_status":"start","queue_duration_s":2.642753,"scheduling_latency_s":2.642774}1714vm-test-run-nixbot-gitlab> gitlab # [ 181.148447] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.745Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebb9c64b5337874797f7d79f","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebb9c64b5337874797f7d79f: done: 0.017327 sec","job_status":"done","queue_duration_s":2.642753,"scheduling_latency_s":2.642774,"redis_calls":13,"redis_duration_s":0.004564,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0014,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003164,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017327,"completed_at":"2026-07-01T17:53:06.745Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1715vm-test-run-nixbot-gitlab> gitlab # [ 181.246435] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.747Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75b7ea76d363923c6882f1ad","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75b7ea76d363923c6882f1ad: start","job_status":"start","queue_duration_s":2.661708,"scheduling_latency_s":2.661729}1716vm-test-run-nixbot-gitlab> gitlab # [ 181.248459] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75b7ea76d363923c6882f1ad","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75b7ea76d363923c6882f1ad: done: 0.017813 sec","job_status":"done","queue_duration_s":2.661708,"scheduling_latency_s":2.661729,"redis_calls":13,"redis_duration_s":0.005347,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00165,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003697,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017813,"completed_at":"2026-07-01T17:53:06.764Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1717vm-test-run-nixbot-gitlab> gitlab # [ 181.291667] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"568818c4713b6d7be282bbee","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-568818c4713b6d7be282bbee: start","job_status":"start","queue_duration_s":2.681224,"scheduling_latency_s":2.681245}1718vm-test-run-nixbot-gitlab> gitlab # [ 181.366476] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"568818c4713b6d7be282bbee","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-568818c4713b6d7be282bbee: done: 0.015858 sec","job_status":"done","queue_duration_s":2.681224,"scheduling_latency_s":2.681245,"redis_calls":13,"redis_duration_s":0.003268,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002172,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015858,"completed_at":"2026-07-01T17:53:06.782Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1719vm-test-run-nixbot-gitlab> gitlab # [ 181.373989] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"193014ddf6aae4aba39d12e5","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-193014ddf6aae4aba39d12e5: start","job_status":"start","queue_duration_s":2.698412,"scheduling_latency_s":2.698433}1720vm-test-run-nixbot-gitlab> gitlab # [ 181.395546] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"193014ddf6aae4aba39d12e5","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-193014ddf6aae4aba39d12e5: done: 0.016145 sec","job_status":"done","queue_duration_s":2.698412,"scheduling_latency_s":2.698433,"redis_calls":13,"redis_duration_s":0.002965,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016145,"completed_at":"2026-07-01T17:53:06.800Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1721vm-test-run-nixbot-gitlab> gitlab # [ 181.475396] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.801Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb1845d07546b734dd43cca9","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb1845d07546b734dd43cca9: start","job_status":"start","queue_duration_s":2.715896,"scheduling_latency_s":2.715916}1722vm-test-run-nixbot-gitlab> gitlab # [ 181.477144] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb1845d07546b734dd43cca9","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb1845d07546b734dd43cca9: done: 0.015369 sec","job_status":"done","queue_duration_s":2.715896,"scheduling_latency_s":2.715916,"redis_calls":13,"redis_duration_s":0.003053,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000968,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015369,"completed_at":"2026-07-01T17:53:06.816Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1723vm-test-run-nixbot-gitlab> gitlab # [ 181.592986] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0bc36811dc89af15eb3077d","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0bc36811dc89af15eb3077d: start","job_status":"start","queue_duration_s":2.732572,"scheduling_latency_s":2.732593}1724vm-test-run-nixbot-gitlab> gitlab # [ 181.594441] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.833Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0bc36811dc89af15eb3077d","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0bc36811dc89af15eb3077d: done: 0.015388 sec","job_status":"done","queue_duration_s":2.732572,"scheduling_latency_s":2.732593,"redis_calls":13,"redis_duration_s":0.003012,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015388,"completed_at":"2026-07-01T17:53:06.833Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1725vm-test-run-nixbot-gitlab> gitlab # [ 181.673601] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0315e415500c7e5073d6c8cd","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0315e415500c7e5073d6c8cd: start","job_status":"start","queue_duration_s":2.749686,"scheduling_latency_s":2.749707}1726vm-test-run-nixbot-gitlab> gitlab # [ 181.675212] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0315e415500c7e5073d6c8cd","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0315e415500c7e5073d6c8cd: done: 0.015051 sec","job_status":"done","queue_duration_s":2.749686,"scheduling_latency_s":2.749707,"redis_calls":13,"redis_duration_s":0.002928,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001994,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015051,"completed_at":"2026-07-01T17:53:06.850Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1727vm-test-run-nixbot-gitlab> gitlab # [ 181.743984] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db7da886270bf0cd0fd714db","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db7da886270bf0cd0fd714db: start","job_status":"start","queue_duration_s":2.765997,"scheduling_latency_s":2.766027}1728vm-test-run-nixbot-gitlab> gitlab # [ 181.745354] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db7da886270bf0cd0fd714db","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db7da886270bf0cd0fd714db: done: 0.015207 sec","job_status":"done","queue_duration_s":2.765997,"scheduling_latency_s":2.766027,"redis_calls":13,"redis_duration_s":0.003039,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000882,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002157,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015207,"completed_at":"2026-07-01T17:53:06.866Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1729vm-test-run-nixbot-gitlab> gitlab # [ 181.840331] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.868Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dce9b2a4ce0b71e4d04ffcaf","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dce9b2a4ce0b71e4d04ffcaf: start","job_status":"start","queue_duration_s":2.782481,"scheduling_latency_s":2.782502}1730vm-test-run-nixbot-gitlab> gitlab # [ 181.841444] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.883Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dce9b2a4ce0b71e4d04ffcaf","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dce9b2a4ce0b71e4d04ffcaf: done: 0.01551 sec","job_status":"done","queue_duration_s":2.782481,"scheduling_latency_s":2.782502,"redis_calls":13,"redis_duration_s":0.0028829999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010183,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01551,"completed_at":"2026-07-01T17:53:06.883Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1731vm-test-run-nixbot-gitlab> gitlab # [ 181.913249] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.884Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c790ccaf2e02c3946e1b061","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c790ccaf2e02c3946e1b061: start","job_status":"start","queue_duration_s":2.79922,"scheduling_latency_s":2.799241}1732vm-test-run-nixbot-gitlab> gitlab # [ 181.914959] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.900Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c790ccaf2e02c3946e1b061","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c790ccaf2e02c3946e1b061: done: 0.015425 sec","job_status":"done","queue_duration_s":2.79922,"scheduling_latency_s":2.799241,"redis_calls":13,"redis_duration_s":0.002732,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000877,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001855,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015425,"completed_at":"2026-07-01T17:53:06.900Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1733vm-test-run-nixbot-gitlab> gitlab # [ 181.989135] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.901Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91aa4912ca952aced6a62dea","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91aa4912ca952aced6a62dea: start","job_status":"start","queue_duration_s":2.815871,"scheduling_latency_s":2.815892}1734vm-test-run-nixbot-gitlab> gitlab # [ 181.990472] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91aa4912ca952aced6a62dea","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91aa4912ca952aced6a62dea: done: 0.014898 sec","job_status":"done","queue_duration_s":2.815871,"scheduling_latency_s":2.815892,"redis_calls":13,"redis_duration_s":0.002698,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001844,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014898,"completed_at":"2026-07-01T17:53:06.916Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1735vm-test-run-nixbot-gitlab> gitlab # [ 182.063610] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a46353a8983c99a7409aa0eb","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a46353a8983c99a7409aa0eb: start","job_status":"start","queue_duration_s":2.831979,"scheduling_latency_s":2.831999}1736vm-test-run-nixbot-gitlab> gitlab # [ 182.064969] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.932Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a46353a8983c99a7409aa0eb","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a46353a8983c99a7409aa0eb: done: 0.014962 sec","job_status":"done","queue_duration_s":2.831979,"scheduling_latency_s":2.831999,"redis_calls":13,"redis_duration_s":0.002796,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000868,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014962,"completed_at":"2026-07-01T17:53:06.932Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1737vm-test-run-nixbot-gitlab> gitlab # [ 182.140802] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.934Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ffe61901c1854bab913d722","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ffe61901c1854bab913d722: start","job_status":"start","queue_duration_s":2.848485,"scheduling_latency_s":2.848506}1738vm-test-run-nixbot-gitlab> gitlab # [ 182.142214] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.948Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ffe61901c1854bab913d722","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ffe61901c1854bab913d722: done: 0.01479 sec","job_status":"done","queue_duration_s":2.848485,"scheduling_latency_s":2.848506,"redis_calls":13,"redis_duration_s":0.00278,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01479,"completed_at":"2026-07-01T17:53:06.948Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1739vm-test-run-nixbot-gitlab> gitlab # [ 182.221050] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.950Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"665ccdc18b5b11dbfb94b506","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-665ccdc18b5b11dbfb94b506: start","job_status":"start","queue_duration_s":2.864613,"scheduling_latency_s":2.864634}1740vm-test-run-nixbot-gitlab> gitlab # [ 182.222446] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"665ccdc18b5b11dbfb94b506","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-665ccdc18b5b11dbfb94b506: done: 0.015136 sec","job_status":"done","queue_duration_s":2.864613,"scheduling_latency_s":2.864634,"redis_calls":13,"redis_duration_s":0.0030139999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00209,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015136,"completed_at":"2026-07-01T17:53:06.965Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1741vm-test-run-nixbot-gitlab> gitlab # [ 182.300213] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.966Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abfeb03542cd65c8cb9e1928","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abfeb03542cd65c8cb9e1928: start","job_status":"start","queue_duration_s":2.880965,"scheduling_latency_s":2.880986}1742vm-test-run-nixbot-gitlab> gitlab # [ 182.301898] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.981Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abfeb03542cd65c8cb9e1928","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abfeb03542cd65c8cb9e1928: done: 0.014745 sec","job_status":"done","queue_duration_s":2.880965,"scheduling_latency_s":2.880986,"redis_calls":13,"redis_duration_s":0.002742,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000819,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009848,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014745,"completed_at":"2026-07-01T17:53:06.981Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1743vm-test-run-nixbot-gitlab> gitlab # [ 182.377191] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72b345720d53760a9ddba229","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72b345720d53760a9ddba229: start","job_status":"start","queue_duration_s":2.896925,"scheduling_latency_s":2.896946}1744vm-test-run-nixbot-gitlab> gitlab # [ 182.378727] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72b345720d53760a9ddba229","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72b345720d53760a9ddba229: done: 0.015814 sec","job_status":"done","queue_duration_s":2.896925,"scheduling_latency_s":2.896946,"redis_calls":13,"redis_duration_s":0.002754,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000821,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015814,"completed_at":"2026-07-01T17:53:06.998Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1745vm-test-run-nixbot-gitlab> gitlab # [ 182.451410] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:06.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8b101ed48242e1c14471b24","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8b101ed48242e1c14471b24: start","job_status":"start","queue_duration_s":2.913961,"scheduling_latency_s":2.913982}1746vm-test-run-nixbot-gitlab> gitlab # [ 182.453121] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8b101ed48242e1c14471b24","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8b101ed48242e1c14471b24: done: 0.014684 sec","job_status":"done","queue_duration_s":2.913961,"scheduling_latency_s":2.913982,"redis_calls":13,"redis_duration_s":0.0028079999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000876,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014684,"completed_at":"2026-07-01T17:53:07.014Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1747vm-test-run-nixbot-gitlab> gitlab # [ 182.551197] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1f2598b50dcb8a959ccf995","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1f2598b50dcb8a959ccf995: start","job_status":"start","queue_duration_s":2.929882,"scheduling_latency_s":2.929903}1748vm-test-run-nixbot-gitlab> gitlab # [ 182.552882] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1f2598b50dcb8a959ccf995","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1f2598b50dcb8a959ccf995: done: 0.014858 sec","job_status":"done","queue_duration_s":2.929882,"scheduling_latency_s":2.929903,"redis_calls":13,"redis_duration_s":0.0028959999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014858,"completed_at":"2026-07-01T17:53:07.030Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1749vm-test-run-nixbot-gitlab> gitlab # [ 182.623126] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd9281835ea0a523e69e7907","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd9281835ea0a523e69e7907: start","job_status":"start","queue_duration_s":2.946053,"scheduling_latency_s":2.946073}1750vm-test-run-nixbot-gitlab> gitlab # [ 182.624263] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd9281835ea0a523e69e7907","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd9281835ea0a523e69e7907: done: 0.015001 sec","job_status":"done","queue_duration_s":2.946053,"scheduling_latency_s":2.946073,"redis_calls":13,"redis_duration_s":0.003075,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002172,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015001,"completed_at":"2026-07-01T17:53:07.046Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1751vm-test-run-nixbot-gitlab> gitlab # [ 182.738522] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcab69b46b55febe73b47679","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcab69b46b55febe73b47679: start","job_status":"start","queue_duration_s":2.962331,"scheduling_latency_s":2.962352}1752vm-test-run-nixbot-gitlab> gitlab # [ 182.739781] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcab69b46b55febe73b47679","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcab69b46b55febe73b47679: done: 0.014846 sec","job_status":"done","queue_duration_s":2.962331,"scheduling_latency_s":2.962352,"redis_calls":13,"redis_duration_s":0.002816,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000873,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014846,"completed_at":"2026-07-01T17:53:07.062Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1753vm-test-run-nixbot-gitlab> gitlab # [ 182.760095] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4edf3273a63efa4dc7857b3d","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4edf3273a63efa4dc7857b3d: start","job_status":"start","queue_duration_s":2.978412,"scheduling_latency_s":2.978434}1754vm-test-run-nixbot-gitlab> gitlab # [ 182.829263] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4edf3273a63efa4dc7857b3d","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4edf3273a63efa4dc7857b3d: done: 0.014875 sec","job_status":"done","queue_duration_s":2.978412,"scheduling_latency_s":2.978434,"redis_calls":13,"redis_duration_s":0.002792,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000871,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014875,"completed_at":"2026-07-01T17:53:07.078Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1755vm-test-run-nixbot-gitlab> gitlab # [ 182.840731] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6ba97c7f8bb974a1a602334","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6ba97c7f8bb974a1a602334: start","job_status":"start","queue_duration_s":2.99456,"scheduling_latency_s":2.994581}1756vm-test-run-nixbot-gitlab> gitlab # [ 182.860843] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.094Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6ba97c7f8bb974a1a602334","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6ba97c7f8bb974a1a602334: done: 0.01464 sec","job_status":"done","queue_duration_s":2.99456,"scheduling_latency_s":2.994581,"redis_calls":13,"redis_duration_s":0.002728,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000881,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001847,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01464,"completed_at":"2026-07-01T17:53:07.094Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1757vm-test-run-nixbot-gitlab> gitlab # [ 182.940987] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.096Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa017671621fbe800e2de262","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa017671621fbe800e2de262: start","job_status":"start","queue_duration_s":3.010459,"scheduling_latency_s":3.010479}1758vm-test-run-nixbot-gitlab> gitlab # [ 182.942340] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa017671621fbe800e2de262","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa017671621fbe800e2de262: done: 0.01465 sec","job_status":"done","queue_duration_s":3.010459,"scheduling_latency_s":3.010479,"redis_calls":13,"redis_duration_s":0.0028380000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01465,"completed_at":"2026-07-01T17:53:07.110Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1759vm-test-run-nixbot-gitlab> gitlab # [ 183.025958] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8bf533ebbebd538b35d3ec16","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8bf533ebbebd538b35d3ec16: start","job_status":"start","queue_duration_s":3.026452,"scheduling_latency_s":3.026473}1760vm-test-run-nixbot-gitlab> gitlab # [ 183.027148] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8bf533ebbebd538b35d3ec16","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8bf533ebbebd538b35d3ec16: done: 0.014761 sec","job_status":"done","queue_duration_s":3.026452,"scheduling_latency_s":3.026473,"redis_calls":13,"redis_duration_s":0.002747,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000881,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001866,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014761,"completed_at":"2026-07-01T17:53:07.126Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1761vm-test-run-nixbot-gitlab> gitlab # [ 183.150305] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d89a50084e1ac93170a5d19","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d89a50084e1ac93170a5d19: start","job_status":"start","queue_duration_s":3.042507,"scheduling_latency_s":3.042527}1762vm-test-run-nixbot-gitlab> gitlab # [ 183.151994] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d89a50084e1ac93170a5d19","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d89a50084e1ac93170a5d19: done: 0.015062 sec","job_status":"done","queue_duration_s":3.042507,"scheduling_latency_s":3.042527,"redis_calls":13,"redis_duration_s":0.002892,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000882,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00201,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015062,"completed_at":"2026-07-01T17:53:07.143Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1763vm-test-run-nixbot-gitlab> gitlab # [ 183.167085] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcbdb3800302e9706e5c56f8","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcbdb3800302e9706e5c56f8: start","job_status":"start","queue_duration_s":3.058979,"scheduling_latency_s":3.059}1764vm-test-run-nixbot-gitlab> gitlab # [ 183.240467] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcbdb3800302e9706e5c56f8","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcbdb3800302e9706e5c56f8: done: 0.014645 sec","job_status":"done","queue_duration_s":3.058979,"scheduling_latency_s":3.059,"redis_calls":13,"redis_duration_s":0.002763,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014645,"completed_at":"2026-07-01T17:53:07.159Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1765vm-test-run-nixbot-gitlab> gitlab # [ 183.312235] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ea4202370c2e5b60a8a48ec","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ea4202370c2e5b60a8a48ec: start","job_status":"start","queue_duration_s":3.07483,"scheduling_latency_s":3.07485}1766vm-test-run-nixbot-gitlab> gitlab # [ 183.313845] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ea4202370c2e5b60a8a48ec","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ea4202370c2e5b60a8a48ec: done: 0.014822 sec","job_status":"done","queue_duration_s":3.07483,"scheduling_latency_s":3.07485,"redis_calls":13,"redis_duration_s":0.002955,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001002,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014822,"completed_at":"2026-07-01T17:53:07.175Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1767vm-test-run-nixbot-gitlab> gitlab # [ 183.389313] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68cacf56e06049684b8cd1fc","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68cacf56e06049684b8cd1fc: start","job_status":"start","queue_duration_s":3.090877,"scheduling_latency_s":3.090898}1768vm-test-run-nixbot-gitlab> gitlab # [ 183.390452] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68cacf56e06049684b8cd1fc","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68cacf56e06049684b8cd1fc: done: 0.015207 sec","job_status":"done","queue_duration_s":3.090877,"scheduling_latency_s":3.090898,"redis_calls":13,"redis_duration_s":0.003118,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002141,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015207,"completed_at":"2026-07-01T17:53:07.191Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1769vm-test-run-nixbot-gitlab> gitlab # [ 183.475348] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc82f0f034cd81da94654524","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc82f0f034cd81da94654524: start","job_status":"start","queue_duration_s":3.10741,"scheduling_latency_s":3.107432}1770vm-test-run-nixbot-gitlab> gitlab # [ 183.476554] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc82f0f034cd81da94654524","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc82f0f034cd81da94654524: done: 0.017411 sec","job_status":"done","queue_duration_s":3.10741,"scheduling_latency_s":3.107432,"redis_calls":13,"redis_duration_s":0.00324,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001078,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002162,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017411,"completed_at":"2026-07-01T17:53:07.210Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1771vm-test-run-nixbot-gitlab> gitlab # [ 183.491067] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d9bf050e6c108a153ed0f27","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d9bf050e6c108a153ed0f27: start","job_status":"start","queue_duration_s":3.126234,"scheduling_latency_s":3.126262}1772vm-test-run-nixbot-gitlab> gitlab # [ 183.559224] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.227Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d9bf050e6c108a153ed0f27","created_at":"2026-07-01T17:53:04.023Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-12c27126697f4d72","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"69a33112a11f66eb176f7bc3410b76aa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.085Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d9bf050e6c108a153ed0f27: done: 0.015946 sec","job_status":"done","queue_duration_s":3.126234,"scheduling_latency_s":3.126262,"redis_calls":13,"redis_duration_s":0.002936,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000973,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010295,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015946,"completed_at":"2026-07-01T17:53:07.227Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1773vm-test-run-nixbot-gitlab> gitlab # [ 183.571088] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.229Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"488ded13c272bb16b3a108c3","created_at":"2026-07-01T17:53:04.166Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-46d7a23c018b4f4b","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"67aff5a98f48f85be5cdc59ea52fae25","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.173Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-488ded13c272bb16b3a108c3: start","job_status":"start","queue_duration_s":3.055816,"scheduling_latency_s":3.055837}1774vm-test-run-nixbot-gitlab> gitlab # [ 183.638942] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.239Z","message":"No existing merge request to be cleaned up."}1775vm-test-run-nixbot-gitlab> gitlab # [ 183.640103] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.245Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"488ded13c272bb16b3a108c3","created_at":"2026-07-01T17:53:04.166Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-46d7a23c018b4f4b","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"67aff5a98f48f85be5cdc59ea52fae25","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.173Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-488ded13c272bb16b3a108c3: done: 0.016338 sec","job_status":"done","queue_duration_s":3.055816,"scheduling_latency_s":3.055837,"redis_calls":10,"redis_duration_s":0.002288,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001404,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016338,"completed_at":"2026-07-01T17:53:07.245Z","load_balancing_strategy":"primary","db_duration_s":0.001958,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1776vm-test-run-nixbot-gitlab> gitlab # [ 183.651873] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.246Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9522ebf9de983232644aa61b","created_at":"2026-07-01T17:53:04.166Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-46d7a23c018b4f4b","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"67aff5a98f48f85be5cdc59ea52fae25","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.173Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9522ebf9de983232644aa61b: start","job_status":"start","queue_duration_s":3.073536,"scheduling_latency_s":3.073558}1777vm-test-run-nixbot-gitlab> gitlab # [ 183.725889] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.256Z","message":"No existing merge request to be cleaned up."}1778vm-test-run-nixbot-gitlab> gitlab # [ 183.727298] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.261Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9522ebf9de983232644aa61b","created_at":"2026-07-01T17:53:04.166Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-46d7a23c018b4f4b","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"67aff5a98f48f85be5cdc59ea52fae25","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.173Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9522ebf9de983232644aa61b: done: 0.015047 sec","job_status":"done","queue_duration_s":3.073536,"scheduling_latency_s":3.073558,"redis_calls":10,"redis_duration_s":0.002221,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000872,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001349,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015047,"completed_at":"2026-07-01T17:53:07.261Z","load_balancing_strategy":"primary","db_duration_s":0.001561,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1779vm-test-run-nixbot-gitlab> gitlab # [ 183.732798] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.263Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b86713ba1411dec8f66e70f9","created_at":"2026-07-01T17:53:04.166Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-46d7a23c018b4f4b","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"67aff5a98f48f85be5cdc59ea52fae25","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.173Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b86713ba1411dec8f66e70f9: start","job_status":"start","queue_duration_s":3.089933,"scheduling_latency_s":3.089953}1780vm-test-run-nixbot-gitlab> gitlab # [ 183.818295] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.272Z","message":"No existing merge request to be cleaned up."}1781vm-test-run-nixbot-gitlab> gitlab # [ 183.819813] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.278Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b86713ba1411dec8f66e70f9","created_at":"2026-07-01T17:53:04.166Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-46d7a23c018b4f4b","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"67aff5a98f48f85be5cdc59ea52fae25","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.173Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b86713ba1411dec8f66e70f9: done: 0.015397 sec","job_status":"done","queue_duration_s":3.089933,"scheduling_latency_s":3.089953,"redis_calls":10,"redis_duration_s":0.002365,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001413,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015397,"completed_at":"2026-07-01T17:53:07.278Z","load_balancing_strategy":"primary","db_duration_s":0.001473,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1782vm-test-run-nixbot-gitlab> gitlab # [ 183.821746] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.279Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1077d536f93fd49f2f02ce9f","created_at":"2026-07-01T17:53:04.166Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-46d7a23c018b4f4b","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"67aff5a98f48f85be5cdc59ea52fae25","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.173Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1077d536f93fd49f2f02ce9f: start","job_status":"start","queue_duration_s":3.106559,"scheduling_latency_s":3.10658}1783vm-test-run-nixbot-gitlab> gitlab # [ 183.894334] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.288Z","message":"No existing merge request to be cleaned up."}1784vm-test-run-nixbot-gitlab> gitlab # [ 183.895451] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:07.294Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1077d536f93fd49f2f02ce9f","created_at":"2026-07-01T17:53:04.166Z","trace_propagation_headers":{"sentry-trace":"def2e8cc95a144be9575a4deae292bcd-46d7a23c018b4f4b","baggage":"sentry-trace_id=def2e8cc95a144be9575a4deae292bcd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"67aff5a98f48f85be5cdc59ea52fae25","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:04.173Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1077d536f93fd49f2f02ce9f: done: 0.01494 sec","job_status":"done","queue_duration_s":3.106559,"scheduling_latency_s":3.10658,"redis_calls":10,"redis_duration_s":0.002227,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001325,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01494,"completed_at":"2026-07-01T17:53:07.294Z","load_balancing_strategy":"primary","db_duration_s":0.001524,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1785vm-test-run-nixbot-gitlab> gitlab # [ 186.388621] runuser[2667]: pam_unix(runuser:session): session closed for user gitlab1786vm-test-run-nixbot-gitlab> gitlab # [ 186.395846] setup-gitlab-start[2875]: ++ jq -r .token1787vm-test-run-nixbot-gitlab> gitlab # [ 186.399259] setup-gitlab-start[2876]: +++ date -d '+7 days' +%F1788vm-test-run-nixbot-gitlab> gitlab # [ 186.402550] setup-gitlab-start[2874]: ++ curl -fs -X POST -H 'Authorization: Bearer 47cf3424e7aa4257d32ec7e0b849c707c7674b6da0c9fe6041338d1cdf941c66' -H 'Content-Type: application/json' -d '{"name":"nixbot","scopes":["api"],"expires_at":"2026-07-08"}' http://gitlab/api/v4/users/1/personal_access_tokens1789vm-test-run-nixbot-gitlab> gitlab # [ 186.603910] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:12.882Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"cc02163c175f89b0aadcf215","created_at":"2026-07-01T17:53:12.835Z","trace_propagation_headers":{"sentry-trace":"6fd6128b38c84342a0e0338a275d0108-641969605faf4111","baggage":"sentry-trace_id=6fd6128b38c84342a0e0338a275d0108,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0GFT6EXR53Q9J0BNQX0Y","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:8814501a9686ca731179b31cc57ea149eaf2e0b642a9aa9e7bf1bda83ddbff0e","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:12.856Z","job_size_bytes":451,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-cc02163c175f89b0aadcf215: start","job_status":"start","queue_duration_s":0.025757,"scheduling_latency_s":0.025859}1790vm-test-run-nixbot-gitlab> gitlab # [ 186.618658] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:12 +0000] "POST /api/v4/users/1/personal_access_tokens HTTP/1.1" 201 267 "" "curl/8.20.0" 1971791vm-test-run-nixbot-gitlab> gitlab # [ 186.670827] setup-gitlab-start[2625]: + TOKEN=glpat-wDw2B3zia1-gr0MHeKsm0G86MQp1OjEH.01.0w0xmtts71792vm-test-run-nixbot-gitlab> gitlab # [ 186.672808] setup-gitlab-start[2625]: + test -n glpat-wDw2B3zia1-gr0MHeKsm0G86MQp1OjEH.01.0w0xmtts71793vm-test-run-nixbot-gitlab> gitlab # [ 186.675231] setup-gitlab-start[2625]: + test glpat-wDw2B3zia1-gr0MHeKsm0G86MQp1OjEH.01.0w0xmtts7 '!=' null1794vm-test-run-nixbot-gitlab> gitlab # [ 186.677252] setup-gitlab-start[2625]: + mkdir -p /var/lib/secrets1795vm-test-run-nixbot-gitlab> gitlab # [ 186.679290] setup-gitlab-start[2625]: + echo glpat-wDw2B3zia1-gr0MHeKsm0G86MQp1OjEH.01.0w0xmtts71796vm-test-run-nixbot-gitlab> gitlab # [ 186.680300] setup-gitlab-start[2625]: + chmod 644 /var/lib/secrets/gitlab-token1797vm-test-run-nixbot-gitlab> gitlab # [ 186.682152] setup-gitlab-start[2625]: + curl -fs -X POST -H 'PRIVATE-TOKEN: glpat-wDw2B3zia1-gr0MHeKsm0G86MQp1OjEH.01.0w0xmtts7' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1798vm-test-run-nixbot-gitlab> gitlab # [ 186.813554] sidekiq-cluster[2096]: {"severity":"WARN","time":"2026-07-01T17:53:13.092Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"cc02163c175f89b0aadcf215","created_at":"2026-07-01T17:53:12.835Z","trace_propagation_headers":{"sentry-trace":"6fd6128b38c84342a0e0338a275d0108-641969605faf4111","baggage":"sentry-trace_id=6fd6128b38c84342a0e0338a275d0108,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0GFT6EXR53Q9J0BNQX0Y","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:8814501a9686ca731179b31cc57ea149eaf2e0b642a9aa9e7bf1bda83ddbff0e","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:12.856Z","job_size_bytes":451,"pid":2096,"sidekiq_tid":"lyo0","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-cc02163c175f89b0aadcf215: fail: 0.209096 sec","job_status":"fail","queue_duration_s":0.025757,"scheduling_latency_s":0.025859,"redis_calls":11,"redis_duration_s":0.006307,"redis_read_bytes":137,"redis_write_bytes":1317,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001363,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004011,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.079616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000807645,"duration_s":0.209096,"completed_at":"2026-07-01T17:53:13.091Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/profile.rb:99:in `access_token_created_email'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/abbaw4w9gll6p923md75p3h3rrmhrdqn-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/bqz31s23z0jk4464lbybyz83ikl0gmyd-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/wp2rnxa243q2gn2f8h04d48hnvfr0387-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/85h4805ad7n5qn7wq2m6icypga7rnk80-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.026306,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1799vm-test-run-nixbot-gitlab> gitlab # [ 188.142995] gitaly[1376]: time="2026-07-01T17:53:14.423Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0GRQ1T4ZY72YS9KP3J32 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-01T17:53:24.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:14.423" pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1800vm-test-run-nixbot-gitlab> gitlab # [ 188.145338] gitaly[1376]: time="2026-07-01T17:53:14.425Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0GRQ1T4ZY72YS9KP3J32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-01T17:53:24.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:14.423" grpc.time_ms=2.062 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1801vm-test-run-nixbot-gitlab> gitlab # [ 188.243985] gitaly[1376]: time="2026-07-01T17:53:14.524Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0GRQ1T4ZY72YS9KP3J32 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-01T17:53:24.104" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:14.524" pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1802vm-test-run-nixbot-gitlab> gitlab # [ 188.246147] gitaly[1376]: time="2026-07-01T17:53:14.524Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0GRQ1T4ZY72YS9KP3J32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-01T17:53:24.104" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:14.524" grpc.time_ms=0.235 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1803vm-test-run-nixbot-gitlab> gitlab # [ 188.321477] gitaly[1376]: time="2026-07-01T17:53:14.602Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0GRQ1T4ZY72YS9KP3J32 diskcache=0943f2b8-78aa-4583-9e92-a4c2aba00ede grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-01T17:53:24.150" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:14.570" pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1804vm-test-run-nixbot-gitlab> gitlab # [ 188.323246] gitaly[1376]: time="2026-07-01T17:53:14.602Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=321 command.oublock=32 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0GRQ1T4ZY72YS9KP3J32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-01T17:53:24.150" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:14.570" grpc.time_ms=31.619 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1805vm-test-run-nixbot-gitlab> gitlab # [ 188.377723] gitaly[1376]: time="2026-07-01T17:53:14.658Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0GRQ1T4ZY72YS9KP3J32 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-01T17:53:24.236" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:14.657" pid=1376 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1806vm-test-run-nixbot-gitlab> gitlab # [ 188.379720] gitaly[1376]: time="2026-07-01T17:53:14.658Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0GRQ1T4ZY72YS9KP3J32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-01T17:53:24.236" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:14.657" grpc.time_ms=0.926 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1807vm-test-run-nixbot-gitlab> gitlab # [ 188.394305] gitaly[1376]: time="2026-07-01T17:53:14.674Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0GRQ1T4ZY72YS9KP3J32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-01T17:53:24.243" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:14.664" grpc.time_ms=10.216 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1808vm-test-run-nixbot-gitlab> gitlab # [ 188.437531] gitaly[1376]: time="2026-07-01T17:53:14.717Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0GRQ1T4ZY72YS9KP3J32 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-01T17:53:24.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:14.717" pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1809vm-test-run-nixbot-gitlab> gitlab # [ 188.454778] gitaly[1376]: time="2026-07-01T17:53:14.718Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0GRQ1T4ZY72YS9KP3J32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-01T17:53:24.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:14.717" grpc.time_ms=0.375 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1810vm-test-run-nixbot-gitlab> gitlab # [ 188.473541] gitaly[1376]: time="2026-07-01T17:53:14.748Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0GRQ1T4ZY72YS9KP3J32 diskcache=d36f2159-98dd-458e-bd25-afd679109ba8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-01T17:53:24.009" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:14.720" pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1811vm-test-run-nixbot-gitlab> gitlab # [ 188.475237] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:14.718Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"a3055e92c8dc867bcf5fe75d","created_at":"2026-07-01T17:53:14.682Z","trace_propagation_headers":{"sentry-trace":"810db7185ceb48dea09b51939fab26a8-ef6c29efccf84b97","baggage":"sentry-trace_id=810db7185ceb48dea09b51939fab26a8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0GRQ1T4ZY72YS9KP3J32","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:14.690Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-a3055e92c8dc867bcf5fe75d: start","job_status":"start","queue_duration_s":0.0272,"scheduling_latency_s":0.027239}1812vm-test-run-nixbot-gitlab> gitlab # [ 188.476090] gitaly[1376]: time="2026-07-01T17:53:14.748Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=32 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0GRQ1T4ZY72YS9KP3J32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-01T17:53:24.009" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:14.720" grpc.time_ms=27.827 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1813vm-test-run-nixbot-gitlab> gitlab # [ 188.532282] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:14.812Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"a3055e92c8dc867bcf5fe75d","created_at":"2026-07-01T17:53:14.682Z","trace_propagation_headers":{"sentry-trace":"810db7185ceb48dea09b51939fab26a8-ef6c29efccf84b97","baggage":"sentry-trace_id=810db7185ceb48dea09b51939fab26a8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0GRQ1T4ZY72YS9KP3J32","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:14.690Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-a3055e92c8dc867bcf5fe75d: done: 0.094716 sec","job_status":"done","queue_duration_s":0.0272,"scheduling_latency_s":0.027239,"redis_calls":10,"redis_duration_s":0.009224,"redis_read_bytes":8,"redis_write_bytes":1165,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005053,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004171,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":7,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.030861743,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.094716,"completed_at":"2026-07-01T17:53:14.812Z","load_balancing_strategy":"primary","db_duration_s":0.013855,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1814vm-test-run-nixbot-gitlab> gitlab # [ 188.537566] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:14.817Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"9dd1f6d5cf075facc6d8b1d8","created_at":"2026-07-01T17:53:14.699Z","trace_propagation_headers":{"sentry-trace":"810db7185ceb48dea09b51939fab26a8-ef6c29efccf84b97","baggage":"sentry-trace_id=810db7185ceb48dea09b51939fab26a8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0GRQ1T4ZY72YS9KP3J32","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:14.709Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-9dd1f6d5cf075facc6d8b1d8: start","job_status":"start","queue_duration_s":0.108838,"scheduling_latency_s":0.108874}1815vm-test-run-nixbot-gitlab> gitlab # [ 188.625074] gitaly[1376]: time="2026-07-01T17:53:14.905Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0GRQ1T4ZY72YS9KP3J32 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-01T17:53:24.194" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:14.905" pid=1376 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1816vm-test-run-nixbot-gitlab> gitlab # [ 188.626501] gitaly[1376]: time="2026-07-01T17:53:14.905Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0GRQ1T4ZY72YS9KP3J32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-01T17:53:24.194" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:14.905" grpc.time_ms=0.464 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1817vm-test-run-nixbot-gitlab> gitlab # [ 188.672853] gitaly[1376]: time="2026-07-01T17:53:14.953Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0GRQ1T4ZY72YS9KP3J32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-01T17:53:24.233" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:14.943" grpc.time_ms=9.131 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1818vm-test-run-nixbot-gitlab> gitlab # [ 188.682898] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:14.962Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"9dd1f6d5cf075facc6d8b1d8","created_at":"2026-07-01T17:53:14.699Z","trace_propagation_headers":{"sentry-trace":"810db7185ceb48dea09b51939fab26a8-ef6c29efccf84b97","baggage":"sentry-trace_id=810db7185ceb48dea09b51939fab26a8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0GRQ1T4ZY72YS9KP3J32","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:14.709Z","job_size_bytes":2,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-9dd1f6d5cf075facc6d8b1d8: done: 0.14435 sec","job_status":"done","queue_duration_s":0.108838,"scheduling_latency_s":0.108874,"redis_calls":14,"redis_duration_s":0.049177000000000005,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.002603,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.04277,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003804,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.060437849,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.14435,"completed_at":"2026-07-01T17:53:14.962Z","load_balancing_strategy":"primary","db_duration_s":0.026013,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1819vm-test-run-nixbot-gitlab> gitlab # [ 188.700836] gitaly[1376]: time="2026-07-01T17:53:14.981Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0GRQ1T4ZY72YS9KP3J32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-01T17:53:24.270" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:14.981" grpc.time_ms=0.167 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1820vm-test-run-nixbot-gitlab> gitlab # [ 188.712950] gitaly[1376]: time="2026-07-01T17:53:14.990Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0GRQ1T4ZY72YS9KP3J32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-01T17:53:24.279" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:14.989" grpc.time_ms=0.441 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1821vm-test-run-nixbot-gitlab> gitlab # [ 188.856497] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:15.136Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"edfbc1b25f40630a30b71651","created_at":"2026-07-01T17:53:15.125Z","trace_propagation_headers":{"sentry-trace":"810db7185ceb48dea09b51939fab26a8-ef6c29efccf84b97","baggage":"sentry-trace_id=810db7185ceb48dea09b51939fab26a8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0GRQ1T4ZY72YS9KP3J32","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:15.132Z","job_size_bytes":5,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-edfbc1b25f40630a30b71651: start","job_status":"start","queue_duration_s":0.003917,"scheduling_latency_s":0.003988}1822vm-test-run-nixbot-gitlab> gitlab # [ 188.910927] gitaly[1376]: time="2026-07-01T17:53:15.191Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0GRQ1T4ZY72YS9KP3J32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-01T17:53:25.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:15.184" grpc.time_ms=7.06 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1823vm-test-run-nixbot-gitlab> gitlab # [ 188.964468] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:15.244Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"edfbc1b25f40630a30b71651","created_at":"2026-07-01T17:53:15.125Z","trace_propagation_headers":{"sentry-trace":"810db7185ceb48dea09b51939fab26a8-ef6c29efccf84b97","baggage":"sentry-trace_id=810db7185ceb48dea09b51939fab26a8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0GRQ1T4ZY72YS9KP3J32","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:15.132Z","job_size_bytes":5,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-edfbc1b25f40630a30b71651: done: 0.108079 sec","job_status":"done","queue_duration_s":0.003917,"scheduling_latency_s":0.003988,"redis_calls":12,"redis_duration_s":0.014912,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.004763,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.008393,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001756,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000522413,"duration_s":0.108079,"completed_at":"2026-07-01T17:53:15.244Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02153,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1824vm-test-run-nixbot-gitlab> gitlab # [ 189.045842] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:15.326Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"3db84bb4c8dca4a1dd7e41be","created_at":"2026-07-01T17:53:15.156Z","trace_propagation_headers":{"sentry-trace":"810db7185ceb48dea09b51939fab26a8-ef6c29efccf84b97","baggage":"sentry-trace_id=810db7185ceb48dea09b51939fab26a8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0GRQ1T4ZY72YS9KP3J32","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:15.162Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-3db84bb4c8dca4a1dd7e41be: start","job_status":"start","queue_duration_s":0.163792,"scheduling_latency_s":0.16384}1825vm-test-run-nixbot-gitlab> gitlab # [ 189.276073] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:15 +0000] "POST /api/v4/projects HTTP/1.1" 201 4795 "" "curl/8.20.0" 25721826vm-test-run-nixbot-gitlab> gitlab # [ 189.277397] setup-gitlab-start[2625]: + mkdir -p /tmp/test-flake1827vm-test-run-nixbot-gitlab> gitlab # [ 189.280261] setup-gitlab-start[2625]: + cd /tmp/test-flake1828vm-test-run-nixbot-gitlab> gitlab # [ 189.283134] setup-gitlab-start[2625]: + git init -b master1829vm-test-run-nixbot-gitlab> gitlab # [ 189.296555] setup-gitlab-start[2919]: Initialized empty Git repository in /tmp/test-flake/.git/1830vm-test-run-nixbot-gitlab> gitlab # [ 189.300056] setup-gitlab-start[2625]: + git config user.name test1831vm-test-run-nixbot-gitlab> gitlab # [ 189.302075] setup-gitlab-start[2625]: + git config user.email test@example.com1832vm-test-run-nixbot-gitlab> gitlab # [ 189.306253] setup-gitlab-start[2625]: + cat1833vm-test-run-nixbot-gitlab> gitlab # [ 189.310421] setup-gitlab-start[2625]: + git add flake.nix1834vm-test-run-nixbot-gitlab> gitlab # [ 189.313159] setup-gitlab-start[2625]: + git commit -m 'initial commit'1835vm-test-run-nixbot-gitlab> gitlab # [ 189.322245] setup-gitlab-start[2924]: [master (root-commit) 3a89041] initial commit1836vm-test-run-nixbot-gitlab> gitlab # [ 189.323345] setup-gitlab-start[2924]: 1 file changed, 10 insertions(+)1837vm-test-run-nixbot-gitlab> gitlab # [ 189.324218] setup-gitlab-start[2924]: create mode 100644 flake.nix1838vm-test-run-nixbot-gitlab> gitlab # [ 189.325432] setup-gitlab-start[2625]: + git remote add origin http://oauth2:glpat-wDw2B3zia1-gr0MHeKsm0G86MQp1OjEH.01.0w0xmtts7@gitlab/root/test-flake.git1839vm-test-run-nixbot-gitlab> gitlab # [ 189.330117] setup-gitlab-start[2625]: + git push -u origin master1840vm-test-run-nixbot-gitlab> gitlab # [ 189.437669] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:15 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 871841vm-test-run-nixbot-gitlab> gitlab # [ 189.540709] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:15.820Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"3db84bb4c8dca4a1dd7e41be","created_at":"2026-07-01T17:53:15.156Z","trace_propagation_headers":{"sentry-trace":"810db7185ceb48dea09b51939fab26a8-ef6c29efccf84b97","baggage":"sentry-trace_id=810db7185ceb48dea09b51939fab26a8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0GRQ1T4ZY72YS9KP3J32","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:15.162Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-3db84bb4c8dca4a1dd7e41be: done: 0.494544 sec","job_status":"done","queue_duration_s":0.163792,"scheduling_latency_s":0.16384,"redis_calls":11,"redis_duration_s":0.12825,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.006964,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.117361,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003925,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.092,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.278,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.278,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.091,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.118506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001605511,"duration_s":0.494544,"completed_at":"2026-07-01T17:53:15.820Z","load_balancing_strategy":"primary","db_duration_s":0.219009,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1842vm-test-run-nixbot-gitlab> gitlab # [ 189.612813] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:15.822Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"e70a24272fccc9089e242148","created_at":"2026-07-01T17:53:15.164Z","trace_propagation_headers":{"sentry-trace":"810db7185ceb48dea09b51939fab26a8-ef6c29efccf84b97","baggage":"sentry-trace_id=810db7185ceb48dea09b51939fab26a8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0GRQ1T4ZY72YS9KP3J32","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:15.169Z","job_size_bytes":89,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-e70a24272fccc9089e242148: start","job_status":"start","queue_duration_s":0.652219,"scheduling_latency_s":0.652242}1843vm-test-run-nixbot-gitlab> gitlab # [ 189.641099] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:15.920Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"e70a24272fccc9089e242148","created_at":"2026-07-01T17:53:15.164Z","trace_propagation_headers":{"sentry-trace":"810db7185ceb48dea09b51939fab26a8-ef6c29efccf84b97","baggage":"sentry-trace_id=810db7185ceb48dea09b51939fab26a8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0GRQ1T4ZY72YS9KP3J32","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:15.169Z","job_size_bytes":89,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-e70a24272fccc9089e242148: done: 0.09797 sec","job_status":"done","queue_duration_s":0.652219,"scheduling_latency_s":0.652242,"redis_calls":11,"redis_duration_s":0.017997,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000716,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.015999,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001282,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.013533284,"duration_s":0.09797,"completed_at":"2026-07-01T17:53:15.920Z","load_balancing_strategy":"primary","db_duration_s":0.019929,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1844vm-test-run-nixbot-gitlab> gitlab # [ 189.724414] gitaly[1376]: time="2026-07-01T17:53:16.004Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=110 command.spawn_token_fork_ms=107 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KE7MJSZTMFC41HTQJAP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:15.890" grpc.time_ms=114.294 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1845vm-test-run-nixbot-gitlab> gitlab # [ 189.728118] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:16 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.54.0" 2881846vm-test-run-nixbot-gitlab> gitlab # [ 189.961703] gitaly[1376]: time="2026-07-01T17:53:16.241Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-01T17:53:26.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:16.233" grpc.time_ms=7.586 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1847vm-test-run-nixbot-gitlab> gitlab # [ 190.011740] gitaly[1376]: time="2026-07-01T17:53:16.292Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-07-01T17:53:46.085" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-07-01T17:53:16.286" grpc.time_ms=6.081 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1848vm-test-run-nixbot-gitlab> gitlab # [ 190.029215] gitaly[1376]: time="2026-07-01T17:53:16.309Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 duration_ms=148ns method=POST pid=1376 status=200 url="http://unix/api/v4/internal/allowed"1849vm-test-run-nixbot-gitlab> gitlab # [ 190.052436] gitaly[1376]: time="2026-07-01T17:53:16.333Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 duration_ms=22ns method=POST pid=1376 status=200 url="http://unix/api/v4/internal/pre_receive"1850vm-test-run-nixbot-gitlab> gitlab # [ 190.055429] gitaly[1376]: time="2026-07-01T17:53:16.333Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5322 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:16.160" grpc.time_ms=172.301 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1851vm-test-run-nixbot-gitlab> gitlab # [ 190.095504] gitaly[1376]: time="2026-07-01T17:53:16.376Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4792 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:16.375" grpc.time_ms=0.549 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1852vm-test-run-nixbot-gitlab> gitlab # [ 190.138196] gitaly[1376]: time="2026-07-01T17:53:16.418Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4791 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:16.417" grpc.time_ms=0.718 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1853vm-test-run-nixbot-gitlab> gitlab # [ 190.182444] gitaly[1376]: time="2026-07-01T17:53:16.463Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4793 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:16.462" grpc.time_ms=0.389 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1854vm-test-run-nixbot-gitlab> gitlab # [ 190.263601] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:16.543Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 3a890412d4148b4d80aaf4423c190839e517d050 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"ddc397ba0b186d235604a7d7","created_at":"2026-07-01T17:53:16.538Z","trace_propagation_headers":{"sentry-trace":"ff0c31ef6b724702a27525655c5785f9-e0a9cab4c01b419c","baggage":"sentry-trace_id=ff0c31ef6b724702a27525655c5785f9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0KR5G69MXST7B1DTZFB5","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:16.542Z","job_size_bytes":185,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-ddc397ba0b186d235604a7d7: start","job_status":"start","queue_duration_s":0.001335,"scheduling_latency_s":0.001412}1855vm-test-run-nixbot-gitlab> gitlab # [ 190.293145] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:16.573Z","message":"changes: \"0000000000000000000000000000000000000000 3a890412d4148b4d80aaf4423c190839e517d050 refs/heads/master\\n\""}1856vm-test-run-nixbot-gitlab> gitlab # [ 190.299779] gitaly[1376]: time="2026-07-01T17:53:16.580Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=15 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-01T17:53:26.135" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:16.555" grpc.time_ms=24.389 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1857vm-test-run-nixbot-gitlab> gitlab # [ 190.324552] gitaly[1376]: time="2026-07-01T17:53:16.605Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=7 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-01T17:53:26.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:16.593" grpc.time_ms=11.948 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1858vm-test-run-nixbot-gitlab> gitlab # [ 190.346100] gitaly[1376]: time="2026-07-01T17:53:16.612Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1575 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-07-01T17:53:26.166" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:16.587" grpc.time_ms=24.024 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1859vm-test-run-nixbot-gitlab> gitlab # [ 190.368041] gitaly[1376]: time="2026-07-01T17:53:16.632Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 duration_ms=125ns method=POST pid=1376 status=200 url="http://unix/api/v4/internal/post_receive"1860vm-test-run-nixbot-gitlab> gitlab # [ 190.373073] gitaly[1376]: time="2026-07-01T17:53:16.633Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4816 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:16.506" grpc.time_ms=127.016 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1861vm-test-run-nixbot-gitlab> gitlab # [ 190.389791] gitaly[1376]: time="2026-07-01T17:53:16.638Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=11 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-01T17:53:26.031" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:16.621" grpc.time_ms=17.177 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1862vm-test-run-nixbot-gitlab> gitlab # [ 190.411875] gitaly[1376]: time="2026-07-01T17:53:16.676Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-07-01T17:53:26.076" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=226 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:16.667" grpc.time_ms=8.941 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1863vm-test-run-nixbot-gitlab> gitlab # [ 190.413698] gitaly[1376]: time="2026-07-01T17:53:16.694Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 diskcache=17a876be-6656-488e-9731-e92a865f7319 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:16.109" pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1864vm-test-run-nixbot-gitlab> gitlab # [ 190.415366] gitaly[1376]: time="2026-07-01T17:53:16.694Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=166 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=12914 command.oublock=32 command.real_time_ms=538 command.spawn_token_fork_ms=1 command.system_time_ms=125 command.user_time_ms=41 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:16.109" grpc.time_ms=585.038 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1865vm-test-run-nixbot-gitlab> gitlab # [ 190.418488] gitlab-workhorse[1284]: time="2026-07-01T17:53:16Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521866vm-test-run-nixbot-gitlab> gitlab # [ 190.420477] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:16 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 6571867vm-test-run-nixbot-gitlab> gitlab # [ 190.478381] setup-gitlab-start[2928]: To http://gitlab/root/test-flake.git1868vm-test-run-nixbot-gitlab> gitlab # [ 190.479843] setup-gitlab-start[2928]: * [new branch] master -> master1869vm-test-run-nixbot-gitlab> gitlab # [ 190.483732] setup-gitlab-start[2928]: branch 'master' set up to track 'origin/master'.1870vm-test-run-nixbot-gitlab> gitlab # [ 190.487514] systemd[1]: Finished setup-gitlab.service.1871vm-test-run-nixbot-gitlab> gitlab # [ 190.489350] gitaly[1376]: time="2026-07-01T17:53:16.769Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3942 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:16.769" grpc.time_ms=0.598 pid=1376 span.kind=server system=grpc1872vm-test-run-nixbot-gitlab> gitlab # [ 190.504811] systemd[1]: Starting nixbot CI service...1873vm-test-run-nixbot-gitlab> gitlab # [ 190.531282] gitaly[1376]: time="2026-07-01T17:53:16.811Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3944 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:16.811" grpc.time_ms=0.3 pid=1376 span.kind=server system=grpc1874vm-test-run-nixbot-gitlab> gitlab # [ 190.548665] gitaly[1376]: time="2026-07-01T17:53:16.829Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 diskcache=6320e34b-2f72-4d77-8523-0a8a8e06db85 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-01T17:53:26.093" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:16.684" pid=1376 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1875vm-test-run-nixbot-gitlab> gitlab # [ 190.567381] gitaly[1376]: time="2026-07-01T17:53:16.829Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=70 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4711 command.oublock=8 command.real_time_ms=135 command.spawn_token_fork_ms=0 command.system_time_ms=51 command.user_time_ms=19 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-01T17:53:26.093" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:16.684" grpc.time_ms=145.278 pid=1376 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1876vm-test-run-nixbot-gitlab> gitlab # [ 190.568509] gitaly[1376]: time="2026-07-01T17:53:16.845Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-01T17:53:26.254" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:16.845" grpc.time_ms=0.162 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1877vm-test-run-nixbot-gitlab> gitlab # [ 190.582287] gitaly[1376]: time="2026-07-01T17:53:16.862Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=943 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=5 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-07-01T17:53:26.261" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:16.851" grpc.time_ms=11.139 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1878vm-test-run-nixbot-gitlab> gitlab # [ 190.686460] gitaly[1376]: time="2026-07-01T17:53:16.967Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=342 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-07-01T17:53:46.062" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:16.962" grpc.time_ms=4.486 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1879vm-test-run-nixbot-gitlab> gitlab # [ 190.730493] gitaly[1376]: time="2026-07-01T17:53:17.010Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-01T17:53:27.010" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:17.010" grpc.time_ms=0.222 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1880vm-test-run-nixbot-gitlab> gitlab # [ 190.753812] gitaly[1376]: time="2026-07-01T17:53:17.034Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-07-01T17:53:27.029" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-07-01T17:53:17.030" grpc.time_ms=4.127 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1881vm-test-run-nixbot-gitlab> gitlab # [ 190.773823] gitaly[1376]: time="2026-07-01T17:53:17.054Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-01T17:53:27.047" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:17.047" grpc.time_ms=6.57 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1882vm-test-run-nixbot-gitlab> gitlab # [ 190.784851] gitaly[1376]: time="2026-07-01T17:53:17.065Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-01T17:53:27.058" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:17.058" grpc.time_ms=6.66 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1883vm-test-run-nixbot-gitlab> gitlab # [ 190.803797] gitaly[1376]: time="2026-07-01T17:53:17.084Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=960 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-01T17:53:47.074" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:17.074" grpc.time_ms=9.752 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1884vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for unit setup-gitlab.service, in 191.80 seconds)1885vm-test-run-nixbot-gitlab> gitlab: waiting for unit nixbot.service1886vm-test-run-nixbot-gitlab> gitlab # [ 191.104587] gitaly[1376]: time="2026-07-01T17:53:17.385Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-07-01T17:53:27.002" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:17.383" grpc.time_ms=1.78 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1887vm-test-run-nixbot-gitlab> gitlab # [ 191.133420] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:17.413Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 3a890412d4148b4d80aaf4423c190839e517d050 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"ddc397ba0b186d235604a7d7","created_at":"2026-07-01T17:53:16.538Z","trace_propagation_headers":{"sentry-trace":"ff0c31ef6b724702a27525655c5785f9-e0a9cab4c01b419c","baggage":"sentry-trace_id=ff0c31ef6b724702a27525655c5785f9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0KR5G69MXST7B1DTZFB5","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:16.542Z","job_size_bytes":185,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-ddc397ba0b186d235604a7d7: done: 0.869583 sec","job_status":"done","queue_duration_s":0.001335,"scheduling_latency_s":0.001412,"gitaly_calls":13,"gitaly_duration_s":0.359013,"redis_calls":200,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.052677,"redis_read_bytes":941,"redis_write_bytes":19810,"redis_cache_calls":14,"redis_cache_duration_s":0.00358,"redis_cache_read_bytes":16,"redis_cache_write_bytes":884,"redis_feature_flag_calls":32,"redis_feature_flag_duration_s":0.009412,"redis_feature_flag_read_bytes":540,"redis_feature_flag_write_bytes":4279,"redis_queues_calls":8,"redis_queues_duration_s":0.001118,"redis_queues_read_bytes":8,"redis_queues_write_bytes":4934,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003917,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1259,"redis_repository_cache_calls":91,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.019385,"redis_repository_cache_read_bytes":233,"redis_repository_cache_write_bytes":6319,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.015265,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":51,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":51,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":51,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.237,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.251,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.414109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00056739,"exclusive_lock_hold_duration_s":0.033221260999999995,"duration_s":0.869583,"completed_at":"2026-07-01T17:53:17.413Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.056897,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1888vm-test-run-nixbot-gitlab> gitlab # [ 191.212951] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:17.415Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"769c9273c7519835efd38bf4","created_at":"2026-07-01T17:53:16.642Z","trace_propagation_headers":{"sentry-trace":"ff0c31ef6b724702a27525655c5785f9-54b57ef73d7b4110","baggage":"sentry-trace_id=ff0c31ef6b724702a27525655c5785f9,sentry-release=Unknown"},"correlation_id":"01KWFD0KR5G69MXST7B1DTZFB5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:16.646Z","job_size_bytes":46,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-769c9273c7519835efd38bf4: start","job_status":"start","queue_duration_s":0.768302,"scheduling_latency_s":0.768328}1889vm-test-run-nixbot-gitlab> gitlab # [ 191.257133] gitaly[1376]: time="2026-07-01T17:53:17.537Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-07-01T23:53:17.534" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:17.534" grpc.time_ms=2.422 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1890vm-test-run-nixbot-gitlab> gitlab # [ 191.293276] gitaly[1376]: time="2026-07-01T17:53:17.573Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-07-01T17:53:47.563" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:17.563" grpc.time_ms=9.796 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1891vm-test-run-nixbot-gitlab> gitlab # [ 191.340417] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:17.620Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"769c9273c7519835efd38bf4","created_at":"2026-07-01T17:53:16.642Z","trace_propagation_headers":{"sentry-trace":"ff0c31ef6b724702a27525655c5785f9-54b57ef73d7b4110","baggage":"sentry-trace_id=ff0c31ef6b724702a27525655c5785f9,sentry-release=Unknown"},"correlation_id":"01KWFD0KR5G69MXST7B1DTZFB5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:16.646Z","job_size_bytes":46,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-769c9273c7519835efd38bf4: done: 0.205503 sec","job_status":"done","queue_duration_s":0.768302,"scheduling_latency_s":0.768328,"gitaly_calls":2,"gitaly_duration_s":0.140637,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.010183000000000001,"redis_read_bytes":68,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002135,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.001012,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2115,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002549,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.003462,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":754,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001025,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000542527,"duration_s":0.205503,"completed_at":"2026-07-01T17:53:17.620Z","load_balancing_strategy":"primary","db_duration_s":0.01064,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1892vm-test-run-nixbot-gitlab> gitlab # [ 191.424251] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:17.703Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"1da38abf61e8b32344b9cca8","created_at":"2026-07-01T17:53:16.658Z","trace_propagation_headers":{"sentry-trace":"ff0c31ef6b724702a27525655c5785f9-54b57ef73d7b4110","baggage":"sentry-trace_id=ff0c31ef6b724702a27525655c5785f9,sentry-release=Unknown"},"correlation_id":"01KWFD0KR5G69MXST7B1DTZFB5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:16.662Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-1da38abf61e8b32344b9cca8: start","job_status":"start","queue_duration_s":1.041003,"scheduling_latency_s":1.041159}1893vm-test-run-nixbot-gitlab> gitlab # [ 191.499668] gitaly[1376]: time="2026-07-01T17:53:17.780Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 diskcache=f11ba917-9637-4fe4-8947-b7ac08f4286b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-01T23:53:17.752" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:17.752" pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1894vm-test-run-nixbot-gitlab> gitlab # [ 191.501265] gitaly[1376]: time="2026-07-01T17:53:17.780Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1281 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-01T23:53:17.752" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:17.752" grpc.time_ms=27.659 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1895vm-test-run-nixbot-gitlab> gitlab # [ 191.536248] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:17.816Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"1da38abf61e8b32344b9cca8","created_at":"2026-07-01T17:53:16.658Z","trace_propagation_headers":{"sentry-trace":"ff0c31ef6b724702a27525655c5785f9-54b57ef73d7b4110","baggage":"sentry-trace_id=ff0c31ef6b724702a27525655c5785f9,sentry-release=Unknown"},"correlation_id":"01KWFD0KR5G69MXST7B1DTZFB5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:16.662Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-1da38abf61e8b32344b9cca8: done: 0.112947 sec","job_status":"done","queue_duration_s":1.041003,"scheduling_latency_s":1.041159,"gitaly_calls":1,"gitaly_duration_s":0.032757,"redis_calls":15,"redis_duration_s":0.007225,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002495,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00122,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002258,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.015,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.069393456,"duration_s":0.112947,"completed_at":"2026-07-01T17:53:17.816Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014081,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1896vm-test-run-nixbot-gitlab> gitlab # [ 191.616270] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:17.818Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"a9f7bbe1452a5ea2299a5f00","created_at":"2026-07-01T17:53:16.841Z","trace_propagation_headers":{"sentry-trace":"ff0c31ef6b724702a27525655c5785f9-54b57ef73d7b4110","baggage":"sentry-trace_id=ff0c31ef6b724702a27525655c5785f9,sentry-release=Unknown"},"correlation_id":"01KWFD0KR5G69MXST7B1DTZFB5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:16.842Z","job_size_bytes":23,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a9f7bbe1452a5ea2299a5f00: start","job_status":"start","queue_duration_s":0.975553,"scheduling_latency_s":0.975593}1897vm-test-run-nixbot-gitlab> gitlab # [ 191.617925] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:17.857Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"a9f7bbe1452a5ea2299a5f00","created_at":"2026-07-01T17:53:16.841Z","trace_propagation_headers":{"sentry-trace":"ff0c31ef6b724702a27525655c5785f9-54b57ef73d7b4110","baggage":"sentry-trace_id=ff0c31ef6b724702a27525655c5785f9,sentry-release=Unknown"},"correlation_id":"01KWFD0KR5G69MXST7B1DTZFB5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:16.842Z","job_size_bytes":23,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a9f7bbe1452a5ea2299a5f00: done: 0.038985 sec","job_status":"done","queue_duration_s":0.975553,"scheduling_latency_s":0.975593,"gitaly_calls":1,"gitaly_duration_s":0.008385,"redis_calls":16,"redis_duration_s":0.003814,"redis_read_bytes":52,"redis_write_bytes":2048,"redis_queues_calls":1,"redis_queues_duration_s":0.000272,"redis_queues_read_bytes":1,"redis_queues_write_bytes":979,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001255,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.00158,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000707,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038985,"completed_at":"2026-07-01T17:53:17.857Z","load_balancing_strategy":"primary","db_duration_s":0.00238,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1898vm-test-run-nixbot-gitlab> gitlab # [ 191.700831] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:17.858Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"e27fd0929ce5e53f9c07ce83","created_at":"2026-07-01T17:53:17.357Z","trace_propagation_headers":{"sentry-trace":"ff0c31ef6b724702a27525655c5785f9-54b57ef73d7b4110","baggage":"sentry-trace_id=ff0c31ef6b724702a27525655c5785f9,sentry-release=Unknown"},"correlation_id":"01KWFD0KR5G69MXST7B1DTZFB5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0ff3a6d53f18a69adaacce1f2c17dcd764dbc258dbd843c75a0058eb0de706a5","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:17.361Z","job_size_bytes":467,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-e27fd0929ce5e53f9c07ce83: start","job_status":"start","queue_duration_s":0.497661,"scheduling_latency_s":0.497684}1899vm-test-run-nixbot-gitlab> gitlab # [ 191.702672] nixbot[3038]: {"ts": "2026-07-01T17:53:17.854Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1900vm-test-run-nixbot-gitlab> gitlab # [ 191.703936] nixbot[3038]: {"ts": "2026-07-01T17:53:17.873Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1901vm-test-run-nixbot-gitlab> gitlab # [ 191.704778] nixbot[3038]: {"ts": "2026-07-01T17:53:17.886Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1902vm-test-run-nixbot-gitlab> gitlab # [ 191.705824] nixbot[3038]: {"ts": "2026-07-01T17:53:17.890Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1903vm-test-run-nixbot-gitlab> gitlab # [ 191.706968] nixbot[3038]: {"ts": "2026-07-01T17:53:17.893Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1904vm-test-run-nixbot-gitlab> gitlab # [ 191.708145] nixbot[3038]: {"ts": "2026-07-01T17:53:17.902Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1905vm-test-run-nixbot-gitlab> gitlab # [ 191.709117] nixbot[3038]: {"ts": "2026-07-01T17:53:17.906Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1906vm-test-run-nixbot-gitlab> gitlab # [ 191.709858] nixbot[3038]: {"ts": "2026-07-01T17:53:17.907Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1907vm-test-run-nixbot-gitlab> gitlab # [ 191.710983] nixbot[3038]: {"ts": "2026-07-01T17:53:17.912Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1908vm-test-run-nixbot-gitlab> gitlab # [ 191.712154] nixbot[3038]: {"ts": "2026-07-01T17:53:17.914Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1909vm-test-run-nixbot-gitlab> gitlab # [ 191.712977] nixbot[3038]: {"ts": "2026-07-01T17:53:17.918Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1910vm-test-run-nixbot-gitlab> gitlab # [ 191.714150] nixbot[3038]: {"ts": "2026-07-01T17:53:17.922Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1911vm-test-run-nixbot-gitlab> gitlab # [ 191.716650] gitaly[1376]: time="2026-07-01T17:53:17.850Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-07-01T17:53:47.843" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:17.843" grpc.time_ms=6.347 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1912vm-test-run-nixbot-gitlab> gitlab # [ 191.734233] nixbot[3038]: {"ts": "2026-07-01T17:53:17.925Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1913vm-test-run-nixbot-gitlab> gitlab # [ 191.737294] nixbot[3038]: {"ts": "2026-07-01T17:53:17.928Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1914vm-test-run-nixbot-gitlab> gitlab # [ 191.741138] nixbot[3038]: {"ts": "2026-07-01T17:53:17.931Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1915vm-test-run-nixbot-gitlab> gitlab # [ 191.744695] nixbot[3038]: {"ts": "2026-07-01T17:53:17.933Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1916vm-test-run-nixbot-gitlab> gitlab # [ 191.747835] nixbot[3038]: {"ts": "2026-07-01T17:53:17.935Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1917vm-test-run-nixbot-gitlab> gitlab # [ 191.751286] nixbot[3038]: {"ts": "2026-07-01T17:53:17.936Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1918vm-test-run-nixbot-gitlab> gitlab # [ 191.754374] nixbot[3038]: {"ts": "2026-07-01T17:53:17.940Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1919vm-test-run-nixbot-gitlab> gitlab # [ 191.826397] nixbot[3038]: {"ts": "2026-07-01T17:53:17.942Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1920vm-test-run-nixbot-gitlab> gitlab # [ 191.828289] gitaly[1376]: time="2026-07-01T17:53:17.893Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:47.892" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:17.892" grpc.time_ms=0.481 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1921vm-test-run-nixbot-gitlab> gitlab # [ 191.829470] gitaly[1376]: time="2026-07-01T17:53:17.902Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-01T17:53:27.005" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:17.896" grpc.time_ms=6.106 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1922vm-test-run-nixbot-gitlab> gitlab # [ 191.830322] gitaly[1376]: time="2026-07-01T17:53:17.991Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-01T17:53:47.090" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:17.990" grpc.time_ms=0.795 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1923vm-test-run-nixbot-gitlab> gitlab # [ 191.831302] gitaly[1376]: time="2026-07-01T17:53:17.999Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=227 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-07-01T17:53:47.094" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:17.994" grpc.time_ms=4.449 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1924vm-test-run-nixbot-gitlab> gitlab # [ 191.901137] gitaly[1376]: time="2026-07-01T17:53:18.071Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-01T17:53:28.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:18.065" grpc.time_ms=5.987 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1925vm-test-run-nixbot-gitlab> gitlab # [ 192.144390] nixbot[3038]: INFO: Started server process [3038]1926vm-test-run-nixbot-gitlab> gitlab # [ 192.147667] nixbot[3038]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1927vm-test-run-nixbot-gitlab> gitlab # [ 192.153274] nixbot[3038]: INFO: ::ffff:127.0.0.1:42104 - "GET /health HTTP/1.1" 200 OK1928vm-test-run-nixbot-gitlab> gitlab # [ 192.159704] systemd[1]: Started nixbot CI service.1929vm-test-run-nixbot-gitlab> gitlab # [ 192.163991] systemd[1]: Reached target Multi-User System.1930vm-test-run-nixbot-gitlab> gitlab # [ 192.167931] systemd[1]: Startup finished in 1.409s (kernel) + 4.249s (initrd) + 3min 6.508s (userspace) = 3min 12.167s.1931vm-test-run-nixbot-gitlab> gitlab # [ 192.349655] gitaly[1376]: time="2026-07-01T17:53:18.630Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=966 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0P300CZ3NHHS93455255 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-01T17:53:48.017" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:18.618" grpc.time_ms=11.679 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1932vm-test-run-nixbot-gitlab> gitlab # [ 192.376869] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:18 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 2241933vm-test-run-nixbot-gitlab> gitlab # [ 192.380403] nixbot[3038]: {"ts": "2026-07-01T17:53:18.657Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1934vm-test-run-nixbot-gitlab> gitlab # [ 192.391136] nixbot[3038]: {"ts": "2026-07-01T17:53:18.671Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1935vm-test-run-nixbot-gitlab> gitlab # [ 192.456552] gitaly[1376]: time="2026-07-01T17:53:18.737Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=960 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-01T17:53:48.026" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:18.726" grpc.time_ms=10.696 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1936vm-test-run-nixbot-gitlab> gitlab # [ 192.469777] gitaly[1376]: time="2026-07-01T17:53:18.750Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0KR5G69MXST7B1DTZFB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-07-01T17:53:48.041" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:18.741" grpc.time_ms=8.703 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1937vm-test-run-nixbot-gitlab> gitlab # [ 192.488927] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 921938vm-test-run-nixbot-gitlab> gitlab # [ 192.499515] sidekiq-cluster[2096]: {"severity":"WARN","time":"2026-07-01T17:53:18.779Z","class":"CreatePipelineWorker","correlation_id":"01KWFD0KR5G69MXST7B1DTZFB5","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"3a890412d4148b4d80aaf4423c190839e517d050","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"3a890412d4148b4d80aaf4423c190839e517d050","ref":"refs/heads/master"},"retry":0}1939vm-test-run-nixbot-gitlab> gitlab # [ 192.506079] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:18.786Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"e27fd0929ce5e53f9c07ce83","created_at":"2026-07-01T17:53:17.357Z","trace_propagation_headers":{"sentry-trace":"ff0c31ef6b724702a27525655c5785f9-54b57ef73d7b4110","baggage":"sentry-trace_id=ff0c31ef6b724702a27525655c5785f9,sentry-release=Unknown"},"correlation_id":"01KWFD0KR5G69MXST7B1DTZFB5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0ff3a6d53f18a69adaacce1f2c17dcd764dbc258dbd843c75a0058eb0de706a5","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:17.361Z","job_size_bytes":467,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-e27fd0929ce5e53f9c07ce83: done: 0.927326 sec","job_status":"done","queue_duration_s":0.497661,"scheduling_latency_s":0.497684,"gitaly_calls":7,"gitaly_duration_s":0.053738,"redis_calls":53,"redis_duration_s":0.011082,"redis_read_bytes":171,"redis_write_bytes":4427,"redis_cache_calls":4,"redis_cache_duration_s":0.000947,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.005062,"redis_feature_flag_read_bytes":18,"redis_feature_flag_write_bytes":2433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001686,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.00244,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":40,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":40,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.164,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.16,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.611369,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000384407,"duration_s":0.927326,"completed_at":"2026-07-01T17:53:18.786Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.238604,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1940vm-test-run-nixbot-gitlab> gitlab # [ 192.587038] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:18.788Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"2e562a2bd7db1bfa83bd43d6","created_at":"2026-07-01T17:53:17.605Z","trace_propagation_headers":{"sentry-trace":"ff0c31ef6b724702a27525655c5785f9-11edc08afc614c5b","baggage":"sentry-trace_id=ff0c31ef6b724702a27525655c5785f9,sentry-release=Unknown"},"correlation_id":"01KWFD0KR5G69MXST7B1DTZFB5","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:17.609Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-2e562a2bd7db1bfa83bd43d6: start","job_status":"start","queue_duration_s":1.178245,"scheduling_latency_s":1.178267}1941vm-test-run-nixbot-gitlab> gitlab # [ 192.588278] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:18.824Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"2e562a2bd7db1bfa83bd43d6","created_at":"2026-07-01T17:53:17.605Z","trace_propagation_headers":{"sentry-trace":"ff0c31ef6b724702a27525655c5785f9-11edc08afc614c5b","baggage":"sentry-trace_id=ff0c31ef6b724702a27525655c5785f9,sentry-release=Unknown"},"correlation_id":"01KWFD0KR5G69MXST7B1DTZFB5","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:17.609Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-2e562a2bd7db1bfa83bd43d6: done: 0.036783 sec","job_status":"done","queue_duration_s":1.178245,"scheduling_latency_s":1.178267,"redis_calls":19,"redis_duration_s":0.00434,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000876,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000703,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002055,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000706,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024443,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006428191,"duration_s":0.036783,"completed_at":"2026-07-01T17:53:18.824Z","load_balancing_strategy":"primary","db_duration_s":0.005878,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1942vm-test-run-nixbot-gitlab> gitlab # [ 192.668374] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:18.826Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"0fec0e6355057546cb2d53cf","created_at":"2026-07-01T17:53:18.813Z","trace_propagation_headers":{"sentry-trace":"ff0c31ef6b724702a27525655c5785f9-ab2aef8f319e4a08","baggage":"sentry-trace_id=ff0c31ef6b724702a27525655c5785f9,sentry-release=Unknown"},"correlation_id":"01KWFD0KR5G69MXST7B1DTZFB5","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:18.817Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-0fec0e6355057546cb2d53cf: start","job_status":"start","queue_duration_s":0.008509,"scheduling_latency_s":0.008531}1943vm-test-run-nixbot-gitlab> gitlab # [ 192.669952] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:18.906Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"0fec0e6355057546cb2d53cf","created_at":"2026-07-01T17:53:18.813Z","trace_propagation_headers":{"sentry-trace":"ff0c31ef6b724702a27525655c5785f9-ab2aef8f319e4a08","baggage":"sentry-trace_id=ff0c31ef6b724702a27525655c5785f9,sentry-release=Unknown"},"correlation_id":"01KWFD0KR5G69MXST7B1DTZFB5","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:18.817Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-0fec0e6355057546cb2d53cf: done: 0.080107 sec","job_status":"done","queue_duration_s":0.008509,"scheduling_latency_s":0.008531,"redis_calls":24,"redis_duration_s":0.006341,"redis_read_bytes":150,"redis_write_bytes":2873,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.003269,"redis_feature_flag_read_bytes":142,"redis_feature_flag_write_bytes":1991,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002342,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00073,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":18,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":18,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":18,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000498388,"duration_s":0.080107,"completed_at":"2026-07-01T17:53:18.906Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021783,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1944vm-test-run-nixbot-gitlab> gitlab # [ 192.769979] nixbot[3038]: {"ts": "2026-07-01T17:53:18.894Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1945vm-test-run-nixbot-gitlab> gitlab # [ 192.771143] nixbot[3038]: {"ts": "2026-07-01T17:53:18.895Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1946vm-test-run-nixbot-gitlab> gitlab # [ 192.781993] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 868 "" "python-httpx/0.28.1" 1631947vm-test-run-nixbot-gitlab> gitlab # [ 192.783687] nixbot[3038]: {"ts": "2026-07-01T17:53:19.063Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1948vm-test-run-nixbot-gitlab> gitlab # [ 192.922846] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:19 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 1321949vm-test-run-nixbot-gitlab> gitlab # [ 192.932616] nixbot[3038]: {"ts": "2026-07-01T17:53:19.203Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1950vm-test-run-nixbot-gitlab> gitlab # [ 192.986958] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "python-httpx/0.28.1" 491951vm-test-run-nixbot-gitlab> gitlab # [ 192.990531] nixbot[3038]: {"ts": "2026-07-01T17:53:19.267Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1952vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for unit nixbot.service, in 2.08 seconds)1953vm-test-run-nixbot-gitlab> gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1954vm-test-run-nixbot-gitlab> gitlab # [ 193.060873] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:19 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 868 "" "python-httpx/0.28.1" 551955vm-test-run-nixbot-gitlab> gitlab # [ 193.062198] nixbot[3038]: {"ts": "2026-07-01T17:53:19.342Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1956vm-test-run-nixbot-gitlab> gitlab # [ 193.108486] nixbot[3038]: INFO: ::ffff:127.0.0.1:48610 - "GET /health HTTP/1.1" 200 OK1957vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.05 seconds)1958vm-test-run-nixbot-gitlab> subtest: project discovered and webhook registered1959vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1960vm-test-run-nixbot-gitlab> gitlab # [ 193.114135] gitaly[1376]: time="2026-07-01T17:53:19.394Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0PZKFKED1QABFDD2BNC1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-07-01T17:53:49.186" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:19.387" grpc.time_ms=6.971 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1961vm-test-run-nixbot-gitlab> gitlab # [ 193.124881] gitaly[1376]: time="2026-07-01T17:53:19.405Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0PZKFKED1QABFDD2BNC1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:49.203" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:19.404" grpc.time_ms=0.633 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1962vm-test-run-nixbot-gitlab> gitlab # [ 193.186457] gitaly[1376]: time="2026-07-01T17:53:19.467Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0PZKFKED1QABFDD2BNC1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-07-01T17:53:29.229" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:19.459" grpc.time_ms=6.981 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1963vm-test-run-nixbot-gitlab> gitlab # [ 193.273253] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 731 "" "python-httpx/0.28.1" 2061964vm-test-run-nixbot-gitlab> gitlab # [ 193.275487] nixbot[3038]: {"ts": "2026-07-01T17:53:19.554Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1965vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.18 seconds)1966vm-test-run-nixbot-gitlab> [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-07-01T17:53:19.044Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]1967vm-test-run-nixbot-gitlab> gitlab # [ 193.288395] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "curl/8.20.0" 791968vm-test-run-nixbot-gitlab> (finished: subtest: project discovered and webhook registered, in 0.18 seconds)1969vm-test-run-nixbot-gitlab> subtest: push delivers the webhook1970vm-test-run-nixbot-gitlab> gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1971vm-test-run-nixbot-gitlab> gitlab # [ 193.343781] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 541972vm-test-run-nixbot-gitlab> gitlab # [ 193.352773] nixbot[3038]: {"ts": "2026-07-01T17:53:19.633Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1973vm-test-run-nixbot-gitlab> gitlab # [ 193.362702] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:19 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 391974vm-test-run-nixbot-gitlab> gitlab # [ 193.369465] nixbot[3038]: {"ts": "2026-07-01T17:53:19.650Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1975vm-test-run-nixbot-gitlab> gitlab # [ 193.449796] gitaly[1376]: time="2026-07-01T17:53:19.730Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0QA09TZFTTQZEX69GSEZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=198 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:19.719" grpc.time_ms=10.528 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc1976vm-test-run-nixbot-gitlab> gitlab # [ 193.451075] gitaly[1376]: time="2026-07-01T17:53:19.730Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0Q8Z2BY5MR1HCBJB4ZQV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:19.723" grpc.time_ms=7.219 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1977vm-test-run-nixbot-gitlab> gitlab # [ 193.454535] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:19 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 531978vm-test-run-nixbot-gitlab> gitlab # [ 193.455784] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:19 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.54.0" 871979vm-test-run-nixbot-gitlab> gitlab # Enumerating objects: 5, done.1980vm-test-run-nixbot-gitlab> gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1981vm-test-run-nixbot-gitlab> gitlab # Delta compression using up to 4 threads1982vm-test-run-nixbot-gitlab> gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1983vm-test-run-nixbot-gitlab> gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 136.00 KiB/s, done.1984vm-test-run-nixbot-gitlab> gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1985vm-test-run-nixbot-gitlab> gitlab # [ 193.593202] gitaly[1376]: time="2026-07-01T17:53:19.873Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0QBX6X594QJ0B3FNZZ5A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:19.858" pid=1376 remote_ip="2001:db8:1::1" request_sha=083c43590fffa527704b32b8836424e8ed055017 response_bytes=149 span.kind=server system=grpc1986vm-test-run-nixbot-gitlab> gitlab # [ 193.596931] gitaly[1376]: time="2026-07-01T17:53:19.875Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0QBX6X594QJ0B3FNZZ5A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:19.858" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc1987vm-test-run-nixbot-gitlab> gitlab # [ 193.597781] gitlab-workhorse[1284]: time="2026-07-01T17:53:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1491988vm-test-run-nixbot-gitlab> gitlab # [ 193.598860] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 149 "" "git/2.54.0" 1351989vm-test-run-nixbot-gitlab> gitlab # [ 193.600056] gitaly[1376]: time="2026-07-01T17:53:19.875Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0QBX6X594QJ0B3FNZZ5A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:19.858" grpc.time_ms=17.646 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc1990vm-test-run-nixbot-gitlab> gitlab # [ 193.708779] gitaly[1376]: time="2026-07-01T17:53:19.989Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0QHG8D2Y1WVJ6093A8NA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:19.972" pid=1376 remote_ip="2001:db8:1::1" request_sha=639b55b350787677137f60ecd9965c9dc570964d response_bytes=373 span.kind=server system=grpc1991vm-test-run-nixbot-gitlab> gitlab # [ 193.712118] gitaly[1376]: time="2026-07-01T17:53:19.989Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1237 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0QHG8D2Y1WVJ6093A8NA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:19.972" negotiation.command=fetch negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc1992vm-test-run-nixbot-gitlab> gitlab # [ 193.747597] gitlab-workhorse[1284]: time="2026-07-01T17:53:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3731993vm-test-run-nixbot-gitlab> gitlab # [ 193.751047] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 373 "" "git/2.54.0" 1071994vm-test-run-nixbot-gitlab> gitlab # [ 193.755265] gitaly[1376]: time="2026-07-01T17:53:19.989Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1237 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0QHG8D2Y1WVJ6093A8NA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=9 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:19.972" grpc.time_ms=17.64 negotiation.command=fetch negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc1995vm-test-run-nixbot-gitlab> gitlab # [ 193.781303] gitaly[1376]: time="2026-07-01T17:53:20.061Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-07-01T17:53:30.004" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=253 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:20.055" grpc.time_ms=6.742 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1996vm-test-run-nixbot-gitlab> gitlab # [ 193.798706] gitaly[1376]: time="2026-07-01T17:53:20.079Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-07-01T17:53:50.072" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-07-01T17:53:20.072" grpc.time_ms=6.812 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1997vm-test-run-nixbot-gitlab> gitlab # [ 193.809058] gitaly[1376]: time="2026-07-01T17:53:20.089Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N duration_ms=76ns method=POST pid=1376 status=200 url="http://unix/api/v4/internal/allowed"1998vm-test-run-nixbot-gitlab> gitlab # [ 193.829795] gitaly[1376]: time="2026-07-01T17:53:20.110Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N duration_ms=19ns method=POST pid=1376 status=200 url="http://unix/api/v4/internal/pre_receive"1999vm-test-run-nixbot-gitlab> gitlab # [ 193.831713] gitaly[1376]: time="2026-07-01T17:53:20.112Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5322 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:20.011" grpc.time_ms=100.189 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2000vm-test-run-nixbot-gitlab> gitlab # [ 193.877224] gitaly[1376]: time="2026-07-01T17:53:20.157Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4792 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:20.155" grpc.time_ms=1.387 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2001vm-test-run-nixbot-gitlab> gitlab # [ 193.923043] gitaly[1376]: time="2026-07-01T17:53:20.202Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4791 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:20.202" grpc.time_ms=0.357 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2002vm-test-run-nixbot-gitlab> gitlab # [ 193.938704] gitaly[1376]: time="2026-07-01T17:53:20.219Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=6 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0QS11FT9C3EHS4GGF0H3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=196 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:20.203" grpc.time_ms=16.039 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc2003vm-test-run-nixbot-gitlab> gitlab # [ 193.941993] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 592004vm-test-run-nixbot-gitlab> gitlab # [ 194.000169] gitaly[1376]: time="2026-07-01T17:53:20.278Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4793 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:20.277" grpc.time_ms=0.535 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2005vm-test-run-nixbot-gitlab> gitlab # [ 194.016216] gitaly[1376]: time="2026-07-01T17:53:20.290Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0QV0MJGVMV983NFJZ5RC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:20.272" pid=1376 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc2006vm-test-run-nixbot-gitlab> gitlab # [ 194.017464] gitlab-workhorse[1284]: time="2026-07-01T17:53:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672007vm-test-run-nixbot-gitlab> gitlab # [ 194.018190] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 672008vm-test-run-nixbot-gitlab> gitlab # [ 194.019241] gitaly[1376]: time="2026-07-01T17:53:20.290Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0QV0MJGVMV983NFJZ5RC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:20.272" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc2009vm-test-run-nixbot-gitlab> gitlab # [ 194.020268] gitaly[1376]: time="2026-07-01T17:53:20.290Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0QV0MJGVMV983NFJZ5RC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:20.272" grpc.time_ms=18.569 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc2010vm-test-run-nixbot-gitlab> gitlab # [ 194.151611] gitaly[1376]: time="2026-07-01T17:53:20.430Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0QZDQGNHF2GD3KD0QBSE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:20.405" pid=1376 remote_ip="2001:db8:1::1" request_sha=2a8cf3e5c040e1f52c31f1e54c9ed84b05b584b8 response_bytes=389 span.kind=server system=grpc2011vm-test-run-nixbot-gitlab> gitlab # [ 194.156249] gitaly[1376]: time="2026-07-01T17:53:20.430Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1195 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0QZDQGNHF2GD3KD0QBSE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:20.405" negotiation.command=fetch negotiation.haves=1 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc2012vm-test-run-nixbot-gitlab> gitlab # [ 194.159458] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:20.435Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","3a890412d4148b4d80aaf4423c190839e517d050 7be4070670fca3c68e199d7f7820643000a5b0a0 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"06a197e0f8deff83e844c198","created_at":"2026-07-01T17:53:20.426Z","trace_propagation_headers":{"sentry-trace":"f02b59b692c14ee28da9ef8827b80565-ae17f3b55b624d44","baggage":"sentry-trace_id=f02b59b692c14ee28da9ef8827b80565,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0QDQW2E7Y87YYBE7W98N","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:20.429Z","job_size_bytes":185,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-06a197e0f8deff83e844c198: start","job_status":"start","queue_duration_s":0.005966,"scheduling_latency_s":0.006009}2013vm-test-run-nixbot-gitlab> gitlab # [ 194.160367] gitlab-workhorse[1284]: time="2026-07-01T17:53:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3892014vm-test-run-nixbot-gitlab> gitlab # [ 194.161177] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 389 "" "git/2.54.0" 662015vm-test-run-nixbot-gitlab> gitlab # [ 194.165228] gitaly[1376]: time="2026-07-01T17:53:20.435Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1195 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0QZDQGNHF2GD3KD0QBSE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:20.405" grpc.time_ms=25.731 negotiation.command=fetch negotiation.haves=1 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc2016vm-test-run-nixbot-gitlab> gitlab # [ 194.174636] gitaly[1376]: time="2026-07-01T17:53:20.442Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N duration_ms=45ns method=POST pid=1376 status=200 url="http://unix/api/v4/internal/post_receive"2017vm-test-run-nixbot-gitlab> gitlab # [ 194.179621] gitaly[1376]: time="2026-07-01T17:53:20.443Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4816 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:20.394" grpc.time_ms=48.661 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2018vm-test-run-nixbot-gitlab> gitlab # [ 194.278911] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:20.559Z","message":"changes: \"3a890412d4148b4d80aaf4423c190839e517d050 7be4070670fca3c68e199d7f7820643000a5b0a0 refs/heads/master\\n\""}2019vm-test-run-nixbot-gitlab> gitlab # [ 194.281902] gitaly[1376]: time="2026-07-01T17:53:20.560Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N diskcache=8947f906-3c35-403a-b610-338822e752a9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:19.854" pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2020vm-test-run-nixbot-gitlab> gitlab # [ 194.283613] gitlab-workhorse[1284]: time="2026-07-01T17:53:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=522021vm-test-run-nixbot-gitlab> gitlab # [ 194.285190] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:20 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 7612022vm-test-run-nixbot-gitlab> gitlab # [ 194.287234] gitaly[1376]: time="2026-07-01T17:53:20.561Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=372 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13258 command.oublock=32 command.real_time_ms=694 command.spawn_token_fork_ms=0 command.system_time_ms=318 command.user_time_ms=54 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:19.854" grpc.time_ms=706.564 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2023vm-test-run-nixbot-gitlab> gitlab # [ 194.303699] gitaly[1376]: time="2026-07-01T17:53:20.584Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-01T17:53:30.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:20.577" grpc.time_ms=5.948 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2024vm-test-run-nixbot-gitlab> gitlab # [ 194.312984] gitaly[1376]: time="2026-07-01T17:53:20.593Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-01T17:53:30.018" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:20.588" grpc.time_ms=5.101 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2025vm-test-run-nixbot-gitlab> gitlab # [ 194.333372] gitaly[1376]: time="2026-07-01T17:53:20.613Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-07-01T17:53:30.037" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:20.607" grpc.time_ms=5.661 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2026vm-test-run-nixbot-gitlab> gitlab # [ 194.344308] gitaly[1376]: time="2026-07-01T17:53:20.624Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-07-01T17:53:50.018" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:20.618" grpc.time_ms=6.287 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2027vm-test-run-nixbot-gitlab> gitlab # [ 194.355723] gitaly[1376]: time="2026-07-01T17:53:20.636Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=345 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-07-01T17:53:30.062" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-07-01T17:53:20.632" grpc.time_ms=3.491 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2028vm-test-run-nixbot-gitlab> gitlab # [ 194.370654] gitaly[1376]: time="2026-07-01T17:53:20.651Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-01T17:53:30.075" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:20.645" grpc.time_ms=5.742 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2029vm-test-run-nixbot-gitlab> gitlab # To http://gitlab/root/test-flake.git2030vm-test-run-nixbot-gitlab> gitlab # 3a89041..7be4070 master -> master2031vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.17 seconds)2032vm-test-run-nixbot-gitlab> gitlab: must succeed: git -C /tmp/test-flake rev-parse master2033vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)2034vm-test-run-nixbot-gitlab> gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7be4070670fca3c68e199d7f7820643000a5b0a0'2035vm-test-run-nixbot-gitlab> gitlab # [ 194.494667] nixbot[3038]: INFO: ::ffff:127.0.0.1:48622 - "GET /api/repos/gitlab/root/test-flake/builds?commit=7be4070670fca3c68e199d7f7820643000a5b0a0 HTTP/1.1" 200 OK2036vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7be4070670fca3c68e199d7f7820643000a5b0a0', in 0.03 seconds)2037vm-test-run-nixbot-gitlab> []2038vm-test-run-nixbot-gitlab> gitlab # [ 194.524313] gitaly[1376]: time="2026-07-01T17:53:20.804Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0RBNJ65QBQST617DJTSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:50.203" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:20.804" grpc.time_ms=0.499 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2039vm-test-run-nixbot-gitlab> gitlab # [ 194.538400] gitaly[1376]: time="2026-07-01T17:53:20.818Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-07-01T17:53:30.247" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:20.817" grpc.time_ms=1.284 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2040vm-test-run-nixbot-gitlab> gitlab # [ 194.557353] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:20.837Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","3a890412d4148b4d80aaf4423c190839e517d050 7be4070670fca3c68e199d7f7820643000a5b0a0 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"06a197e0f8deff83e844c198","created_at":"2026-07-01T17:53:20.426Z","trace_propagation_headers":{"sentry-trace":"f02b59b692c14ee28da9ef8827b80565-ae17f3b55b624d44","baggage":"sentry-trace_id=f02b59b692c14ee28da9ef8827b80565,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0QDQW2E7Y87YYBE7W98N","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-01T17:53:20.429Z","job_size_bytes":185,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-06a197e0f8deff83e844c198: done: 0.402228 sec","job_status":"done","queue_duration_s":0.005966,"scheduling_latency_s":0.006009,"gitaly_calls":7,"gitaly_duration_s":0.049574,"redis_calls":114,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.090157,"redis_read_bytes":352,"redis_write_bytes":13350,"redis_cache_calls":9,"redis_cache_duration_s":0.002271,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001296,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":606,"redis_queues_calls":8,"redis_queues_duration_s":0.00132,"redis_queues_read_bytes":8,"redis_queues_write_bytes":6767,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.002074,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1182,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.007859,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.075337,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":30,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":30,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.016,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.016,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.192053,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00052325,"exclusive_lock_hold_duration_s":0.017420371,"duration_s":0.402228,"completed_at":"2026-07-01T17:53:20.837Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033801,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2041vm-test-run-nixbot-gitlab> gitlab # [ 194.626482] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:20.840Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"bb6abb3aa4a341868afde549","created_at":"2026-07-01T17:53:20.596Z","trace_propagation_headers":{"sentry-trace":"f02b59b692c14ee28da9ef8827b80565-8fb0c544745c4c81","baggage":"sentry-trace_id=f02b59b692c14ee28da9ef8827b80565,sentry-release=Unknown"},"correlation_id":"01KWFD0QDQW2E7Y87YYBE7W98N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:20.598Z","job_size_bytes":46,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-bb6abb3aa4a341868afde549: start","job_status":"start","queue_duration_s":0.241707,"scheduling_latency_s":0.241733}2042vm-test-run-nixbot-gitlab> gitlab # [ 194.627951] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:20.856Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"bb6abb3aa4a341868afde549","created_at":"2026-07-01T17:53:20.596Z","trace_propagation_headers":{"sentry-trace":"f02b59b692c14ee28da9ef8827b80565-8fb0c544745c4c81","baggage":"sentry-trace_id=f02b59b692c14ee28da9ef8827b80565,sentry-release=Unknown"},"correlation_id":"01KWFD0QDQW2E7Y87YYBE7W98N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:20.598Z","job_size_bytes":46,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-bb6abb3aa4a341868afde549: done: 0.016629 sec","job_status":"done","queue_duration_s":0.241707,"scheduling_latency_s":0.241733,"redis_calls":9,"redis_duration_s":0.002007,"redis_read_bytes":23,"redis_write_bytes":782,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001118,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000265,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000624,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":304,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016629,"completed_at":"2026-07-01T17:53:20.856Z","load_balancing_strategy":"primary","db_duration_s":0.001309,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2043vm-test-run-nixbot-gitlab> gitlab # [ 194.703285] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:20.858Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"fdb249e0631b6617b4e8b823","created_at":"2026-07-01T17:53:20.602Z","trace_propagation_headers":{"sentry-trace":"f02b59b692c14ee28da9ef8827b80565-8fb0c544745c4c81","baggage":"sentry-trace_id=f02b59b692c14ee28da9ef8827b80565,sentry-release=Unknown"},"correlation_id":"01KWFD0QDQW2E7Y87YYBE7W98N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:20.603Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-fdb249e0631b6617b4e8b823: start","job_status":"start","queue_duration_s":0.254394,"scheduling_latency_s":0.254416}2044vm-test-run-nixbot-gitlab> gitlab # [ 194.704456] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:20.975Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"fdb249e0631b6617b4e8b823","created_at":"2026-07-01T17:53:20.602Z","trace_propagation_headers":{"sentry-trace":"f02b59b692c14ee28da9ef8827b80565-8fb0c544745c4c81","baggage":"sentry-trace_id=f02b59b692c14ee28da9ef8827b80565,sentry-release=Unknown"},"correlation_id":"01KWFD0QDQW2E7Y87YYBE7W98N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:20.603Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-fdb249e0631b6617b4e8b823: done: 0.117161 sec","job_status":"done","queue_duration_s":0.254394,"scheduling_latency_s":0.254416,"gitaly_calls":1,"gitaly_duration_s":0.090876,"redis_calls":12,"redis_duration_s":0.0028409999999999998,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001117,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000645,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001079,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.101662082,"duration_s":0.117161,"completed_at":"2026-07-01T17:53:20.975Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003804,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2045vm-test-run-nixbot-gitlab> gitlab # [ 194.831372] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:20.976Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"605d9cd4b6f24fee6410756c","created_at":"2026-07-01T17:53:20.689Z","trace_propagation_headers":{"sentry-trace":"f02b59b692c14ee28da9ef8827b80565-8fb0c544745c4c81","baggage":"sentry-trace_id=f02b59b692c14ee28da9ef8827b80565,sentry-release=Unknown"},"correlation_id":"01KWFD0QDQW2E7Y87YYBE7W98N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:27192eea8c24ecd1033bc6897fe1d33c6aff3e0d97bc68b9e8c01875d968e128","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:20.691Z","job_size_bytes":467,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-605d9cd4b6f24fee6410756c: start","job_status":"start","queue_duration_s":0.285008,"scheduling_latency_s":0.28503}2046vm-test-run-nixbot-gitlab> gitlab # [ 194.833069] gitaly[1376]: time="2026-07-01T17:53:20.961Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N diskcache=7c821584-8872-4a55-a8d0-c26a9f419068 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-01T23:53:20.872" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:20.872" pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2047vm-test-run-nixbot-gitlab> gitlab # [ 194.834089] gitaly[1376]: time="2026-07-01T17:53:20.961Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=5 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1638 command.oublock=0 command.real_time_ms=86 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-01T23:53:20.872" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:20.872" grpc.time_ms=88.709 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2048vm-test-run-nixbot-gitlab> gitlab # [ 194.834925] gitaly[1376]: time="2026-07-01T17:53:20.999Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:50.396" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:20.997" grpc.time_ms=1.735 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2049vm-test-run-nixbot-gitlab> gitlab # [ 194.852310] gitaly[1376]: time="2026-07-01T17:53:21.008Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-01T17:53:31.100" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:21.001" grpc.time_ms=7.208 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2050vm-test-run-nixbot-gitlab> gitlab # [ 194.923443] gitaly[1376]: time="2026-07-01T17:53:21.034Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-01T17:53:51.032" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:21.032" grpc.time_ms=1.239 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2051vm-test-run-nixbot-gitlab> gitlab # [ 194.924990] gitaly[1376]: time="2026-07-01T17:53:21.041Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=325 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-07-01T17:53:51.037" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:21.037" grpc.time_ms=3.829 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2052vm-test-run-nixbot-gitlab> gitlab # [ 194.926172] gitaly[1376]: time="2026-07-01T17:53:21.078Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-01T17:53:31.171" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:21.072" grpc.time_ms=5.958 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2053vm-test-run-nixbot-gitlab> gitlab # [ 195.030995] gitaly[1376]: time="2026-07-01T17:53:21.311Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=653 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0RBNJ65QBQST617DJTSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-07-01T17:53:51.003" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:21.304" grpc.time_ms=7.25 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2054vm-test-run-nixbot-gitlab> gitlab # [ 195.059407] gitaly[1376]: time="2026-07-01T17:53:21.340Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0RBNJ65QBQST617DJTSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-01T17:53:31.153" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:21.334" grpc.time_ms=5.641 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2055vm-test-run-nixbot-gitlab> gitlab # [ 195.098617] gitaly[1376]: time="2026-07-01T17:53:21.379Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0RBNJ65QBQST617DJTSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-01T17:53:31.198" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:21.378" grpc.time_ms=0.447 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2056vm-test-run-nixbot-gitlab> gitlab # [ 195.129828] gitaly[1376]: time="2026-07-01T17:53:21.410Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0RBNJ65QBQST617DJTSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-01T17:53:31.222" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:21.402" grpc.time_ms=7.249 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2057vm-test-run-nixbot-gitlab> gitlab # [ 195.183355] gitaly[1376]: time="2026-07-01T17:53:21.463Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0RBNJ65QBQST617DJTSN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4159 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:21.462" grpc.time_ms=0.357 pid=1376 span.kind=server system=grpc2058vm-test-run-nixbot-gitlab> gitlab # [ 195.204525] gitaly[1376]: time="2026-07-01T17:53:21.485Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-01T17:53:51.475" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:21.475" grpc.time_ms=9.101 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2059vm-test-run-nixbot-gitlab> gitlab # [ 195.230390] gitaly[1376]: time="2026-07-01T17:53:21.511Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0RBNJ65QBQST617DJTSN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4161 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:21.510" grpc.time_ms=0.419 pid=1376 span.kind=server system=grpc2060vm-test-run-nixbot-gitlab> gitlab # [ 195.253646] gitaly[1376]: time="2026-07-01T17:53:21.534Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0RBNJ65QBQST617DJTSN diskcache=54b0ff7b-bed2-49d8-a150-cfd3a550430d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-01T17:53:31.236" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:21.416" pid=1376 ref=refs/keep-around/3a890412d4148b4d80aaf4423c190839e517d050 remote_ip="2001:db8:1::1" revision=3a890412d4148b4d80aaf4423c190839e517d050 span.kind=server system=grpc username=root2061vm-test-run-nixbot-gitlab> gitlab # [ 195.272115] gitaly[1376]: time="2026-07-01T17:53:21.534Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=69 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5089 command.oublock=8 command.real_time_ms=106 command.spawn_token_fork_ms=5 command.system_time_ms=45 command.user_time_ms=24 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0RBNJ65QBQST617DJTSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-01T17:53:31.236" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:21.416" grpc.time_ms=117.659 pid=1376 ref=refs/keep-around/3a890412d4148b4d80aaf4423c190839e517d050 remote_ip="2001:db8:1::1" revision=3a890412d4148b4d80aaf4423c190839e517d050 span.kind=server system=grpc username=root2062vm-test-run-nixbot-gitlab> gitlab # [ 195.273605] sidekiq-cluster[2096]: {"severity":"WARN","time":"2026-07-01T17:53:21.546Z","class":"CreatePipelineWorker","correlation_id":"01KWFD0QDQW2E7Y87YYBE7W98N","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"3a890412d4148b4d80aaf4423c190839e517d050","after":"7be4070670fca3c68e199d7f7820643000a5b0a0","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"7be4070670fca3c68e199d7f7820643000a5b0a0","ref":"refs/heads/master"},"retry":0}2063vm-test-run-nixbot-gitlab> gitlab # [ 195.274585] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:21.551Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"605d9cd4b6f24fee6410756c","created_at":"2026-07-01T17:53:20.689Z","trace_propagation_headers":{"sentry-trace":"f02b59b692c14ee28da9ef8827b80565-8fb0c544745c4c81","baggage":"sentry-trace_id=f02b59b692c14ee28da9ef8827b80565,sentry-release=Unknown"},"correlation_id":"01KWFD0QDQW2E7Y87YYBE7W98N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:27192eea8c24ecd1033bc6897fe1d33c6aff3e0d97bc68b9e8c01875d968e128","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:20.691Z","job_size_bytes":467,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-605d9cd4b6f24fee6410756c: done: 0.574559 sec","job_status":"done","queue_duration_s":0.285008,"scheduling_latency_s":0.28503,"gitaly_calls":7,"gitaly_duration_s":0.091767,"redis_calls":33,"redis_duration_s":0.006917,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000648,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00223,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003059,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":30,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":26,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.44719,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.574559,"completed_at":"2026-07-01T17:53:21.551Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022753,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2064vm-test-run-nixbot-gitlab> gitlab # [ 195.349831] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:21.553Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"5d23daf8-d657-4994-aa48-88092d8e0edb\"}"],"class":"WebHookWorker","jid":"109a6af4538cfcaab6918c47","created_at":"2026-07-01T17:53:20.802Z","trace_propagation_headers":{"sentry-trace":"f02b59b692c14ee28da9ef8827b80565-8fb0c544745c4c81","baggage":"sentry-trace_id=f02b59b692c14ee28da9ef8827b80565,sentry-release=Unknown"},"correlation_id":"01KWFD0QDQW2E7Y87YYBE7W98N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8ff63c0660c570d9248591750e0493354b155445b0fcf310f4ed750aa1ca3d7c","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:20.808Z","job_size_bytes":1749,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-109a6af4538cfcaab6918c47: start","job_status":"start","queue_duration_s":0.744155,"scheduling_latency_s":0.744183}2065vm-test-run-nixbot-gitlab> gitlab # [ 195.352283] gitaly[1376]: time="2026-07-01T17:53:21.535Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0QDQW2E7Y87YYBE7W98N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-07-01T17:53:51.509" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:21.509" grpc.time_ms=25.344 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2066vm-test-run-nixbot-gitlab> gitlab # [ 195.359449] nixbot[3038]: INFO: ::ffff:127.0.0.1:48628 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2067vm-test-run-nixbot-gitlab> gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7be4070670fca3c68e199d7f7820643000a5b0a0'2068vm-test-run-nixbot-gitlab> gitlab # [ 195.361456] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:21.632Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"5d23daf8-d657-4994-aa48-88092d8e0edb\"}"],"class":"WebHookWorker","jid":"109a6af4538cfcaab6918c47","created_at":"2026-07-01T17:53:20.802Z","trace_propagation_headers":{"sentry-trace":"f02b59b692c14ee28da9ef8827b80565-8fb0c544745c4c81","baggage":"sentry-trace_id=f02b59b692c14ee28da9ef8827b80565,sentry-release=Unknown"},"correlation_id":"01KWFD0QDQW2E7Y87YYBE7W98N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8ff63c0660c570d9248591750e0493354b155445b0fcf310f4ed750aa1ca3d7c","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:20.808Z","job_size_bytes":1749,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-109a6af4538cfcaab6918c47: done: 0.079724 sec","job_status":"done","queue_duration_s":0.744155,"scheduling_latency_s":0.744183,"redis_calls":19,"redis_duration_s":0.004146,"redis_read_bytes":31,"redis_write_bytes":5282,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001023,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000339,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3644,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00194,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000844,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.007457092999999304,"cpu_s":0.058031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039614,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","duration_s":0.079724,"completed_at":"2026-07-01T17:53:21.632Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001728,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2069vm-test-run-nixbot-gitlab> gitlab # [ 195.486331] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:21.637Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"2a7a929904c0b50a3a5c03f9","created_at":"2026-07-01T17:53:21.541Z","trace_propagation_headers":{"sentry-trace":"92d9ac8aa85e468c947a682265f77607-f1eb804bbf4249ef","baggage":"sentry-trace_id=92d9ac8aa85e468c947a682265f77607,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0RBNJ65QBQST617DJTSN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:21.547Z","job_size_bytes":65,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-2a7a929904c0b50a3a5c03f9: start","job_status":"start","queue_duration_s":0.089382,"scheduling_latency_s":0.089417}2070vm-test-run-nixbot-gitlab> gitlab # [ 195.490211] gitaly[1376]: time="2026-07-01T17:53:21.538Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0RBNJ65QBQST617DJTSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:51.237" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:21.538" grpc.time_ms=0.329 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2071vm-test-run-nixbot-gitlab> gitlab # [ 195.491379] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:21 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3a890412d4148b4d80aaf4423c190839e517d050 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 9132072vm-test-run-nixbot-gitlab> gitlab # [ 195.492204] nixbot[3038]: {"ts": "2026-07-01T17:53:21.670Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3a890412d4148b4d80aaf4423c190839e517d050 \"HTTP/1.1 201 Created\""}2073vm-test-run-nixbot-gitlab> gitlab # [ 195.495142] nixbot[3038]: {"ts": "2026-07-01T17:53:21.680Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-3a890412d414-442a5ecb", "argv0": "bwrap"}2074vm-test-run-nixbot-gitlab> gitlab # [ 195.498267] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:21.691Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"2a7a929904c0b50a3a5c03f9","created_at":"2026-07-01T17:53:21.541Z","trace_propagation_headers":{"sentry-trace":"92d9ac8aa85e468c947a682265f77607-f1eb804bbf4249ef","baggage":"sentry-trace_id=92d9ac8aa85e468c947a682265f77607,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0RBNJ65QBQST617DJTSN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:21.547Z","job_size_bytes":65,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-2a7a929904c0b50a3a5c03f9: done: 0.054779 sec","job_status":"done","queue_duration_s":0.089382,"scheduling_latency_s":0.089417,"redis_calls":18,"redis_duration_s":0.00448,"redis_read_bytes":271,"redis_write_bytes":2103,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002349,"redis_feature_flag_read_bytes":264,"redis_feature_flag_write_bytes":1285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001654,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000477,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028254,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003872,"duration_s":0.054779,"completed_at":"2026-07-01T17:53:21.691Z","load_balancing_strategy":"primary","db_duration_s":0.016432,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2075vm-test-run-nixbot-gitlab> gitlab # [ 195.572220] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:21.693Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"7da7424984dd44def258b779","created_at":"2026-07-01T17:53:21.548Z","trace_propagation_headers":{"sentry-trace":"92d9ac8aa85e468c947a682265f77607-f1eb804bbf4249ef","baggage":"sentry-trace_id=92d9ac8aa85e468c947a682265f77607,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0RBNJ65QBQST617DJTSN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:21.552Z","job_size_bytes":65,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-7da7424984dd44def258b779: start","job_status":"start","queue_duration_s":0.141013,"scheduling_latency_s":0.141035}2076vm-test-run-nixbot-gitlab> gitlab # [ 195.648126] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:21.747Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"7da7424984dd44def258b779","created_at":"2026-07-01T17:53:21.548Z","trace_propagation_headers":{"sentry-trace":"92d9ac8aa85e468c947a682265f77607-f1eb804bbf4249ef","baggage":"sentry-trace_id=92d9ac8aa85e468c947a682265f77607,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0RBNJ65QBQST617DJTSN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:21.552Z","job_size_bytes":65,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-7da7424984dd44def258b779: done: 0.053755 sec","job_status":"done","queue_duration_s":0.141013,"scheduling_latency_s":0.141035,"redis_calls":15,"redis_duration_s":0.003551,"redis_read_bytes":142,"redis_write_bytes":1431,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000683,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":431,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001344,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001524,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000393626,"duration_s":0.053755,"completed_at":"2026-07-01T17:53:21.747Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009253,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2077vm-test-run-nixbot-gitlab> gitlab # [ 195.731040] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:21.748Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","109a6af4538cfcaab6918c47"],"class":"WebHooks::LogExecutionWorker","jid":"72abad2c553e34cabba3237e","created_at":"2026-07-01T17:53:21.618Z","trace_propagation_headers":{"sentry-trace":"f02b59b692c14ee28da9ef8827b80565-3890345403474eef","baggage":"sentry-trace_id=f02b59b692c14ee28da9ef8827b80565,sentry-release=Unknown"},"correlation_id":"01KWFD0QDQW2E7Y87YYBE7W98N","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:87a26d3025a39ecd596ddd5732df06a05e98c4dded3c3ee20e5d08a8b103fcb4","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:21.623Z","job_size_bytes":2507,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-72abad2c553e34cabba3237e: start","job_status":"start","queue_duration_s":0.125285,"scheduling_latency_s":0.125352}2078vm-test-run-nixbot-gitlab> gitlab # [ 195.735288] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:21.846Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","109a6af4538cfcaab6918c47"],"class":"WebHooks::LogExecutionWorker","jid":"72abad2c553e34cabba3237e","created_at":"2026-07-01T17:53:21.618Z","trace_propagation_headers":{"sentry-trace":"f02b59b692c14ee28da9ef8827b80565-3890345403474eef","baggage":"sentry-trace_id=f02b59b692c14ee28da9ef8827b80565,sentry-release=Unknown"},"correlation_id":"01KWFD0QDQW2E7Y87YYBE7W98N","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:87a26d3025a39ecd596ddd5732df06a05e98c4dded3c3ee20e5d08a8b103fcb4","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:21.623Z","job_size_bytes":2507,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-72abad2c553e34cabba3237e: done: 0.097847 sec","job_status":"done","queue_duration_s":0.125285,"scheduling_latency_s":0.125352,"redis_calls":10,"redis_duration_s":0.003077,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000748,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001618,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000711,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.023,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.023,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000369042,"duration_s":0.097847,"completed_at":"2026-07-01T17:53:21.846Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005897,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2079vm-test-run-nixbot-gitlab> gitlab # [ 195.767948] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:21.848Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"2fd59dce66a0b3091de2998e","created_at":"2026-07-01T17:53:21.652Z","trace_propagation_headers":{"sentry-trace":"92d9ac8aa85e468c947a682265f77607-f1eb804bbf4249ef","baggage":"sentry-trace_id=92d9ac8aa85e468c947a682265f77607,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0RBNJ65QBQST617DJTSN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:21.657Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2fd59dce66a0b3091de2998e: start","job_status":"start","queue_duration_s":0.190439,"scheduling_latency_s":0.190461}2080vm-test-run-nixbot-gitlab> gitlab # [ 195.856964] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:21.977Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"2fd59dce66a0b3091de2998e","created_at":"2026-07-01T17:53:21.652Z","trace_propagation_headers":{"sentry-trace":"92d9ac8aa85e468c947a682265f77607-f1eb804bbf4249ef","baggage":"sentry-trace_id=92d9ac8aa85e468c947a682265f77607,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0RBNJ65QBQST617DJTSN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:21.657Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2fd59dce66a0b3091de2998e: done: 0.128955 sec","job_status":"done","queue_duration_s":0.190439,"scheduling_latency_s":0.190461,"gitaly_calls":3,"gitaly_duration_s":0.007879,"redis_calls":48,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.009611,"redis_read_bytes":208,"redis_write_bytes":6802,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001323,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":16,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.001243,"redis_cache_read_bytes":32,"redis_cache_write_bytes":1470,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.001612,"redis_feature_flag_read_bytes":134,"redis_feature_flag_write_bytes":992,"redis_queues_calls":2,"redis_queues_duration_s":0.000278,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.002011,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":840,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000553,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000215,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":34,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":34,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":22,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.086588,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.104037804,"duration_s":0.128955,"completed_at":"2026-07-01T17:53:21.977Z","load_balancing_strategy":"primary","db_duration_s":0.030299,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2081vm-test-run-nixbot-gitlab> gitlab # [ 195.877983] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:21.978Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"2c77760ecd66e105f6af34b2","created_at":"2026-07-01T17:53:21.902Z","trace_propagation_headers":{"sentry-trace":"92d9ac8aa85e468c947a682265f77607-a1d223ed824943cd","baggage":"sentry-trace_id=92d9ac8aa85e468c947a682265f77607,sentry-release=Unknown"},"correlation_id":"01KWFD0RBNJ65QBQST617DJTSN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:21.906Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-2c77760ecd66e105f6af34b2: start","job_status":"start","queue_duration_s":0.072294,"scheduling_latency_s":0.072315}2082vm-test-run-nixbot-gitlab> gitlab # [ 195.904293] gitaly[1376]: time="2026-07-01T17:53:21.917Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0RBNJ65QBQST617DJTSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-01T17:53:51.315" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:21.916" grpc.time_ms=0.8 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2083vm-test-run-nixbot-gitlab> gitlab # [ 195.975181] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:22.139Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"2c77760ecd66e105f6af34b2","created_at":"2026-07-01T17:53:21.902Z","trace_propagation_headers":{"sentry-trace":"92d9ac8aa85e468c947a682265f77607-a1d223ed824943cd","baggage":"sentry-trace_id=92d9ac8aa85e468c947a682265f77607,sentry-release=Unknown"},"correlation_id":"01KWFD0RBNJ65QBQST617DJTSN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:21.906Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-2c77760ecd66e105f6af34b2: done: 0.160804 sec","job_status":"done","queue_duration_s":0.072294,"scheduling_latency_s":0.072315,"redis_calls":10,"redis_duration_s":0.003187,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00136,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001391,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000436,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.133,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.132,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000391111,"duration_s":0.160804,"completed_at":"2026-07-01T17:53:22.139Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.133163,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2084vm-test-run-nixbot-gitlab> gitlab # [ 195.994345] gitaly[1376]: time="2026-07-01T17:53:21.948Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0RBNJ65QBQST617DJTSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:51.347" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:21.948" grpc.time_ms=0.558 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2085vm-test-run-nixbot-gitlab> gitlab # [ 196.065147] gitaly[1376]: time="2026-07-01T17:53:21.968Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0RBNJ65QBQST617DJTSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:51.367" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:21.967" grpc.time_ms=0.563 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2086vm-test-run-nixbot-gitlab> gitlab # [ 196.110558] gitaly[1376]: time="2026-07-01T17:53:22.391Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=643 command.spawn_token_fork_ms=639 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0S9EQS50Q33CV8STGYMZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:21.745" grpc.time_ms=645.253 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc2087vm-test-run-nixbot-gitlab> gitlab # [ 196.131742] nixbot[3038]: INFO: ::ffff:127.0.0.1:48638 - "GET /api/repos/gitlab/root/test-flake/builds?commit=7be4070670fca3c68e199d7f7820643000a5b0a0 HTTP/1.1" 200 OK2088vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7be4070670fca3c68e199d7f7820643000a5b0a0', in 0.64 seconds)2089vm-test-run-nixbot-gitlab> []2090vm-test-run-nixbot-gitlab> gitlab # [ 196.136490] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:22 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 7062091vm-test-run-nixbot-gitlab> gitlab # [ 196.192339] systemd[1]: Started Nix Daemon.2092vm-test-run-nixbot-gitlab> gitlab # [ 196.202806] gitaly[1376]: time="2026-07-01T17:53:22.482Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0SZJJV6TYYZG3RCFX4H5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:22.474" pid=1376 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc2093vm-test-run-nixbot-gitlab> gitlab # [ 196.221341] gitaly[1376]: time="2026-07-01T17:53:22.482Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0SZJJV6TYYZG3RCFX4H5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:22.474" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc2094vm-test-run-nixbot-gitlab> gitlab # [ 196.222421] gitlab-workhorse[1284]: time="2026-07-01T17:53:22Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672095vm-test-run-nixbot-gitlab> gitlab # [ 196.223219] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:22 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 652096vm-test-run-nixbot-gitlab> gitlab # [ 196.224283] gitaly[1376]: time="2026-07-01T17:53:22.483Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0SZJJV6TYYZG3RCFX4H5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-01T17:53:22.474" grpc.time_ms=8.976 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc2097vm-test-run-nixbot-gitlab> gitlab # [ 196.232413] nix-daemon[3339]: accepted connection from pid 3338, user nixbot2098vm-test-run-nixbot-gitlab> gitlab # [ 196.234694] nix-daemon[3339]: accepted connection from pid 3337, user nixbot2099vm-test-run-nixbot-gitlab> gitlab # [ 196.285313] nixbot[3038]: {"ts": "2026-07-01T17:53:22.565Z", "level": "info", "logger": "nixbot.canceller", "msg": "cancelling build", "build_id": 1, "reason": "superseded"}2100vm-test-run-nixbot-gitlab> gitlab # [ 196.292186] nix-daemon[3352]: unexpected Nix daemon error: error: interrupted by the user2101vm-test-run-nixbot-gitlab> gitlab # [ 196.338844] gitaly[1376]: time="2026-07-01T17:53:22.619Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0T48FC6JBRJ6CB288WBC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:52.418" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:22.618" grpc.time_ms=0.62 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2102vm-test-run-nixbot-gitlab> gitlab # [ 196.374984] gitaly[1376]: time="2026-07-01T17:53:22.655Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0T4YG353E5K4VS95FHFW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:52.053" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:22.654" grpc.time_ms=0.598 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2103vm-test-run-nixbot-gitlab> gitlab # [ 196.406714] gitaly[1376]: time="2026-07-01T17:53:22.687Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0T48FC6JBRJ6CB288WBC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-07-01T17:53:52.478" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:22.678" grpc.time_ms=8.356 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2104vm-test-run-nixbot-gitlab> gitlab # [ 196.441427] gitaly[1376]: time="2026-07-01T17:53:22.722Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0T4YG353E5K4VS95FHFW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-01T17:53:32.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:22.715" grpc.time_ms=6.252 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2105vm-test-run-nixbot-gitlab> gitlab # [ 196.463171] gitaly[1376]: time="2026-07-01T17:53:22.743Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0T48FC6JBRJ6CB288WBC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-01T17:53:32.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:22.716" grpc.time_ms=26.589 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2106vm-test-run-nixbot-gitlab> gitlab # [ 196.475414] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:22.754Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"2761705525ff94ae05cd4c0f","created_at":"2026-07-01T17:53:22.748Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-b8b5b21c651a4712","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:22.751Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2761705525ff94ae05cd4c0f: start","job_status":"start","queue_duration_s":0.002714,"scheduling_latency_s":0.00275}2107vm-test-run-nixbot-gitlab> gitlab # [ 196.486476] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:22 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3a890412d4148b4d80aaf4423c190839e517d050 HTTP/1.1" 201 651 "" "python-httpx/0.28.1" 1762108vm-test-run-nixbot-gitlab> gitlab # [ 196.498874] nixbot[3038]: {"ts": "2026-07-01T17:53:22.779Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3a890412d4148b4d80aaf4423c190839e517d050 \"HTTP/1.1 201 Created\""}2109vm-test-run-nixbot-gitlab> gitlab # [ 196.519088] gitaly[1376]: time="2026-07-01T17:53:22.799Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0T48FC6JBRJ6CB288WBC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-01T17:53:32.088" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:22.799" grpc.time_ms=0.222 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2110vm-test-run-nixbot-gitlab> gitlab # [ 196.529887] gitaly[1376]: time="2026-07-01T17:53:22.810Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=619 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0T48FC6JBRJ6CB288WBC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-01T17:53:32.094" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:22.804" grpc.time_ms=5.841 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2111vm-test-run-nixbot-gitlab> gitlab # [ 196.560114] gitaly[1376]: time="2026-07-01T17:53:22.840Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0TB0SR80TDVDAZ5VJE0K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:52.228" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:22.839" grpc.time_ms=0.791 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2112vm-test-run-nixbot-gitlab> gitlab # [ 196.574929] gitaly[1376]: time="2026-07-01T17:53:22.855Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0T48FC6JBRJ6CB288WBC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4159 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:22.855" grpc.time_ms=0.297 pid=1376 span.kind=server system=grpc2113vm-test-run-nixbot-gitlab> gitlab # [ 196.592510] gitaly[1376]: time="2026-07-01T17:53:22.873Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0TB0SR80TDVDAZ5VJE0K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-01T17:53:32.156" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:22.866" grpc.time_ms=6.202 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2114vm-test-run-nixbot-gitlab> gitlab # [ 196.633152] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:22 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3a890412d4148b4d80aaf4423c190839e517d050 HTTP/1.1" 201 665 "" "python-httpx/0.28.1" 1282115vm-test-run-nixbot-gitlab> gitlab # [ 196.635342] nixbot[3038]: {"ts": "2026-07-01T17:53:22.915Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3a890412d4148b4d80aaf4423c190839e517d050 \"HTTP/1.1 201 Created\""}2116vm-test-run-nixbot-gitlab> gitlab # [ 196.645800] gitaly[1376]: time="2026-07-01T17:53:22.926Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0T48FC6JBRJ6CB288WBC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4161 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:22.926" grpc.time_ms=0.306 pid=1376 span.kind=server system=grpc2117vm-test-run-nixbot-gitlab> gitlab # [ 196.667148] gitaly[1376]: time="2026-07-01T17:53:22.947Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0T4YG353E5K4VS95FHFW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:22.947" grpc.time_ms=0.35 pid=1376 span.kind=server system=grpc2118vm-test-run-nixbot-gitlab> gitlab # [ 196.672287] gitaly[1376]: time="2026-07-01T17:53:22.952Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0T48FC6JBRJ6CB288WBC diskcache=0b459110-3a98-400a-ba4a-3e50fc32ae70 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-01T17:53:32.104" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:22.814" pid=1376 ref=refs/keep-around/7be4070670fca3c68e199d7f7820643000a5b0a0 remote_ip="2001:db8:1::1" revision=7be4070670fca3c68e199d7f7820643000a5b0a0 span.kind=server system=grpc username=root2119vm-test-run-nixbot-gitlab> gitlab # [ 196.673266] gitaly[1376]: time="2026-07-01T17:53:22.953Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=74 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5177 command.oublock=8 command.real_time_ms=128 command.spawn_token_fork_ms=1 command.system_time_ms=54 command.user_time_ms=20 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0T48FC6JBRJ6CB288WBC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-01T17:53:32.104" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-01T17:53:22.814" grpc.time_ms=138.362 pid=1376 ref=refs/keep-around/7be4070670fca3c68e199d7f7820643000a5b0a0 remote_ip="2001:db8:1::1" revision=7be4070670fca3c68e199d7f7820643000a5b0a0 span.kind=server system=grpc username=root2120vm-test-run-nixbot-gitlab> gitlab # [ 196.675967] gitaly[1376]: time="2026-07-01T17:53:22.956Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0T48FC6JBRJ6CB288WBC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:52.755" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:22.956" grpc.time_ms=0.373 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2121vm-test-run-nixbot-gitlab> gitlab # [ 196.768340] gitaly[1376]: time="2026-07-01T17:53:23.048Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0T4YG353E5K4VS95FHFW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3901 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:23.048" grpc.time_ms=0.42 pid=1376 span.kind=server system=grpc2122vm-test-run-nixbot-gitlab> gitlab # [ 196.808282] gitaly[1376]: time="2026-07-01T17:53:23.088Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0T4YG353E5K4VS95FHFW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:23.088" grpc.time_ms=0.355 pid=1376 span.kind=server system=grpc2123vm-test-run-nixbot-gitlab> gitlab # [ 196.833044] gitaly[1376]: time="2026-07-01T17:53:23.113Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0T4YG353E5K4VS95FHFW diskcache=49b573c8-5653-49e5-b8fc-54044eb432a3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-01T17:53:52.239" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:22.840" pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2124vm-test-run-nixbot-gitlab> gitlab # [ 196.834641] gitaly[1376]: time="2026-07-01T17:53:23.114Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=157 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7235 command.oublock=0 command.real_time_ms=207 command.spawn_token_fork_ms=0 command.system_time_ms=123 command.user_time_ms=34 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0T4YG353E5K4VS95FHFW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-01T17:53:52.239" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:22.840" grpc.time_ms=272.859 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2125vm-test-run-nixbot-gitlab> gitlab # [ 196.856622] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:23 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7be4070670fca3c68e199d7f7820643000a5b0a0 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 5672126vm-test-run-nixbot-gitlab> gitlab # [ 196.857961] nixbot[3038]: {"ts": "2026-07-01T17:53:23.138Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7be4070670fca3c68e199d7f7820643000a5b0a0 \"HTTP/1.1 201 Created\""}2127vm-test-run-nixbot-gitlab> gitlab # [ 196.864966] nixbot[3038]: {"ts": "2026-07-01T17:53:23.145Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-7be4070670fc-22d2745f", "argv0": "bwrap"}2128vm-test-run-nixbot-gitlab> gitlab # [ 196.900276] gitaly[1376]: time="2026-07-01T17:53:23.180Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0T4YG353E5K4VS95FHFW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-01T17:53:53.179" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:23.180" grpc.time_ms=0.719 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2129vm-test-run-nixbot-gitlab> gitlab # [ 196.922919] gitaly[1376]: time="2026-07-01T17:53:23.203Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0T4YG353E5K4VS95FHFW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:53.201" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:23.202" grpc.time_ms=0.555 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2130vm-test-run-nixbot-gitlab> gitlab # [ 196.953140] gitaly[1376]: time="2026-07-01T17:53:23.233Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0T4YG353E5K4VS95FHFW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:53.232" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:23.232" grpc.time_ms=0.543 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2131vm-test-run-nixbot-gitlab> gitlab # [ 196.960659] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.241Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"85ea0c702ddbf485947225bc","created_at":"2026-07-01T17:53:23.239Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"2761705525ff94ae05cd4c0f","job_size_bytes":3,"pid":2096,"job_status":"deduplicated","message":"PipelineProcessWorker JID-85ea0c702ddbf485947225bc: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2132vm-test-run-nixbot-gitlab> gitlab # [ 196.962251] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.242Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"2761705525ff94ae05cd4c0f","created_at":"2026-07-01T17:53:22.748Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-b8b5b21c651a4712","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:22.751Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2096,"job_status":"rescheduled","message":"PipelineProcessWorker JID-2761705525ff94ae05cd4c0f: rescheduled"}2133vm-test-run-nixbot-gitlab> gitlab # [ 196.967714] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.248Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"2761705525ff94ae05cd4c0f","created_at":"2026-07-01T17:53:22.748Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-b8b5b21c651a4712","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:22.751Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2761705525ff94ae05cd4c0f: done: 0.493813 sec","job_status":"done","queue_duration_s":0.002714,"scheduling_latency_s":0.00275,"gitaly_calls":4,"gitaly_duration_s":0.290918,"redis_calls":104,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.025298,"redis_read_bytes":267,"redis_write_bytes":24006,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001364,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":17,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.002947,"redis_cache_read_bytes":33,"redis_cache_write_bytes":1526,"redis_feature_flag_calls":22,"redis_feature_flag_duration_s":0.0073,"redis_feature_flag_read_bytes":22,"redis_feature_flag_write_bytes":3871,"redis_queues_calls":22,"redis_queues_duration_s":0.003406,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12385,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.00561,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00026,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000777,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00227,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":850,"db_count":47,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.015,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.018,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.141808,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.461757849,"duration_s":0.493813,"completed_at":"2026-07-01T17:53:23.248Z","load_balancing_strategy":"primary","db_duration_s":0.041523,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2134vm-test-run-nixbot-gitlab> gitlab # [ 197.046106] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.249Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"f1aeef52b5e0edf0b0f7e673","created_at":"2026-07-01T17:53:22.823Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:22.827Z","job_size_bytes":23,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-f1aeef52b5e0edf0b0f7e673: start","job_status":"start","queue_duration_s":0.422372,"scheduling_latency_s":0.422396}2135vm-test-run-nixbot-gitlab> gitlab # [ 197.060804] nix-daemon[3339]: accepted connection from pid 3427, user nixbot2136vm-test-run-nixbot-gitlab> gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7be4070670fca3c68e199d7f7820643000a5b0a0'2137vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7be4070670fca3c68e199d7f7820643000a5b0a0', in 0.03 seconds)2138vm-test-run-nixbot-gitlab> [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '7be4070670fca3c68e199d7f7820643000a5b0a0', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': [{'level': 'warning', 'message': "unable to download 'https://cache.nixos.org/…': Could not resolve hostname (6) Could not resolve host: cache.nixos.org", 'count': 1}], 'error': None, 'created_at': '2026-07-01T17:53:22.559247Z', 'started_at': '2026-07-01T17:53:23.139991Z', 'finished_at': None}]2139vm-test-run-nixbot-gitlab> (finished: subtest: push delivers the webhook, in 3.88 seconds)2140vm-test-run-nixbot-gitlab> subtest: eval and build post commit statuses2141vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses2142vm-test-run-nixbot-gitlab> gitlab # [ 197.064449] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.344Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"f1aeef52b5e0edf0b0f7e673","created_at":"2026-07-01T17:53:22.823Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:22.827Z","job_size_bytes":23,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-f1aeef52b5e0edf0b0f7e673: done: 0.09519 sec","job_status":"done","queue_duration_s":0.422372,"scheduling_latency_s":0.422396,"redis_calls":15,"redis_duration_s":0.004863,"redis_read_bytes":13,"redis_write_bytes":3011,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000422,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_calls":2,"redis_queues_duration_s":0.001102,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1626,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002248,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":742,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000512,"redis_rate_limiting_write_bytes":148,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000579,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":13,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":13,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066527,"worker_id":"sidekiq_0","rate_limiting_gates":["permanent_email_failure","temporary_email_failure"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043134,"duration_s":0.09519,"completed_at":"2026-07-01T17:53:23.344Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010101,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2143vm-test-run-nixbot-gitlab> gitlab # [ 197.142143] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.346Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ffbec3d3f8711885b3a5f4ea","created_at":"2026-07-01T17:53:22.960Z","trace_propagation_headers":{"sentry-trace":"4d111a49f4c44c72a6f379ad9ea71026-0db02aa03ca84459","baggage":"sentry-trace_id=4d111a49f4c44c72a6f379ad9ea71026,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0T48FC6JBRJ6CB288WBC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:22.963Z","job_size_bytes":65,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ffbec3d3f8711885b3a5f4ea: start","job_status":"start","queue_duration_s":0.382517,"scheduling_latency_s":0.382539}2144vm-test-run-nixbot-gitlab> gitlab # [ 197.164776] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.367Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ffbec3d3f8711885b3a5f4ea","created_at":"2026-07-01T17:53:22.960Z","trace_propagation_headers":{"sentry-trace":"4d111a49f4c44c72a6f379ad9ea71026-0db02aa03ca84459","baggage":"sentry-trace_id=4d111a49f4c44c72a6f379ad9ea71026,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0T48FC6JBRJ6CB288WBC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:22.963Z","job_size_bytes":65,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ffbec3d3f8711885b3a5f4ea: done: 0.021476 sec","job_status":"done","queue_duration_s":0.382517,"scheduling_latency_s":0.382539,"redis_calls":7,"redis_duration_s":0.001647,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001159,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000488,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021476,"completed_at":"2026-07-01T17:53:23.367Z","load_balancing_strategy":"primary","db_duration_s":0.002513,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2145vm-test-run-nixbot-gitlab> gitlab # [ 197.237566] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.369Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"aa01689ae60bb6897f4b2f2a","created_at":"2026-07-01T17:53:23.331Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-94485f7475424b5b","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineNotificationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:76f52fe8f4735b4bff77b4f073d422bc256f64ecf9eece2f9649406450057a80","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.336Z","job_size_bytes":464,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-aa01689ae60bb6897f4b2f2a: start","job_status":"start","queue_duration_s":0.032414,"scheduling_latency_s":0.032439}2146vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses, in 0.29 seconds)2147vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '7be4070670fca3c68e199d7f7820643000a5b0a0', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-07-01T17:53:23.111Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2148vm-test-run-nixbot-gitlab> gitlab # [ 197.322220] sidekiq-cluster[2096]: {"severity":"WARN","time":"2026-07-01T17:53:23.398Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"aa01689ae60bb6897f4b2f2a","created_at":"2026-07-01T17:53:23.331Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-94485f7475424b5b","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineNotificationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:76f52fe8f4735b4bff77b4f073d422bc256f64ecf9eece2f9649406450057a80","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.336Z","job_size_bytes":464,"pid":2096,"sidekiq_tid":"m46o","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-aa01689ae60bb6897f4b2f2a: fail: 0.029256 sec","job_status":"fail","queue_duration_s":0.032414,"scheduling_latency_s":0.032439,"redis_calls":7,"redis_duration_s":0.001781,"redis_read_bytes":5,"redis_write_bytes":786,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001152,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000629,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029256,"completed_at":"2026-07-01T17:53:23.398Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/pipelines.rb:33:in `pipeline_mail'","app/mailers/emails/pipelines.rb:10:in `pipeline_failed_email'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/abbaw4w9gll6p923md75p3h3rrmhrdqn-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/bqz31s23z0jk4464lbybyz83ikl0gmyd-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/wp2rnxa243q2gn2f8h04d48hnvfr0387-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/85h4805ad7n5qn7wq2m6icypga7rnk80-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.004093,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2149vm-test-run-nixbot-gitlab> gitlab # [ 197.877099] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.401Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"4c1b170cfd473057c40e6223","created_at":"2026-07-01T17:53:22.964Z","trace_propagation_headers":{"sentry-trace":"4d111a49f4c44c72a6f379ad9ea71026-0db02aa03ca84459","baggage":"sentry-trace_id=4d111a49f4c44c72a6f379ad9ea71026,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0T48FC6JBRJ6CB288WBC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:22.966Z","job_size_bytes":65,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-4c1b170cfd473057c40e6223: start","job_status":"start","queue_duration_s":0.434823,"scheduling_latency_s":0.43486}2150vm-test-run-nixbot-gitlab> gitlab # [ 197.888214] nixbot[3038]: INFO: ::ffff:127.0.0.1:48644 - "GET /api/repos/gitlab/root/test-flake/builds?commit=7be4070670fca3c68e199d7f7820643000a5b0a0 HTTP/1.1" 200 OK2151vm-test-run-nixbot-gitlab> gitlab # [ 197.890514] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 2622152vm-test-run-nixbot-gitlab> gitlab # [ 197.894494] gitaly[1376]: time="2026-07-01T17:53:23.688Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0T48FC6JBRJ6CB288WBC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-01T17:53:53.085" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:23.687" grpc.time_ms=0.997 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2153vm-test-run-nixbot-gitlab> gitlab # [ 197.967451] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.444Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"4c1b170cfd473057c40e6223","created_at":"2026-07-01T17:53:22.964Z","trace_propagation_headers":{"sentry-trace":"4d111a49f4c44c72a6f379ad9ea71026-0db02aa03ca84459","baggage":"sentry-trace_id=4d111a49f4c44c72a6f379ad9ea71026,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0T48FC6JBRJ6CB288WBC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:22.966Z","job_size_bytes":65,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-4c1b170cfd473057c40e6223: done: 0.042966 sec","job_status":"done","queue_duration_s":0.434823,"scheduling_latency_s":0.43486,"redis_calls":10,"redis_duration_s":0.004141,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002995,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001146,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042966,"completed_at":"2026-07-01T17:53:23.444Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010343,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2154vm-test-run-nixbot-gitlab> gitlab # [ 197.983363] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.445Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"26bdc3b7357c7c7361b77624","created_at":"2026-07-01T17:53:23.117Z","trace_propagation_headers":{"sentry-trace":"4d111a49f4c44c72a6f379ad9ea71026-0db02aa03ca84459","baggage":"sentry-trace_id=4d111a49f4c44c72a6f379ad9ea71026,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0T48FC6JBRJ6CB288WBC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.121Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-26bdc3b7357c7c7361b77624: start","job_status":"start","queue_duration_s":0.324711,"scheduling_latency_s":0.324735}2155vm-test-run-nixbot-gitlab> gitlab # [ 198.052518] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.752Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"26bdc3b7357c7c7361b77624","created_at":"2026-07-01T17:53:23.117Z","trace_propagation_headers":{"sentry-trace":"4d111a49f4c44c72a6f379ad9ea71026-0db02aa03ca84459","baggage":"sentry-trace_id=4d111a49f4c44c72a6f379ad9ea71026,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0T48FC6JBRJ6CB288WBC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.121Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-26bdc3b7357c7c7361b77624: done: 0.30642 sec","job_status":"done","queue_duration_s":0.324711,"scheduling_latency_s":0.324735,"gitaly_calls":3,"gitaly_duration_s":0.010714,"redis_calls":44,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.008981,"redis_read_bytes":99,"redis_write_bytes":6014,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001055,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.002409,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_queues_calls":2,"redis_queues_duration_s":0.000376,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00163,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000416,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000917,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001123,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":31,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":31,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":19,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.126448,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.287516709,"duration_s":0.30642,"completed_at":"2026-07-01T17:53:23.752Z","load_balancing_strategy":"primary","db_duration_s":0.029429,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2156vm-test-run-nixbot-gitlab> gitlab # [ 198.136307] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.753Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a72f80c15368ae3d94920858","created_at":"2026-07-01T17:53:23.119Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.124Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a72f80c15368ae3d94920858: start","job_status":"start","queue_duration_s":0.628817,"scheduling_latency_s":0.628839}2157vm-test-run-nixbot-gitlab> gitlab # [ 198.137869] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.776Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a72f80c15368ae3d94920858","created_at":"2026-07-01T17:53:23.119Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.124Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a72f80c15368ae3d94920858: done: 0.023094 sec","job_status":"done","queue_duration_s":0.628817,"scheduling_latency_s":0.628839,"redis_calls":10,"redis_duration_s":0.002138,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000427,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001258,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000453,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000332444,"duration_s":0.023094,"completed_at":"2026-07-01T17:53:23.776Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002525,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2158vm-test-run-nixbot-gitlab> gitlab # [ 198.239369] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.778Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"77ac3858b64ea19390fab915","created_at":"2026-07-01T17:53:23.135Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.141Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-77ac3858b64ea19390fab915: start","job_status":"start","queue_duration_s":0.636166,"scheduling_latency_s":0.636187}2159vm-test-run-nixbot-gitlab> gitlab # [ 198.240397] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.914Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"77ac3858b64ea19390fab915","created_at":"2026-07-01T17:53:23.135Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.141Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-77ac3858b64ea19390fab915: done: 0.136343 sec","job_status":"done","queue_duration_s":0.636166,"scheduling_latency_s":0.636187,"redis_calls":10,"redis_duration_s":0.0024,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000482,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001434,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000484,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.111,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.111,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018833,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000366247,"duration_s":0.136343,"completed_at":"2026-07-01T17:53:23.914Z","load_balancing_strategy":"primary","db_duration_s":0.111184,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2160vm-test-run-nixbot-gitlab> gitlab # [ 198.333241] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.916Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"2b12d2e1cb8239e90910c5f8","created_at":"2026-07-01T17:53:23.153Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.157Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-2b12d2e1cb8239e90910c5f8: start","job_status":"start","queue_duration_s":0.758817,"scheduling_latency_s":0.758839}2161vm-test-run-nixbot-gitlab> gitlab # [ 198.334806] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.943Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"2b12d2e1cb8239e90910c5f8","created_at":"2026-07-01T17:53:23.153Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.157Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-2b12d2e1cb8239e90910c5f8: done: 0.027305 sec","job_status":"done","queue_duration_s":0.758817,"scheduling_latency_s":0.758839,"redis_calls":13,"redis_duration_s":0.002807,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000426,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001326,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000638,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000417,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000334958,"duration_s":0.027305,"completed_at":"2026-07-01T17:53:23.943Z","load_balancing_strategy":"primary","db_duration_s":0.002933,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2162vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses2163vm-test-run-nixbot-gitlab> gitlab # [ 198.409169] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.944Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"33ede205d4d4ab6fd0a2ffb4","created_at":"2026-07-01T17:53:23.157Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.160Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-33ede205d4d4ab6fd0a2ffb4: start","job_status":"start","queue_duration_s":0.783803,"scheduling_latency_s":0.783824}2164vm-test-run-nixbot-gitlab> gitlab # [ 198.410267] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.966Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"33ede205d4d4ab6fd0a2ffb4","created_at":"2026-07-01T17:53:23.157Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.160Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-33ede205d4d4ab6fd0a2ffb4: done: 0.022167 sec","job_status":"done","queue_duration_s":0.783803,"scheduling_latency_s":0.783824,"redis_calls":10,"redis_duration_s":0.002144,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000402,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001298,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000444,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000328813,"duration_s":0.022167,"completed_at":"2026-07-01T17:53:23.966Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00277,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2165vm-test-run-nixbot-gitlab> gitlab # [ 198.474121] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.968Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"6c4d75eb697147e45ad91f89","created_at":"2026-07-01T17:53:23.161Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.166Z","job_size_bytes":19,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-6c4d75eb697147e45ad91f89: start","job_status":"start","queue_duration_s":0.802038,"scheduling_latency_s":0.802058}2166vm-test-run-nixbot-gitlab> gitlab # [ 198.552837] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.991Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"6c4d75eb697147e45ad91f89","created_at":"2026-07-01T17:53:23.161Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.166Z","job_size_bytes":19,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-6c4d75eb697147e45ad91f89: done: 0.02348 sec","job_status":"done","queue_duration_s":0.802038,"scheduling_latency_s":0.802058,"redis_calls":11,"redis_duration_s":0.0025599999999999998,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000528,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001609,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000423,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000328533,"duration_s":0.02348,"completed_at":"2026-07-01T17:53:23.991Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002616,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2167vm-test-run-nixbot-gitlab> gitlab # [ 198.569387] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:23.992Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"failed\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"52e58145fd345d9be9b03b4a","created_at":"2026-07-01T17:53:23.168Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2e8f76273ed3dffe93170e4a8828cd9c1cde36f18ce9deaf751670cff2f2dad","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.172Z","job_size_bytes":65,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-52e58145fd345d9be9b03b4a: start","job_status":"start","queue_duration_s":0.820606,"scheduling_latency_s":0.820626}2168vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses, in 0.23 seconds)2169vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '7be4070670fca3c68e199d7f7820643000a5b0a0', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-07-01T17:53:23.111Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2170vm-test-run-nixbot-gitlab> gitlab # [ 198.597796] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:24.014Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"failed\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"52e58145fd345d9be9b03b4a","created_at":"2026-07-01T17:53:23.168Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2e8f76273ed3dffe93170e4a8828cd9c1cde36f18ce9deaf751670cff2f2dad","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.172Z","job_size_bytes":65,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-52e58145fd345d9be9b03b4a: done: 0.021591 sec","job_status":"done","queue_duration_s":0.820606,"scheduling_latency_s":0.820626,"redis_calls":10,"redis_duration_s":0.002136,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0004,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001281,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000455,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000328813,"duration_s":0.021591,"completed_at":"2026-07-01T17:53:24.014Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002516,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2171vm-test-run-nixbot-gitlab> gitlab # [ 198.735181] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:24.015Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"93beb6057da6af728e51cee2","created_at":"2026-07-01T17:53:23.173Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.174Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-93beb6057da6af728e51cee2: start","job_status":"start","queue_duration_s":0.840999,"scheduling_latency_s":0.84102}2172vm-test-run-nixbot-gitlab> gitlab # [ 198.735925] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:24.038Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"93beb6057da6af728e51cee2","created_at":"2026-07-01T17:53:23.173Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.174Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-93beb6057da6af728e51cee2: done: 0.022827 sec","job_status":"done","queue_duration_s":0.840999,"scheduling_latency_s":0.84102,"redis_calls":7,"redis_duration_s":0.0015990000000000002,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001188,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000411,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016524,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022827,"completed_at":"2026-07-01T17:53:24.038Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002439,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2173vm-test-run-nixbot-gitlab> gitlab # [ 198.806848] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:24.040Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"1b23036d852708ee70fc53e1","created_at":"2026-07-01T17:53:23.205Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.208Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-1b23036d852708ee70fc53e1: start","job_status":"start","queue_duration_s":0.831351,"scheduling_latency_s":0.831372}2174vm-test-run-nixbot-gitlab> gitlab # [ 198.808055] gitaly[1376]: time="2026-07-01T17:53:23.719Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0V0K656Q3M9TC7C5NSX2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:53.117" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:23.717" grpc.time_ms=0.962 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2175vm-test-run-nixbot-gitlab> gitlab # [ 198.809090] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:24 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1892176vm-test-run-nixbot-gitlab> gitlab # [ 198.809936] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:24.066Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"1b23036d852708ee70fc53e1","created_at":"2026-07-01T17:53:23.205Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.208Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-1b23036d852708ee70fc53e1: done: 0.026655 sec","job_status":"done","queue_duration_s":0.831351,"scheduling_latency_s":0.831372,"redis_calls":10,"redis_duration_s":0.002209,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00042,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001305,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000484,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000333283,"duration_s":0.026655,"completed_at":"2026-07-01T17:53:24.066Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006093,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2177vm-test-run-nixbot-gitlab> gitlab # [ 198.909646] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:24.068Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0c1d01420af3c7807bbd6548","created_at":"2026-07-01T17:53:23.209Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.212Z","job_size_bytes":6,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0c1d01420af3c7807bbd6548: start","job_status":"start","queue_duration_s":0.855815,"scheduling_latency_s":0.855836}2178vm-test-run-nixbot-gitlab> gitlab # [ 198.910822] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:24.087Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0c1d01420af3c7807bbd6548","created_at":"2026-07-01T17:53:23.209Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.212Z","job_size_bytes":6,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0c1d01420af3c7807bbd6548: done: 0.018988 sec","job_status":"done","queue_duration_s":0.855815,"scheduling_latency_s":0.855836,"redis_calls":10,"redis_duration_s":0.0022559999999999998,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000468,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001362,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000426,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000348369,"duration_s":0.018988,"completed_at":"2026-07-01T17:53:24.086Z","load_balancing_strategy":"primary","db_duration_s":0.001553,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2179vm-test-run-nixbot-gitlab> gitlab # [ 198.981288] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:24.088Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"fc03827a2d754c244827c6e9","created_at":"2026-07-01T17:53:23.243Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.244Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-fc03827a2d754c244827c6e9: start","job_status":"start","queue_duration_s":0.844186,"scheduling_latency_s":0.844207}2180vm-test-run-nixbot-gitlab> gitlab # [ 198.996162] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:24.155Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"fc03827a2d754c244827c6e9","created_at":"2026-07-01T17:53:23.243Z","trace_propagation_headers":{"sentry-trace":"dbb3d81861bd41538998c0f41d09736f-038b3971110640bc","baggage":"sentry-trace_id=dbb3d81861bd41538998c0f41d09736f,sentry-release=Unknown"},"correlation_id":"01KWFD0T4YG353E5K4VS95FHFW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.244Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-fc03827a2d754c244827c6e9: done: 0.067413 sec","job_status":"done","queue_duration_s":0.844186,"scheduling_latency_s":0.844207,"gitaly_calls":2,"gitaly_duration_s":0.007051,"redis_calls":19,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.003483,"redis_read_bytes":42,"redis_write_bytes":1891,"redis_cache_calls":8,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000816,"redis_cache_read_bytes":16,"redis_cache_write_bytes":735,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001388,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000214,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001065,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":20,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":20,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":9,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.046356451,"duration_s":0.067413,"completed_at":"2026-07-01T17:53:24.155Z","load_balancing_strategy":"primary","db_duration_s":0.012454,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2181vm-test-run-nixbot-gitlab> gitlab # [ 199.069125] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:24.157Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"9c7055d4fef06ee12f642733","created_at":"2026-07-01T17:53:23.675Z","trace_propagation_headers":{"sentry-trace":"4d111a49f4c44c72a6f379ad9ea71026-d2098977b8204927","baggage":"sentry-trace_id=4d111a49f4c44c72a6f379ad9ea71026,sentry-release=Unknown"},"correlation_id":"01KWFD0T48FC6JBRJ6CB288WBC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.677Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-9c7055d4fef06ee12f642733: start","job_status":"start","queue_duration_s":0.48044,"scheduling_latency_s":0.480462}2182vm-test-run-nixbot-gitlab> gitlab # [ 199.154206] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:24.183Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"9c7055d4fef06ee12f642733","created_at":"2026-07-01T17:53:23.675Z","trace_propagation_headers":{"sentry-trace":"4d111a49f4c44c72a6f379ad9ea71026-d2098977b8204927","baggage":"sentry-trace_id=4d111a49f4c44c72a6f379ad9ea71026,sentry-release=Unknown"},"correlation_id":"01KWFD0T48FC6JBRJ6CB288WBC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:23.677Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-9c7055d4fef06ee12f642733: done: 0.025897 sec","job_status":"done","queue_duration_s":0.48044,"scheduling_latency_s":0.480462,"redis_calls":7,"redis_duration_s":0.001838,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001421,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000417,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025897,"completed_at":"2026-07-01T17:53:24.183Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005015,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2183vm-test-run-nixbot-gitlab> gitlab # [ 199.229752] gitaly[1376]: time="2026-07-01T17:53:23.720Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0T48FC6JBRJ6CB288WBC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:53.117" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:23.718" grpc.time_ms=1.227 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2184vm-test-run-nixbot-gitlab> gitlab # [ 199.231218] gitaly[1376]: time="2026-07-01T17:53:23.743Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0T48FC6JBRJ6CB288WBC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:53.142" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:23.743" grpc.time_ms=0.624 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2185vm-test-run-nixbot-gitlab> gitlab # [ 199.232089] gitaly[1376]: time="2026-07-01T17:53:24.120Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0T4YG353E5K4VS95FHFW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-01T17:53:54.117" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:24.119" grpc.time_ms=0.763 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2186vm-test-run-nixbot-gitlab> gitlab # [ 199.232938] gitaly[1376]: time="2026-07-01T17:53:24.144Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0T4YG353E5K4VS95FHFW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:54.143" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:24.143" grpc.time_ms=0.558 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2187vm-test-run-nixbot-gitlab> gitlab # [ 199.301187] gitaly[1376]: time="2026-07-01T17:53:24.945Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0W95GE3EEDJMQT61HWDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:54.743" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:24.944" grpc.time_ms=0.577 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2188vm-test-run-nixbot-gitlab> gitlab # [ 199.350058] nix-daemon[3339]: accepted connection from pid 3428, user nixbot2189vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses2190vm-test-run-nixbot-gitlab> gitlab # [ 199.812706] gitaly[1376]: time="2026-07-01T17:53:26.093Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0XG2ZT7SYVMWJCAAVWRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:56.090" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:26.091" grpc.time_ms=1.314 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2191vm-test-run-nixbot-gitlab> gitlab # [ 199.902792] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:26 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1632192vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses, in 0.23 seconds)2193vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '7be4070670fca3c68e199d7f7820643000a5b0a0', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-07-01T17:53:23.111Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2194vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses2195vm-test-run-nixbot-gitlab> gitlab # [ 201.026679] gitaly[1376]: time="2026-07-01T17:53:27.306Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0YP4A2A2F6XPQGCZWPG4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:57.303" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:27.304" grpc.time_ms=1.284 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2196vm-test-run-nixbot-gitlab> gitlab # [ 201.046228] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 892197vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses, in 0.17 seconds)2198vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '7be4070670fca3c68e199d7f7820643000a5b0a0', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-07-01T17:53:23.111Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2199vm-test-run-nixbot-gitlab> gitlab # [ 201.603534] nix-daemon[3339]: accepted connection from pid 3465, user nixbot2200vm-test-run-nixbot-gitlab> gitlab # [ 201.655325] gitaly[1376]: time="2026-07-01T17:53:27.935Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0Z9Z3R9K9R0Y6F1WGGGF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:57.733" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:27.934" grpc.time_ms=1.167 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2201vm-test-run-nixbot-gitlab> gitlab # [ 201.702168] gitaly[1376]: time="2026-07-01T17:53:27.971Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0Z9Z3R9K9R0Y6F1WGGGF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-01T17:53:37.253" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:27.964" grpc.time_ms=7.238 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2202vm-test-run-nixbot-gitlab> gitlab # [ 201.727192] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.005Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b85b2d97322e9f671ac574bc","created_at":"2026-07-01T17:53:27.999Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-917ef5c9e550432e","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.003Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b85b2d97322e9f671ac574bc: start","job_status":"start","queue_duration_s":0.002482,"scheduling_latency_s":0.00252}2203vm-test-run-nixbot-gitlab> gitlab # [ 201.753727] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:28 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7be4070670fca3c68e199d7f7820643000a5b0a0 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 1622204vm-test-run-nixbot-gitlab> gitlab # [ 201.756491] nixbot[3038]: {"ts": "2026-07-01T17:53:28.036Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7be4070670fca3c68e199d7f7820643000a5b0a0 \"HTTP/1.1 201 Created\""}2205vm-test-run-nixbot-gitlab> gitlab # [ 201.813675] gitaly[1376]: time="2026-07-01T17:53:28.094Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0ZFCWX9ZGBWK0S48MKNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:58.093" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:28.093" grpc.time_ms=0.619 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2206vm-test-run-nixbot-gitlab> gitlab # [ 201.842193] gitaly[1376]: time="2026-07-01T17:53:28.122Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0Z9Z3R9K9R0Y6F1WGGGF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:28.122" grpc.time_ms=0.283 pid=1376 span.kind=server system=grpc2207vm-test-run-nixbot-gitlab> gitlab # [ 201.844339] gitaly[1376]: time="2026-07-01T17:53:28.124Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0ZFCWX9ZGBWK0S48MKNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-01T17:53:38.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:28.117" grpc.time_ms=7.557 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2208vm-test-run-nixbot-gitlab> gitlab # [ 201.867193] gitaly[1376]: time="2026-07-01T17:53:28.147Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0Z9Z3R9K9R0Y6F1WGGGF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3901 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:28.147" grpc.time_ms=0.346 pid=1376 span.kind=server system=grpc2209vm-test-run-nixbot-gitlab> gitlab # [ 201.883081] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:28 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7be4070670fca3c68e199d7f7820643000a5b0a0 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1192210vm-test-run-nixbot-gitlab> gitlab # [ 201.884209] nixbot[3038]: {"ts": "2026-07-01T17:53:28.163Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7be4070670fca3c68e199d7f7820643000a5b0a0 \"HTTP/1.1 201 Created\""}2211vm-test-run-nixbot-gitlab> gitlab # [ 201.892649] gitaly[1376]: time="2026-07-01T17:53:28.173Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD0Z9Z3R9K9R0Y6F1WGGGF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:28.172" grpc.time_ms=0.271 pid=1376 span.kind=server system=grpc2212vm-test-run-nixbot-gitlab> gitlab # [ 201.904294] gitaly[1376]: time="2026-07-01T17:53:28.184Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0Z9Z3R9K9R0Y6F1WGGGF diskcache=b83d6b4e-f4e2-4a57-b233-a328ab87ea92 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-01T17:53:58.095" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:28.095" pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2213vm-test-run-nixbot-gitlab> gitlab # [ 201.905678] gitaly[1376]: time="2026-07-01T17:53:28.185Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=79 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7314 command.oublock=0 command.real_time_ms=81 command.spawn_token_fork_ms=0 command.system_time_ms=47 command.user_time_ms=32 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0Z9Z3R9K9R0Y6F1WGGGF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-01T17:53:58.095" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:28.095" grpc.time_ms=89.397 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2214vm-test-run-nixbot-gitlab> gitlab # [ 201.940260] gitaly[1376]: time="2026-07-01T17:53:28.220Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0Z9Z3R9K9R0Y6F1WGGGF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-01T17:53:58.219" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:28.219" grpc.time_ms=0.736 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2215vm-test-run-nixbot-gitlab> gitlab # [ 201.959778] gitaly[1376]: time="2026-07-01T17:53:28.240Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0Z9Z3R9K9R0Y6F1WGGGF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:58.239" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:28.239" grpc.time_ms=0.544 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2216vm-test-run-nixbot-gitlab> gitlab # [ 201.990291] gitaly[1376]: time="2026-07-01T17:53:28.270Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0Z9Z3R9K9R0Y6F1WGGGF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:58.269" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:28.270" grpc.time_ms=0.594 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2217vm-test-run-nixbot-gitlab> gitlab # [ 201.999364] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.279Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a8038938a346a9f9a44138a4","created_at":"2026-07-01T17:53:28.277Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"b85b2d97322e9f671ac574bc","job_size_bytes":3,"pid":2096,"job_status":"deduplicated","message":"PipelineProcessWorker JID-a8038938a346a9f9a44138a4: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2218vm-test-run-nixbot-gitlab> gitlab # [ 202.000874] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.281Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b85b2d97322e9f671ac574bc","created_at":"2026-07-01T17:53:27.999Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-917ef5c9e550432e","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.003Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2096,"job_status":"rescheduled","message":"PipelineProcessWorker JID-b85b2d97322e9f671ac574bc: rescheduled"}2219vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses2220vm-test-run-nixbot-gitlab> gitlab # [ 202.006982] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.287Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b85b2d97322e9f671ac574bc","created_at":"2026-07-01T17:53:27.999Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-917ef5c9e550432e","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.003Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b85b2d97322e9f671ac574bc: done: 0.281713 sec","job_status":"done","queue_duration_s":0.002482,"scheduling_latency_s":0.00252,"gitaly_calls":4,"gitaly_duration_s":0.098997,"redis_calls":93,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.020809,"redis_read_bytes":262,"redis_write_bytes":23390,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001642,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":21,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.002563,"redis_cache_read_bytes":39,"redis_cache_write_bytes":1840,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000829,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":712,"redis_queues_calls":25,"redis_queues_duration_s":0.004014,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14471,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.006265,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000449,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000661,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002744,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":38,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":38,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":23,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.011,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.131442,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.245395993,"duration_s":0.281713,"completed_at":"2026-07-01T17:53:28.287Z","load_balancing_strategy":"primary","db_duration_s":0.038943,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2221vm-test-run-nixbot-gitlab> gitlab # [ 202.093360] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.288Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e24d2f8f9a9284b8c1aa2bd7","created_at":"2026-07-01T17:53:28.084Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.087Z","job_size_bytes":23,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e24d2f8f9a9284b8c1aa2bd7: start","job_status":"start","queue_duration_s":0.2009,"scheduling_latency_s":0.200959}2222vm-test-run-nixbot-gitlab> gitlab # [ 202.169156] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.420Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e24d2f8f9a9284b8c1aa2bd7","created_at":"2026-07-01T17:53:28.084Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.087Z","job_size_bytes":23,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e24d2f8f9a9284b8c1aa2bd7: done: 0.131885 sec","job_status":"done","queue_duration_s":0.2009,"scheduling_latency_s":0.200959,"redis_calls":7,"redis_duration_s":0.001899,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001462,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000437,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.118946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.131885,"completed_at":"2026-07-01T17:53:28.420Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006151,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2223vm-test-run-nixbot-gitlab> gitlab # [ 202.170370] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.422Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5ffa2b4c7a4d7313b49b500f","created_at":"2026-07-01T17:53:28.189Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.191Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5ffa2b4c7a4d7313b49b500f: start","job_status":"start","queue_duration_s":0.230391,"scheduling_latency_s":0.230419}2224vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses, in 0.20 seconds)2225vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '7be4070670fca3c68e199d7f7820643000a5b0a0', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-01T17:53:23.111Z', 'started_at': None, 'finished_at': '2026-07-01T17:53:27.990Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': '7be4070670fca3c68e199d7f7820643000a5b0a0', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-07-01T17:53:28.143Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2226vm-test-run-nixbot-gitlab> gitlab # [ 202.254907] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.441Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5ffa2b4c7a4d7313b49b500f","created_at":"2026-07-01T17:53:28.189Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.191Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5ffa2b4c7a4d7313b49b500f: done: 0.018804 sec","job_status":"done","queue_duration_s":0.230391,"scheduling_latency_s":0.230419,"redis_calls":7,"redis_duration_s":0.001659,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001242,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000417,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018804,"completed_at":"2026-07-01T17:53:28.441Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002222,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2227vm-test-run-nixbot-gitlab> gitlab # [ 202.263796] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.442Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"349d48db41da9194a2c10118","created_at":"2026-07-01T17:53:28.197Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.199Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-349d48db41da9194a2c10118: start","job_status":"start","queue_duration_s":0.243045,"scheduling_latency_s":0.243067}2228vm-test-run-nixbot-gitlab> gitlab # [ 202.336496] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.465Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"349d48db41da9194a2c10118","created_at":"2026-07-01T17:53:28.197Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.199Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-349d48db41da9194a2c10118: done: 0.023197 sec","job_status":"done","queue_duration_s":0.243045,"scheduling_latency_s":0.243067,"redis_calls":7,"redis_duration_s":0.002729,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001461,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001268,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023197,"completed_at":"2026-07-01T17:53:28.465Z","load_balancing_strategy":"primary","db_duration_s":0.004736,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2229vm-test-run-nixbot-gitlab> gitlab # [ 202.409963] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.467Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"d1e4ffeac5217b3cedd014df","created_at":"2026-07-01T17:53:28.205Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.206Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-d1e4ffeac5217b3cedd014df: start","job_status":"start","queue_duration_s":0.2606,"scheduling_latency_s":0.260621}2230vm-test-run-nixbot-gitlab> gitlab # [ 202.410995] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.603Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"d1e4ffeac5217b3cedd014df","created_at":"2026-07-01T17:53:28.205Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.206Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-d1e4ffeac5217b3cedd014df: done: 0.135756 sec","job_status":"done","queue_duration_s":0.2606,"scheduling_latency_s":0.260621,"redis_calls":10,"redis_duration_s":0.109523,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001548,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.107502,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000473,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.135756,"completed_at":"2026-07-01T17:53:28.603Z","load_balancing_strategy":"primary","db_duration_s":0.003682,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2231vm-test-run-nixbot-gitlab> gitlab # [ 202.449085] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.604Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"77cf5db1b8f5f015112f84d2","created_at":"2026-07-01T17:53:28.207Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.208Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-77cf5db1b8f5f015112f84d2: start","job_status":"start","queue_duration_s":0.395916,"scheduling_latency_s":0.395939}2232vm-test-run-nixbot-gitlab> gitlab # [ 202.520477] gitaly[1376]: time="2026-07-01T17:53:28.542Z" level=info msg="finished unary call with code OK" catfile.duration_ms=48 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=48 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0ZVCPE9W7B5K88DDP842 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:58.492" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:28.493" grpc.time_ms=48.77 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2233vm-test-run-nixbot-gitlab> gitlab # [ 202.522227] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:28 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 1342234vm-test-run-nixbot-gitlab> gitlab # [ 202.523118] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.623Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"77cf5db1b8f5f015112f84d2","created_at":"2026-07-01T17:53:28.207Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.208Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-77cf5db1b8f5f015112f84d2: done: 0.018928 sec","job_status":"done","queue_duration_s":0.395916,"scheduling_latency_s":0.395939,"redis_calls":7,"redis_duration_s":0.001634,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001207,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000427,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018928,"completed_at":"2026-07-01T17:53:28.623Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003172,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2235vm-test-run-nixbot-gitlab> gitlab # [ 202.603282] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.624Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"37c8f0ca27731983185b22c8","created_at":"2026-07-01T17:53:28.209Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.211Z","job_size_bytes":19,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-37c8f0ca27731983185b22c8: start","job_status":"start","queue_duration_s":0.413865,"scheduling_latency_s":0.413887}2236vm-test-run-nixbot-gitlab> gitlab # [ 202.604329] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.643Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"37c8f0ca27731983185b22c8","created_at":"2026-07-01T17:53:28.209Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.211Z","job_size_bytes":19,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-37c8f0ca27731983185b22c8: done: 0.01877 sec","job_status":"done","queue_duration_s":0.413865,"scheduling_latency_s":0.413887,"redis_calls":8,"redis_duration_s":0.001805,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001364,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000441,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01877,"completed_at":"2026-07-01T17:53:28.643Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002116,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2237vm-test-run-nixbot-gitlab> gitlab # [ 202.674145] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.644Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"dd6f9e92f128a7661a921296","created_at":"2026-07-01T17:53:28.211Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.213Z","job_size_bytes":66,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-dd6f9e92f128a7661a921296: start","job_status":"start","queue_duration_s":0.431936,"scheduling_latency_s":0.431957}2238vm-test-run-nixbot-gitlab> gitlab # [ 202.748481] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.659Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"dd6f9e92f128a7661a921296","created_at":"2026-07-01T17:53:28.211Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.213Z","job_size_bytes":66,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-dd6f9e92f128a7661a921296: done: 0.01484 sec","job_status":"done","queue_duration_s":0.431936,"scheduling_latency_s":0.431957,"redis_calls":7,"redis_duration_s":0.001469,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001059,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00041,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009871,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01484,"completed_at":"2026-07-01T17:53:28.659Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000968,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2239vm-test-run-nixbot-gitlab> gitlab # [ 202.755198] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.661Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"5519552d266e7d2add196ca1","created_at":"2026-07-01T17:53:28.213Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.215Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5519552d266e7d2add196ca1: start","job_status":"start","queue_duration_s":0.446051,"scheduling_latency_s":0.446072}2240vm-test-run-nixbot-gitlab> gitlab # [ 202.824709] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.683Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"5519552d266e7d2add196ca1","created_at":"2026-07-01T17:53:28.213Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.215Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5519552d266e7d2add196ca1: done: 0.021907 sec","job_status":"done","queue_duration_s":0.446051,"scheduling_latency_s":0.446072,"redis_calls":7,"redis_duration_s":0.0014810000000000001,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001067,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000414,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021907,"completed_at":"2026-07-01T17:53:28.682Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002542,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2241vm-test-run-nixbot-gitlab> gitlab # [ 202.897203] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.684Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"f57c04fa85382733f9b0b497","created_at":"2026-07-01T17:53:28.245Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.246Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-f57c04fa85382733f9b0b497: start","job_status":"start","queue_duration_s":0.437915,"scheduling_latency_s":0.437935}2242vm-test-run-nixbot-gitlab> gitlab # [ 202.898269] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.702Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"f57c04fa85382733f9b0b497","created_at":"2026-07-01T17:53:28.245Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.246Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-f57c04fa85382733f9b0b497: done: 0.017832 sec","job_status":"done","queue_duration_s":0.437915,"scheduling_latency_s":0.437935,"redis_calls":7,"redis_duration_s":0.0016749999999999998,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001223,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000452,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010597,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017832,"completed_at":"2026-07-01T17:53:28.702Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003176,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2243vm-test-run-nixbot-gitlab> gitlab # [ 202.977284] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.703Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"8b928fde78585f565e1d47b0","created_at":"2026-07-01T17:53:28.246Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.247Z","job_size_bytes":6,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-8b928fde78585f565e1d47b0: start","job_status":"start","queue_duration_s":0.455365,"scheduling_latency_s":0.455385}2244vm-test-run-nixbot-gitlab> gitlab # [ 202.978841] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.715Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"8b928fde78585f565e1d47b0","created_at":"2026-07-01T17:53:28.246Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.247Z","job_size_bytes":6,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-8b928fde78585f565e1d47b0: done: 0.012131 sec","job_status":"done","queue_duration_s":0.455365,"scheduling_latency_s":0.455385,"redis_calls":7,"redis_duration_s":0.001516,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001111,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000405,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012131,"completed_at":"2026-07-01T17:53:28.715Z","load_balancing_strategy":"primary","db_duration_s":0.000373,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2245vm-test-run-nixbot-gitlab> gitlab # [ 203.056217] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.716Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"3e6c38797a22a651b72cc870","created_at":"2026-07-01T17:53:28.248Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.251Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3e6c38797a22a651b72cc870: start","job_status":"start","queue_duration_s":0.465186,"scheduling_latency_s":0.465206}2246vm-test-run-nixbot-gitlab> gitlab # [ 203.057846] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.740Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"3e6c38797a22a651b72cc870","created_at":"2026-07-01T17:53:28.248Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.251Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3e6c38797a22a651b72cc870: done: 0.023664 sec","job_status":"done","queue_duration_s":0.465186,"scheduling_latency_s":0.465206,"redis_calls":10,"redis_duration_s":0.002237,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00047,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00131,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000457,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000333003,"duration_s":0.023664,"completed_at":"2026-07-01T17:53:28.740Z","load_balancing_strategy":"primary","db_duration_s":0.003906,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2247vm-test-run-nixbot-gitlab> gitlab # [ 203.163153] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.741Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"7ec58ace9360cf18dc01c5d5","created_at":"2026-07-01T17:53:28.281Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.282Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7ec58ace9360cf18dc01c5d5: start","job_status":"start","queue_duration_s":0.45897,"scheduling_latency_s":0.45899}2248vm-test-run-nixbot-gitlab> gitlab # [ 203.164326] gitaly[1376]: time="2026-07-01T17:53:28.791Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWFD0Z9Z3R9K9R0Y6F1WGGGF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-01T17:53:58.190" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:28.791" grpc.time_ms=0.71 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2249vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses2250vm-test-run-nixbot-gitlab> gitlab # [ 203.168557] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.843Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"7ec58ace9360cf18dc01c5d5","created_at":"2026-07-01T17:53:28.281Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f9fa53ea296742d8","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.282Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7ec58ace9360cf18dc01c5d5: done: 0.101811 sec","job_status":"done","queue_duration_s":0.45897,"scheduling_latency_s":0.45899,"gitaly_calls":3,"gitaly_duration_s":0.007959,"redis_calls":44,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.007192,"redis_read_bytes":98,"redis_write_bytes":6013,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000976,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.001751,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_queues_calls":2,"redis_queues_duration_s":0.000266,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001542,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000221,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000424,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":20,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070607,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.081192442,"duration_s":0.101811,"completed_at":"2026-07-01T17:53:28.843Z","load_balancing_strategy":"primary","db_duration_s":0.022405,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2251vm-test-run-nixbot-gitlab> gitlab # [ 203.270275] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.844Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"d9d8dafbd7452f953a967848","created_at":"2026-07-01T17:53:28.781Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f3db9d316a324c82","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.783Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-d9d8dafbd7452f953a967848: start","job_status":"start","queue_duration_s":0.061801,"scheduling_latency_s":0.061823}2252vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses, in 0.11 seconds)2253vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '7be4070670fca3c68e199d7f7820643000a5b0a0', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-01T17:53:23.111Z', 'started_at': None, 'finished_at': '2026-07-01T17:53:27.990Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': '7be4070670fca3c68e199d7f7820643000a5b0a0', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-07-01T17:53:28.143Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2254vm-test-run-nixbot-gitlab> gitlab # [ 203.339947] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:28.868Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"d9d8dafbd7452f953a967848","created_at":"2026-07-01T17:53:28.781Z","trace_propagation_headers":{"sentry-trace":"94a5588ff8de4197a84683aacad05b0b-f3db9d316a324c82","baggage":"sentry-trace_id=94a5588ff8de4197a84683aacad05b0b,sentry-release=Unknown"},"correlation_id":"01KWFD0Z9Z3R9K9R0Y6F1WGGGF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:28.783Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-d9d8dafbd7452f953a967848: done: 0.023148 sec","job_status":"done","queue_duration_s":0.061801,"scheduling_latency_s":0.061823,"redis_calls":7,"redis_duration_s":0.0015110000000000002,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001097,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000414,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023148,"completed_at":"2026-07-01T17:53:28.868Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002679,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2255vm-test-run-nixbot-gitlab> gitlab # [ 203.341921] gitaly[1376]: time="2026-07-01T17:53:28.811Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0Z9Z3R9K9R0Y6F1WGGGF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:58.210" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:28.811" grpc.time_ms=0.537 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2256vm-test-run-nixbot-gitlab> gitlab # [ 203.414247] gitaly[1376]: time="2026-07-01T17:53:28.831Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD0Z9Z3R9K9R0Y6F1WGGGF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:58.230" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:28.830" grpc.time_ms=0.534 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2257vm-test-run-nixbot-gitlab> gitlab # [ 203.415874] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 762258vm-test-run-nixbot-gitlab> gitlab # [ 203.416959] gitaly[1376]: time="2026-07-01T17:53:29.656Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD10ZZZGG2GP4CNRZSW4B7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:53:59.455" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:29.655" grpc.time_ms=0.688 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2259vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses2260vm-test-run-nixbot-gitlab> gitlab # [ 204.509897] gitaly[1376]: time="2026-07-01T17:53:30.790Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD1230WSQS1C25X3EXJ3G4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:54:00.787" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:30.788" grpc.time_ms=1.178 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2261vm-test-run-nixbot-gitlab> gitlab # [ 204.594987] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:30 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 1532262vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses, in 0.21 seconds)2263vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '7be4070670fca3c68e199d7f7820643000a5b0a0', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-01T17:53:23.111Z', 'started_at': None, 'finished_at': '2026-07-01T17:53:27.990Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': '7be4070670fca3c68e199d7f7820643000a5b0a0', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-07-01T17:53:28.143Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2264vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses2265vm-test-run-nixbot-gitlab> gitlab # [ 205.726655] gitaly[1376]: time="2026-07-01T17:53:32.006Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD138TSEMKDH42RR6FW50W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:54:02.003" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:32.004" grpc.time_ms=1.374 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2266vm-test-run-nixbot-gitlab> gitlab # [ 205.766819] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:32 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 1152267vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses, in 0.18 seconds)2268vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '7be4070670fca3c68e199d7f7820643000a5b0a0', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-01T17:53:23.111Z', 'started_at': None, 'finished_at': '2026-07-01T17:53:27.990Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': '7be4070670fca3c68e199d7f7820643000a5b0a0', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-07-01T17:53:28.143Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2269vm-test-run-nixbot-gitlab> gitlab # [ 206.501559] nix-daemon[3339]: accepted connection from pid 3543, user nixbot2270vm-test-run-nixbot-gitlab> gitlab # [ 206.670442] gitaly[1376]: time="2026-07-01T17:53:32.950Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD144K4WMQXJJQN4GMR1F4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:54:02.348" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:32.949" grpc.time_ms=1.037 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2271vm-test-run-nixbot-gitlab> gitlab # [ 206.713460] gitaly[1376]: time="2026-07-01T17:53:32.994Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWFD144K4WMQXJJQN4GMR1F4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-01T17:53:42.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-01T17:53:32.983" grpc.time_ms=10.267 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2272vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses2273vm-test-run-nixbot-gitlab> gitlab # [ 206.762398] sidekiq-cluster[2096]: {"severity":"INFO","time":"2026-07-01T17:53:33.041Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"3326a3d4eb21c3cbb4c28598","created_at":"2026-07-01T17:53:33.036Z","trace_propagation_headers":{"sentry-trace":"056b0f6b758645fa9faac3eab27c0dae-dca951ac701a4c1d","baggage":"sentry-trace_id=056b0f6b758645fa9faac3eab27c0dae,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWFD144K4WMQXJJQN4GMR1F4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-01T17:53:33.039Z","job_size_bytes":3,"pid":2096,"sidekiq_tid":"ma0o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3326a3d4eb21c3cbb4c28598: start","job_status":"start","queue_duration_s":0.002125,"scheduling_latency_s":0.002188}2274vm-test-run-nixbot-gitlab> gitlab # [ 206.789775] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:33 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7be4070670fca3c68e199d7f7820643000a5b0a0 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2332275vm-test-run-nixbot-gitlab> gitlab # [ 206.792836] nixbot[3038]: {"ts": "2026-07-01T17:53:33.055Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7be4070670fca3c68e199d7f7820643000a5b0a0 \"HTTP/1.1 201 Created\""}2276vm-test-run-nixbot-gitlab> gitlab # [ 206.848430] gitaly[1376]: time="2026-07-01T17:53:33.128Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWFD14D0C6RVXPHP4JYZM88J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-01T17:54:03.126" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-01T17:53:33.127" grpc.time_ms=0.918 pid=1376 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2277vm-test-run-nixbot-gitlab> gitlab # [ 206.872114] gitlab-workhorse[1284]: gitlab 2001:db8:1::1 - - [2026/07/01:17:53:33 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses HTTP/1.1" 200 1328 "" "curl/8.20.0" 632278vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7be4070670fca3c68e199d7f7820643000a5b0a0/statuses, in 0.09 seconds)2279vm-test-run-nixbot-gitlab> [{'id': 3, 'sha': '7be4070670fca3c68e199d7f7820643000a5b0a0', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-01T17:53:23.111Z', 'started_at': None, 'finished_at': '2026-07-01T17:53:27.990Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': '7be4070670fca3c68e199d7f7820643000a5b0a0', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-07-01T17:53:28.143Z', 'started_at': None, 'finished_at': '2026-07-01T17:53:33.026Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2280vm-test-run-nixbot-gitlab> (finished: subtest: eval and build post commit statuses, in 9.70 seconds)2281vm-test-run-nixbot-gitlab> (finished: run the VM test script, in 242.84 seconds)2282vm-test-run-nixbot-gitlab> gitlab # [ 206.908083] gitaly[1376]: time="2026-07-01T17:53:33.188Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWFD144K4WMQXJJQN4GMR1F4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-01T17:53:33.188" grpc.time_ms=0.577 pid=1376 span.kind=server system=grpc2283vm-test-run-nixbot-gitlab> test script finished in 242.89s2284vm-test-run-nixbot-gitlab> cleanup2285vm-test-run-nixbot-gitlab> kill QemuMachine (pid 13)2286vm-test-run-nixbot-gitlab> gitlab # qemu-system-x86_64: terminating on signal 15 from pid 6 (/nix/store/60m4rxhg2fldqaak400c0lry96ijrzqn-python3-3.13.13/bin/python3.13)2287vm-test-run-nixbot-gitlab> (finished: cleanup, in 1.13 seconds)22882289post-build step Upload coverage to codecov: ok2290Skipping codecov: project=Mic92/nixbot attr=x86_64-linux.nixbot-gitlab