vm-test-run-nixbot-gitlab
default.checks.x86_64-linux.nixbot-gitlab
· build #207
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.01 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.dYRqzFlEyr', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15gitlab # Filesystem UUID: 7b3ba74a-e7e9-4190-b09a-5ab98a02832916gitlab # Superblock backups stored on blocks:17gitlab # 32768, 98304, 163840, 22937618gitlab # 19gitlab # Allocating group tables: 0/8 done20(finished: start all VMs, in 39.67 seconds)21gitlab # Writing inode tables: 0/8 done22gitlab # Creating journal (8192 blocks): done23gitlab # Writing superblocks and filesystem accounting information: 0/8 done24gitlab # 25gitlab # Virtualisation disk image created.26gitlab: waiting for unit setup-gitlab.service27gitlab # Creating Nix store image...28gitlab: waiting for the VM to finish booting29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... ok45gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202646gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/k5zd5llhc4a7a33jzm5l6bmf9mwqbmmh-nixos-system-gitlab-test/init regInfo=/nix/store/g3ir9d65h19qac76m44r1dkdym8fhzhk-closure-info/registration console=ttyS0,115200n8 console=tty047gitlab # [ 0.000000] BIOS-provided physical RAM map:48gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable49gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved51gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved55gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable56gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved57gitlab # [ 0.000000] NX (Execute Disable) protection: active58gitlab # [ 0.000000] APIC: Static calls initialized59gitlab # [ 0.000000] SMBIOS 2.8 present.60gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201461gitlab # [ 0.000000] DMI: Memory slots populated: 1/162gitlab # [ 0.000000] Hypervisor detected: KVM63gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000064gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0065gitlab # [ 0.000001] kvm-clock: using sched offset of 490449278 cycles66gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns67gitlab # [ 0.000005] tsc: Detected 2400.008 MHz processor68gitlab # [ 0.000818] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000069gitlab # [ 0.000859] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs70gitlab # [ 0.000862] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT71gitlab # [ 0.000914] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000072gitlab # [ 0.002775] found SMP MP-table at [mem 0x000f5470-0x000f547f]73gitlab # [ 0.002786] Using GB pages for direct mapping74gitlab # [ 0.002840] RAMDISK: [mem 0xbe31c000-0xbffcffff]75gitlab # [ 0.002848] ACPI: Early table checksum verification disabled76gitlab # [ 0.002850] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )77gitlab # [ 0.002854] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002858] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002865] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)80gitlab # [ 0.002867] ACPI: FACS 0x00000000BFFE0000 00004081gitlab # [ 0.002869] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002870] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002872] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)84gitlab # [ 0.002873] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]85gitlab # [ 0.002874] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]86gitlab # [ 0.002875] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]87gitlab # [ 0.002875] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]88gitlab # [ 0.002876] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]89gitlab # [ 0.002877] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]90gitlab # [ 0.003371] No NUMA configuration found91gitlab # [ 0.003373] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]92gitlab # [ 0.003376] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]93gitlab # [ 0.005814] Zone ranges:94gitlab # [ 0.005815] DMA [mem 0x0000000000001000-0x0000000000ffffff]95gitlab # [ 0.005817] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]96gitlab # [ 0.005818] Normal [mem 0x0000000100000000-0x00000001bfffffff]97gitlab # [ 0.005819] Device empty98gitlab # [ 0.005820] Movable zone start for each node99gitlab # [ 0.005821] Early memory node ranges100gitlab # [ 0.005821] node 0: [mem 0x0000000000001000-0x000000000009efff]101gitlab # [ 0.005822] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]102gitlab # [ 0.005823] node 0: [mem 0x0000000100000000-0x00000001bfffffff]103gitlab # [ 0.005824] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]104gitlab # [ 0.005845] On node 0, zone DMA: 1 pages in unavailable ranges105gitlab # [ 0.006122] On node 0, zone DMA: 97 pages in unavailable ranges106gitlab # [ 0.121267] On node 0, zone Normal: 40 pages in unavailable ranges107gitlab # [ 0.122291] ACPI: PM-Timer IO Port: 0x608108gitlab # [ 0.122308] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])109gitlab # [ 0.122346] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23110gitlab # [ 0.122349] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)111gitlab # [ 0.122351] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)112gitlab # [ 0.122352] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)113gitlab # [ 0.122353] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)114gitlab # [ 0.122354] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)115gitlab # [ 0.122356] ACPI: Using ACPI (MADT) for SMP configuration information116gitlab # [ 0.122357] ACPI: HPET id: 0x8086a201 base: 0xfed00000117gitlab # [ 0.122363] TSC deadline timer available118gitlab # [ 0.122368] CPU topo: Max. logical packages: 1119gitlab # [ 0.122369] CPU topo: Max. logical dies: 1120gitlab # [ 0.122369] CPU topo: Max. dies per package: 1121gitlab # [ 0.122372] CPU topo: Max. threads per core: 1122gitlab # [ 0.122373] CPU topo: Num. cores per package: 4123gitlab # [ 0.122373] CPU topo: Num. threads per package: 4124gitlab # [ 0.122374] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs125gitlab # [ 0.122398] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()126gitlab # [ 0.122417] kvm-guest: KVM setup pv remote TLB flush127gitlab # [ 0.122420] kvm-guest: setup PV sched yield128gitlab # [ 0.122440] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]129gitlab # [ 0.122441] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]130gitlab # [ 0.122442] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]131gitlab # [ 0.122444] [mem 0xc0000000-0xfeffbfff] available for PCI devices132gitlab # [ 0.122445] Booting paravirtualized kernel on KVM133gitlab # [ 0.122449] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns134gitlab # [ 0.126909] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1135gitlab # [ 0.129301] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288136gitlab # [ 0.129353] kvm-guest: PV spinlocks enabled137gitlab # [ 0.129355] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)138gitlab # [ 0.129357] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/k5zd5llhc4a7a33jzm5l6bmf9mwqbmmh-nixos-system-gitlab-test/init regInfo=/nix/store/g3ir9d65h19qac76m44r1dkdym8fhzhk-closure-info/registration console=ttyS0,115200n8 console=tty0139gitlab # [ 0.129453] Unknown kernel command line parameters "regInfo=/nix/store/g3ir9d65h19qac76m44r1dkdym8fhzhk-closure-info/registration", will be passed to user space.140gitlab # [ 0.129466] random: crng init done141gitlab # [ 0.129466] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes142gitlab # [ 0.139359] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)143gitlab # [ 0.144329] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)144gitlab # [ 0.144406] software IO TLB: area num 4.145gitlab # [ 0.224372] Fallback order for Node 0: 0146gitlab # [ 0.224379] Built 1 zonelists, mobility grouping on. Total pages: 1572726147gitlab # [ 0.224381] Policy zone: Normal148gitlab # [ 0.227081] mem auto-init: stack:all(zero), heap alloc:on, heap free:off149gitlab # [ 0.236725] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1150gitlab # [ 0.251643] allocated 12582912 bytes of page_ext151gitlab # [ 0.261713] ftrace: allocating 48717 entries in 192 pages152gitlab # [ 0.261715] ftrace: allocated 192 pages with 2 groups153gitlab # [ 0.262582] Dynamic Preempt: lazy154gitlab # [ 0.262761] rcu: Preemptible hierarchical RCU implementation.155gitlab # [ 0.262762] rcu: RCU event tracing is enabled.156gitlab # [ 0.262762] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.157gitlab # [ 0.262764] Trampoline variant of Tasks RCU enabled.158gitlab # [ 0.262764] Rude variant of Tasks RCU enabled.159gitlab # [ 0.262765] Tracing variant of Tasks RCU enabled.160gitlab # [ 0.262765] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.161gitlab # [ 0.262766] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4162gitlab # [ 0.262793] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.262794] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.262795] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.165gitlab # [ 0.267188] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16166gitlab # [ 0.267514] rcu: srcu_init: Setting srcu_struct sizes based on contention.167gitlab # [ 0.267523] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns168gitlab # [ 0.267635] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)169gitlab # [ 0.274960] Console: colour VGA+ 80x25170gitlab # [ 0.274963] printk: legacy console [tty0] enabled171gitlab # [ 0.319512] printk: legacy console [ttyS0] enabled172gitlab # [ 0.520292] ACPI: Core revision 20250807173gitlab # [ 0.521879] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns174gitlab # [ 0.524717] APIC: Switch to symmetric I/O mode setup175gitlab # [ 0.526773] x2apic enabled176gitlab # [ 0.527972] APIC: Switched APIC routing to: physical x2apic177gitlab # [ 0.530591] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()178gitlab # [ 0.532800] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()179gitlab # [ 0.535474] kvm-guest: setup PV IPIs180gitlab # [ 0.537777] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1181gitlab # [ 0.541976] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns182gitlab # [ 0.545112] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008)183gitlab # [ 0.546230] x86/cpu: User Mode Instruction Prevention (UMIP) activated184gitlab # [ 0.549206] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127185gitlab # [ 0.551111] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0186gitlab # [ 0.552116] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto187gitlab # [ 0.553111] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl188gitlab # [ 0.555111] Transient Scheduler Attacks: Mitigation: Clear CPU buffers189gitlab # [ 0.556111] Spectre V2 : Mitigation: Enhanced / Automatic IBRS190gitlab # [ 0.558111] Speculative Return Stack Overflow: Mitigation: Safe RET191gitlab # [ 0.560111] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization192gitlab # [ 0.562120] Spectre V2 : Enabling IBPB for BPF193gitlab # [ 0.563113] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier194gitlab # [ 0.565112] active return thunk: srso_alias_return_thunk195gitlab # [ 0.566141] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'196gitlab # [ 0.568111] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'197gitlab # [ 0.569111] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'198gitlab # [ 0.570111] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'199gitlab # [ 0.572111] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'200gitlab # [ 0.574111] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'201gitlab # [ 0.576111] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'202gitlab # [ 0.578111] x86/fpu: Supporting XSAVE feature 0x800: 'Control-flow User registers'203gitlab # [ 0.580111] x86/fpu: Supporting XSAVE feature 0x1000: 'Control-flow Kernel registers (KVM only)'204gitlab # [ 0.581111] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256205gitlab # [ 0.583111] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64206gitlab # [ 0.584111] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512207gitlab # [ 0.585111] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024208gitlab # [ 0.586111] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8209gitlab # [ 0.587111] x86/fpu: xstate_offset[11]: 2440, xstate_sizes[11]: 16210gitlab # [ 0.588111] x86/fpu: xstate_offset[12]: 2456, xstate_sizes[12]: 24211gitlab # [ 0.590111] x86/fpu: Enabled xstate features 0x1ae7, context size is 2480 bytes, using 'compacted' format.212gitlab # [ 0.621250] Freeing SMP alternatives memory: 44K213gitlab # [ 0.622114] pid_max: default: 32768 minimum: 301214gitlab # [ 0.623218] LSM: initializing lsm=capability,landlock,yama,bpf,ima215gitlab # [ 0.625210] landlock: Up and running.216gitlab # [ 0.626111] Yama: becoming mindful.217gitlab # [ 0.627322] LSM support for eBPF active218gitlab # [ 0.629226] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)219gitlab # [ 0.630272] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)220gitlab # [ 0.633254] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)221gitlab # [ 0.634724] Performance Events: Fam17h+ core perfctr, AMD PMU driver.222gitlab # [ 0.635121] ... version: 2223gitlab # [ 0.636113] ... bit width: 48224gitlab # [ 0.637113] ... generic counters: 6225gitlab # [ 0.638113] ... generic bitmap: 000000000000003f226gitlab # [ 0.639113] ... fixed-purpose counters: 0227gitlab # [ 0.640113] ... fixed-purpose bitmap: 0000000000000000228gitlab # [ 0.641113] ... value mask: 0000ffffffffffff229gitlab # [ 0.642113] ... max period: 00007fffffffffff230gitlab # [ 0.643113] ... global_ctrl mask: 000000000000003f231gitlab # [ 0.644239] signal: max sigframe size: 3376232gitlab # [ 0.645237] rcu: Hierarchical SRCU implementation.233gitlab # [ 0.646117] rcu: Max phase no-delay instances is 400.234gitlab # [ 0.647317] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level235gitlab # [ 0.652723] smp: Bringing up secondary CPUs ...236gitlab # [ 0.653536] smpboot: x86: Booting SMP configuration:237gitlab # [ 0.654116] .... node #0, CPUs: #1 #2 #3238gitlab # [ 0.658310] smp: Brought up 1 node, 4 CPUs239gitlab # [ 0.661116] smpboot: Total of 4 processors activated (19200.06 BogoMIPS)240gitlab # [ 0.662792] Memory: 6011352K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260100K reserved, 0K cma-reserved)241gitlab # [ 0.665113] devtmpfs: initialized242gitlab # [ 0.666634] x86/mm: Memory block size: 128MB243gitlab # [ 0.669282] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)244gitlab # [ 0.671201] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).245gitlab # [ 0.672207] pinctrl core: initialized pinctrl subsystem246gitlab # [ 0.673492] PM: RTC time: 11:34:44, date: 2026-08-11247gitlab # [ 0.677182] NET: Registered PF_NETLINK/PF_ROUTE protocol family248gitlab # [ 0.679545] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations249gitlab # [ 0.680173] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations250gitlab # [ 0.682259] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations251gitlab # [ 0.683126] audit: initializing netlink subsys (disabled)252gitlab # [ 0.684373] audit: type=2000 audit(1786448084.391:1): state=initialized audit_enabled=0 res=1253gitlab # [ 0.684396] thermal_sys: Registered thermal governor 'fair_share'254gitlab # [ 0.686113] thermal_sys: Registered thermal governor 'bang_bang'255gitlab # [ 0.687113] thermal_sys: Registered thermal governor 'step_wise'256gitlab # [ 0.688113] thermal_sys: Registered thermal governor 'user_space'257gitlab # [ 0.689113] thermal_sys: Registered thermal governor 'power_allocator'258gitlab # [ 0.690133] cpuidle: using governor menu259gitlab # [ 0.693363] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5260gitlab # [ 0.694433] PCI: Using configuration type 1 for base access261gitlab # [ 0.695113] PCI: Using configuration type 1 for extended access262gitlab # [ 0.696252] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.263gitlab # [ 0.699571] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages264gitlab # [ 0.701114] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page265gitlab # [ 0.702115] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages266gitlab # [ 0.703113] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page267gitlab # [ 0.708430] ACPI: Added _OSI(Module Device)268gitlab # [ 0.712122] ACPI: Added _OSI(Processor Device)269gitlab # [ 0.715125] ACPI: Added _OSI(Processor Aggregator Device)270gitlab # [ 0.724211] ACPI: 1 ACPI AML tables successfully acquired and loaded271gitlab # [ 0.733860] ACPI: Interpreter enabled272gitlab # [ 0.737398] ACPI: PM: (supports S0 S3 S4 S5)273gitlab # [ 0.740125] ACPI: Using IOAPIC for interrupt routing274gitlab # [ 0.744427] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug275gitlab # [ 0.751121] PCI: Using E820 reservations for host bridge windows276gitlab # [ 0.755717] ACPI: Enabled 2 GPEs in block 00 to 0F277gitlab # [ 0.771536] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])278gitlab # [ 0.775129] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]279gitlab # [ 0.782206] acpiphp: Slot [3] registered280gitlab # [ 0.784242] acpiphp: Slot [4] registered281gitlab # [ 0.787241] acpiphp: Slot [5] registered282gitlab # [ 0.789256] acpiphp: Slot [6] registered283gitlab # [ 0.792178] acpiphp: Slot [7] registered284gitlab # [ 0.793182] acpiphp: Slot [8] registered285gitlab # [ 0.794172] acpiphp: Slot [9] registered286gitlab # [ 0.796185] acpiphp: Slot [10] registered287gitlab # [ 0.797177] acpiphp: Slot [11] registered288gitlab # [ 0.798187] acpiphp: Slot [12] registered289gitlab # [ 0.799183] acpiphp: Slot [13] registered290gitlab # [ 0.801457] acpiphp: Slot [14] registered291gitlab # [ 0.802158] acpiphp: Slot [15] registered292gitlab # [ 0.804152] acpiphp: Slot [16] registered293gitlab # [ 0.806237] acpiphp: Slot [17] registered294gitlab # [ 0.809205] acpiphp: Slot [18] registered295gitlab # [ 0.812205] acpiphp: Slot [19] registered296gitlab # [ 0.816205] acpiphp: Slot [20] registered297gitlab # [ 0.819254] acpiphp: Slot [21] registered298gitlab # [ 0.822207] acpiphp: Slot [22] registered299gitlab # [ 0.825225] acpiphp: Slot [23] registered300gitlab # [ 0.828206] acpiphp: Slot [24] registered301gitlab # [ 0.831239] acpiphp: Slot [25] registered302gitlab # [ 0.835206] acpiphp: Slot [26] registered303gitlab # [ 0.838203] acpiphp: Slot [27] registered304gitlab # [ 0.841258] acpiphp: Slot [28] registered305gitlab # [ 0.843232] acpiphp: Slot [29] registered306gitlab # [ 0.846199] acpiphp: Slot [30] registered307gitlab # [ 0.849183] acpiphp: Slot [31] registered308gitlab # [ 0.851243] PCI host bridge to bus 0000:00309gitlab # [ 0.854182] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]310gitlab # [ 0.856116] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]311gitlab # [ 0.858115] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]312gitlab # [ 0.860115] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]313gitlab # [ 0.863124] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]314gitlab # [ 0.865116] pci_bus 0000:00: root bus resource [bus 00-ff]315gitlab # [ 0.868562] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint316gitlab # [ 0.876409] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint317gitlab # [ 0.884384] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint318gitlab # [ 0.896283] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]319gitlab # [ 0.900283] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk320gitlab # [ 0.905122] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk321gitlab # [ 0.910123] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk322gitlab # [ 0.915122] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk323gitlab # [ 0.919932] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint324gitlab # [ 0.928245] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]325gitlab # [ 0.933626] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint326gitlab # [ 0.939402] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI327gitlab # [ 0.941129] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB328gitlab # [ 0.945647] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint329gitlab # [ 0.969230] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]330gitlab # [ 0.971145] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]331gitlab # [ 0.973166] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]332gitlab # [ 0.975391] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]333gitlab # [ 0.994121] pci 0000:00:02.0: pci_fixup_video+0x0/0x100 took 18554 usecs334gitlab # [ 0.997515] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint335gitlab # [ 1.004194] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]336gitlab # [ 1.006138] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]337gitlab # [ 1.008168] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]338gitlab # [ 1.010129] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]339gitlab # [ 1.015115] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint340gitlab # [ 1.022370] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]341gitlab # [ 1.024130] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]342gitlab # [ 1.026167] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]343gitlab # [ 1.030166] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint344gitlab # [ 1.036133] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]345gitlab # [ 1.038129] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]346gitlab # [ 1.040168] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]347gitlab # [ 1.044178] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint348gitlab # [ 1.051155] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]349gitlab # [ 1.052128] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]350gitlab # [ 1.054167] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]351gitlab # [ 1.059828] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint352gitlab # [ 1.064151] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]353gitlab # [ 1.066137] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]354gitlab # [ 1.068174] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]355gitlab # [ 1.072841] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint356gitlab # [ 1.090158] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]357gitlab # [ 1.094159] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]358gitlab # [ 1.099254] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]359gitlab # [ 1.110686] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint360gitlab # [ 1.123149] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]361gitlab # [ 1.127148] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]362gitlab # [ 1.130224] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]363gitlab # [ 1.135155] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]364gitlab # [ 1.140805] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint365gitlab # [ 1.146157] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]366gitlab # [ 1.148168] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]367gitlab # [ 1.152318] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint368gitlab # [ 1.158156] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]369gitlab # [ 1.160129] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]370gitlab # [ 1.161166] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]371gitlab # [ 1.166479] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint372gitlab # [ 1.171156] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]373gitlab # [ 1.172128] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]374gitlab # [ 1.174166] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]375gitlab # [ 1.184536] ACPI: PCI: Interrupt link LNKA configured for IRQ 10376gitlab # [ 1.186345] ACPI: PCI: Interrupt link LNKB configured for IRQ 10377gitlab # [ 1.188327] ACPI: PCI: Interrupt link LNKC configured for IRQ 11378gitlab # [ 1.190303] ACPI: PCI: Interrupt link LNKD configured for IRQ 11379gitlab # [ 1.192221] ACPI: PCI: Interrupt link LNKS configured for IRQ 9380gitlab # [ 1.197124] iommu: Default domain type: Translated381gitlab # [ 1.198114] iommu: DMA domain TLB invalidation policy: lazy mode382gitlab # [ 1.200382] ACPI: bus type USB registered383gitlab # [ 1.202220] usbcore: registered new interface driver usbfs384gitlab # [ 1.203175] usbcore: registered new interface driver hub385gitlab # [ 1.205249] usbcore: registered new device driver usb386gitlab # [ 1.209090] NetLabel: Initializing387gitlab # [ 1.209951] NetLabel: domain hash size = 128388gitlab # [ 1.211113] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO389gitlab # [ 1.213205] NetLabel: unlabeled traffic allowed by default390gitlab # [ 1.215130] PCI: Using ACPI for IRQ routing391gitlab # [ 1.217267] pci 0000:00:02.0: vgaarb: setting as boot VGA device392gitlab # [ 1.218108] pci 0000:00:02.0: vgaarb: bridge control possible393gitlab # [ 1.218108] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none394gitlab # [ 1.223119] vgaarb: loaded395gitlab # [ 1.224287] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0396gitlab # [ 1.225113] hpet0: 3 comparators, 64-bit 100.000000 MHz counter397gitlab # [ 1.232382] clocksource: Switched to clocksource kvm-clock398gitlab # [ 1.236794] VFS: Disk quotas dquot_6.6.0399gitlab # [ 1.238077] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)400gitlab # [ 1.240548] pnp: PnP ACPI init401gitlab # [ 1.242391] pnp: PnP ACPI: found 6 devices402gitlab # [ 1.252333] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns403gitlab # [ 1.255067] clocksource: Switched to clocksource acpi_pm404gitlab # [ 1.256884] NET: Registered PF_INET protocol family405gitlab # [ 1.260027] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)406gitlab # [ 1.299031] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)407gitlab # [ 1.305526] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)408gitlab # [ 1.311709] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)409gitlab # [ 1.324156] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)410gitlab # [ 1.328926] TCP: Hash tables configured (established 65536 bind 65536)411gitlab # [ 1.333148] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)412gitlab # [ 1.338892] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)413gitlab # [ 1.344965] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)414gitlab # [ 1.351295] NET: Registered PF_UNIX/PF_LOCAL protocol family415gitlab # [ 1.355822] NET: Registered PF_XDP protocol family416gitlab # [ 1.359551] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]417gitlab # [ 1.364311] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]418gitlab # [ 1.368972] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]419gitlab # [ 1.374129] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]420gitlab # [ 1.379322] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]421gitlab # [ 1.385315] pci 0000:00:01.0: PIIX3: Enabling Passive Release422gitlab # [ 1.388977] pci 0000:00:00.0: Limiting direct PCI/PCI transfers423gitlab # [ 1.395732] ACPI: \_SB_.LNKD: Enabled at IRQ 11424gitlab # [ 1.401358] PCI: CLS 0 bytes, default 64425gitlab # [ 1.402853] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)426gitlab # [ 1.403456] Trying to unpack rootfs image as initramfs...427gitlab # [ 1.404780] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)428gitlab # [ 1.404965] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns429gitlab # [ 1.455421] Initialise system trusted keyrings430gitlab # [ 1.457532] workingset: timestamp_bits=40 max_order=21 bucket_order=0431gitlab # [ 1.492704] Key type asymmetric registered432gitlab # [ 1.495959] Asymmetric key parser 'x509' registered433gitlab # [ 1.499539] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)434gitlab # [ 1.504730] io scheduler mq-deadline registered435gitlab # [ 1.508206] io scheduler kyber registered436gitlab # [ 1.516705] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled437gitlab # [ 1.522806] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A438gitlab # [ 1.532838] Linux agpgart interface v0.103439gitlab # [ 1.536233] ACPI: bus type drm_connector registered440gitlab # [ 1.544285] usbcore: registered new interface driver usbserial_generic441gitlab # [ 1.549293] usbserial: USB Serial support registered for generic442gitlab # [ 1.553848] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.443gitlab # [ 1.553848] Please enable it if your BIOS has the CPPC option.444gitlab # [ 1.563796] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled445gitlab # [ 1.570037] drop_monitor: Initializing network drop monitor service446gitlab # [ 1.575254] NET: Registered PF_INET6 protocol family447gitlab # [ 1.582465] Segment Routing with IPv6448gitlab # [ 1.585712] In-situ OAM (IOAM) with IPv6449gitlab # [ 1.592281] IPI shorthand broadcast: enabled450gitlab # [ 1.606288] sched_clock: Marking stable (1338204362, 267585609)->(1678351966, -72561995)451gitlab # [ 1.613544] registered taskstats version 1452gitlab # [ 1.617853] Loading compiled-in X.509 certificates453gitlab # [ 1.643996] Demotion targets for Node 0: null454gitlab # [ 1.647466] Key type .fscrypt registered455gitlab # [ 1.650018] Key type fscrypt-provisioning registered456gitlab # [ 1.653332] ima: No TPM chip found, activating TPM-bypass!457gitlab # [ 1.656677] ima: Allocated hash algorithm: sha1458gitlab # [ 1.659557] ima: No architecture policies found459gitlab # [ 1.663049] PM: Magic number: 6:35:580460gitlab # [ 1.665451] RAS: Correctable Errors collector initialized.461gitlab # [ 1.670977] clk: Disabling unused clocks462gitlab # [ 1.672261] PM: genpd: Disabling unused power domains463gitlab # [ 1.711048] Freeing initrd memory: 29392K464gitlab # [ 1.718456] Freeing unused decrypted memory: 2028K465gitlab # [ 1.726504] Freeing unused kernel image (initmem) memory: 3640K466gitlab # [ 1.730260] Write protecting the kernel read-only data: 32768k467gitlab # [ 1.736219] Freeing unused kernel image (text/rodata gap) memory: 1220K468gitlab # [ 1.741273] Freeing unused kernel image (rodata/data gap) memory: 760K469gitlab # [ 1.795722] x86/mm: Checked W+X mappings: passed, no W+X pages found.470gitlab # [ 1.797858] Run /init as init process471gitlab # [ 1.812665] systemd[1]: Inserted module 'autofs4'472gitlab # [ 1.842187] fuse: init (API version 7.45)473gitlab # [ 1.852786] ACPI: \_SB_.LNKC: Enabled at IRQ 10474gitlab # [ 1.862860] ACPI: \_SB_.LNKA: Enabled at IRQ 10475gitlab # [ 1.879949] ACPI: \_SB_.LNKB: Enabled at IRQ 11476gitlab # [ 1.932859] systemd[1]: Successfully made /usr/ read-only.477gitlab # [ 2.270425] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)478gitlab # [ 2.285414] systemd[1]: Detected virtualization kvm.479gitlab # [ 2.289478] systemd[1]: Detected architecture x86-64.480gitlab # [ 2.293682] systemd[1]: Running in initrd.481gitlab # [ 2.298078] systemd[1]: Initializing machine ID from random generator.482gitlab # [ 2.303361] systemd[1]: Hostname set to <gitlab>.483gitlab # [ 2.423878] systemd[1]: bpf-restrict-fs: LSM BPF program attached484gitlab # [ 2.476674] systemd[1]: Queued start job for default target Initrd Default Target.485gitlab # [ 2.490866] systemd[1]: Created slice Slice /system/modprobe.486gitlab # [ 2.492978] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.487gitlab # [ 2.495495] systemd[1]: Expecting device /dev/disk/by-label/nix-store...488gitlab # [ 2.497674] systemd[1]: Expecting device /dev/disk/by-label/nixos...489gitlab # [ 2.499700] systemd[1]: Reached target Path Units.490gitlab # [ 2.501922] systemd[1]: Reached target Slice Units.491gitlab # [ 2.503548] systemd[1]: Reached target Swaps.492gitlab # [ 2.505124] systemd[1]: Reached target Timer Units.493gitlab # [ 2.507021] systemd[1]: Listening on D-Bus System Message Bus Socket.494gitlab # [ 2.509186] systemd[1]: Listening on Journal Socket (/dev/log).495gitlab # [ 2.511229] systemd[1]: Listening on Journal Sockets.496gitlab # [ 2.513016] systemd[1]: Listening on udev Control Socket.497gitlab # [ 2.514855] systemd[1]: Listening on udev Kernel Socket.498gitlab # [ 2.516659] systemd[1]: Reached target Socket Units.499gitlab # [ 2.519974] systemd[1]: Starting Create List of Static Device Nodes...500gitlab # [ 2.523223] systemd[1]: Starting Load Kernel Module 9pnet_virtio...501gitlab # [ 2.526337] systemd[1]: Starting Load Kernel Module configfs...502gitlab # [ 2.540719] systemd[1]: Starting Journal Service...503gitlab # [ 2.545414] systemd[1]: Starting Load Kernel Modules...504gitlab # [ 2.547696] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os505gitlab # [ 2.556003] systemd[1]: Starting Coldplug All udev Devices...506gitlab # [ 2.564146] systemd-journald[94]: Collecting audit messages is disabled.507gitlab # [ 2.595856] systemd[1]: Finished Create List of Static Device Nodes.508gitlab # [ 2.603316] systemd[1]: modprobe@configfs.service: Deactivated successfully.509gitlab # [ 2.606500] systemd[1]: Finished Load Kernel Module configfs.510gitlab # [ 2.609192] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config511gitlab # [ 2.616957] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.512gitlab # [ 2.618167] netfs: FS-Cache loaded513gitlab # [ 2.621082] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...514gitlab # [ 2.626233] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev515gitlab # [ 2.634854] 9pnet: Installing 9P2000 support516gitlab # [ 2.636182] systemd[1]: Finished Load Kernel Modules.517gitlab # [ 2.646297] systemd[1]: Starting Apply Kernel Variables...518gitlab # [ 2.648715] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.519gitlab # [ 2.656084] systemd[1]: Finished Load Kernel Module 9pnet_virtio.520gitlab # [ 2.659312] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.521gitlab # [ 2.662859] systemd[1]: Finished Apply Kernel Variables.522gitlab # [ 2.395923] systemd-modules-load[95]: Using 4 probe threads523gitlab # [ 2.666343] systemd[1]: Started Journal Service.524gitlab # [ 2.399293] systemd-modules-load[95]: Inserted module 'virtio_balloon'525gitlab # [ 2.401726] systemd-modules-load[95]: Inserted module 'virtio_gpu'526gitlab # [ 2.403516] systemd-modules-load[95]: Inserted module 'dm_mod'527gitlab # [ 2.410280] systemd[1]: Starting Create Static Device Nodes in /dev...528gitlab # [ 2.427963] systemd[1]: Finished Create Static Device Nodes in /dev.529gitlab # [ 2.429997] systemd[1]: Reached target Preparation for Local File Systems.530gitlab # [ 2.431864] systemd[1]: Reached target Local File Systems.531gitlab # [ 2.433330] systemd[1]: Starting Create System Files and Directories...532gitlab # [ 2.435279] systemd[1]: Starting Rule-based Manager for Device Events and Files...533gitlab # [ 2.449986] systemd[1]: Finished Create System Files and Directories.534gitlab # [ 2.461816] systemd-udevd[115]: Using default interface naming scheme 'v261'.535gitlab # [ 2.477043] systemd[1]: Started Rule-based Manager for Device Events and Files.536gitlab # [ 2.491427] systemd[1]: Finished Coldplug All udev Devices.537gitlab # [ 2.493710] systemd[1]: Reached target System Initialization.538gitlab # [ 2.495919] systemd[1]: Reached target Basic System.539gitlab # [ 2.919279] virtio_blk virtio4: 4/0/0 default/read/poll queues540gitlab # [ 2.922132] uhci_hcd 0000:00:01.2: UHCI Host Controller541gitlab # [ 2.923473] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1542gitlab # [ 2.925537] uhci_hcd 0000:00:01.2: detected 2 ports543gitlab # [ 2.929350] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140544gitlab # [ 2.930620] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)545gitlab # [ 2.930686] SCSI subsystem initialized546gitlab # [ 2.931056] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18547gitlab # [ 2.936890] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1548gitlab # [ 2.938665] usb usb1: Product: UHCI Host Controller549gitlab # [ 2.940097] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd550gitlab # [ 2.940127] virtio_blk virtio5: 4/0/0 default/read/poll queues551gitlab # [ 2.940435] usb usb1: SerialNumber: 0000:00:01.2552gitlab # [ 2.950181] hub 1-0:1.0: USB hub found553gitlab # [ 2.951358] hub 1-0:1.0: 2 ports detected554gitlab # [ 2.963799] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12555gitlab # [ 2.969521] virtio_blk virtio5: [vdb] 11784584 512-byte logical blocks (6.03 GB/5.62 GiB)556gitlab # [ 2.970307] serio: i8042 KBD port at 0x60,0x64 irq 1557gitlab # [ 2.973759] serio: i8042 AUX port at 0x60,0x64 irq 12558gitlab # [ 2.975970] scsi host0: ata_piix559gitlab # [ 2.979231] scsi host1: ata_piix560gitlab # [ 2.980302] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0561gitlab # [ 2.982186] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0562gitlab # [ 2.754247] systemd[1]: Starting Virtual Console Setup...563gitlab # [ 2.761735] (udev-worker)[144]: Network interface NamePolicy= disabled on kernel command line.564gitlab # [ 2.767085] (udev-worker)[136]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.565gitlab # [ 2.772266] (udev-worker)[136]: Network interface NamePolicy= disabled on kernel command line.566gitlab # [ 2.783132] systemd[1]: Found device /dev/disk/by-label/nix-store.567gitlab # [ 2.784978] systemd-vconsole-setup[154]: Configuration of first virtual console was skipped, ignoring remaining ones.568gitlab # [ 2.787823] systemd[1]: Found device /dev/disk/by-label/nixos.569gitlab # [ 2.789529] systemd[1]: Finished Virtual Console Setup.570gitlab # [ 2.790952] systemd[1]: Reached target Initrd Root Device.571gitlab # [ 2.792495] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...572gitlab # [ 2.818873] systemd-fsck[161]: nixos: clean, 12/65536 files, 13019/262144 blocks573gitlab # [ 2.823864] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.574gitlab # [ 3.144493] ata2: found unknown device (class 0)575gitlab # [ 3.146541] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100576gitlab # [ 3.150665] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5577gitlab # [ 3.176718] usb 1-1: new full-speed USB device number 2 using uhci_hcd578gitlab # [ 3.184568] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0579gitlab # [ 3.214558] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray580gitlab # [ 3.242983] cdrom: Uniform CD-ROM driver Revision: 3.20581gitlab # [ 3.347907] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00582gitlab # [ 3.352865] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10583gitlab # [ 3.357226] usb 1-1: Product: QEMU USB Tablet584gitlab # [ 3.360060] usb 1-1: Manufacturer: QEMU585gitlab # [ 3.362671] usb 1-1: SerialNumber: 28754-0000:00:01.2-1586gitlab # [ 3.400121] hid: raw HID events driver (C) Jiri Kosina587gitlab # [ 3.415737] usbcore: registered new interface driver usbhid588gitlab # [ 3.419044] usbhid: USB HID core driver589gitlab # [ 3.430886] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2590gitlab # [ 3.436804] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0591gitlab # [ 3.301725] systemd[1]: Mounting /sysroot...592gitlab # [ 3.759767] EXT4-fs (vda): mounted filesystem 7b3ba74a-e7e9-4190-b09a-5ab98a028329 r/w with ordered data mode. Quota mode: none.593gitlab # [ 3.496968] systemd[1]: Mounted /sysroot.594gitlab # [ 3.499472] systemd[1]: Reached target Initrd Root File System.595gitlab # [ 3.501780] systemd[1]: Mounting /sysroot/nix/.ro-store...596gitlab # [ 3.503880] systemd[1]: Mounting /sysroot/nix/.rw-store...597gitlab # [ 3.508578] systemd[1]: Mounting /sysroot/run...598gitlab # [ 3.510567] systemd[1]: Mounting /sysroot/tmp/shared...599gitlab # [ 3.515527] systemd[1]: Mounting /sysroot/tmp/xchg...600gitlab # [ 3.519857] systemd[1]: Starting Mountpoints Configured in the Real Root...601gitlab # [ 3.526820] systemd[1]: Mounted /sysroot/nix/.rw-store.602gitlab # [ 3.529571] systemd[1]: Mounted /sysroot/run.603gitlab # [ 3.797256] 9p: Installing v9fs 9p2000 file system support604gitlab # [ 3.805235] erofs (device vdb): mounted with root inode @ nid 128.605gitlab # [ 3.540344] systemd[1]: Starting rw-sysroot-nix-store.service...606gitlab # [ 3.542059] systemd[1]: Mounted /sysroot/tmp/shared.607gitlab # [ 3.543740] systemd-sysroot-fstab-check[181]: /sysroot should be mounted in the initrd, will request daemon-reload.608gitlab # [ 3.546285] systemd[1]: Mounted /sysroot/nix/.ro-store.609gitlab # [ 3.547553] systemd[1]: Mounted /sysroot/tmp/xchg.610gitlab # [ 3.548780] systemd[1]: Reload requested from client PID 181 ('systemd-sysroot') (unit initrd-parse-etc.service)...611gitlab # [ 3.551379] systemd[1]: Reloading...612gitlab # [ 3.615469] systemd[1]: Reloading finished in 66 ms.613gitlab # [ 3.637887] systemd-sysroot-fstab-check[181]: Requesting initrd-fs.target/start/replace...614gitlab # [ 3.642808] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.615gitlab # [ 3.647264] systemd[1]: Finished rw-sysroot-nix-store.service.616gitlab # [ 3.650741] systemd-sysroot-fstab-check[181]: Requesting swap.target/start/replace...617gitlab # [ 3.655251] systemd[1]: initrd-parse-etc.service: Deactivated successfully.618gitlab # [ 3.659275] systemd[1]: Finished Mountpoints Configured in the Real Root.619gitlab # [ 3.663118] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.620gitlab # [ 3.667397] systemd[1]: Starting rw-sysroot-nix-store.service...621gitlab # [ 3.673179] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.622gitlab # [ 3.676502] systemd[1]: Finished rw-sysroot-nix-store.service.623gitlab # [ 4.304637] systemd[1]: Mounting /sysroot/nix/store...624gitlab # [ 4.364466] systemd[1]: Mounted /sysroot/nix/store.625gitlab # [ 4.369197] systemd[1]: Reached target Initrd File Systems.626gitlab # [ 4.375207] systemd[1]: Starting Find NixOS closure...627gitlab # [ 4.380644] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...628gitlab # [ 4.413861] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.629gitlab # [ 4.419114] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.630gitlab # [ 4.438177] systemd[1]: Finished Find NixOS closure.631gitlab # [ 4.441984] systemd[1]: Reached target Initrd Default Target.632gitlab # [ 4.445624] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...633gitlab # [ 4.480685] systemd[1]: Stopped target Initrd Default Target.634gitlab # [ 4.484310] systemd[1]: Stopped target Basic System.635gitlab # [ 4.487466] systemd[1]: Stopped target Initrd Root Device.636gitlab # [ 4.490776] systemd[1]: Stopped target Path Units.637gitlab # [ 4.493802] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.638gitlab # [ 4.498289] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.639gitlab # [ 4.502824] systemd[1]: Stopped target Slice Units.640gitlab # [ 4.506105] systemd[1]: Stopped target Socket Units.641gitlab # [ 4.510720] systemd[1]: Stopped target System Initialization.642gitlab # [ 4.514109] systemd[1]: Stopped target Swaps.643gitlab # [ 4.516857] systemd[1]: Stopped target Timer Units.644gitlab # [ 4.519692] systemd[1]: dbus.socket: Deactivated successfully.645gitlab # [ 4.523284] systemd[1]: Closed D-Bus System Message Bus Socket.646gitlab # [ 4.526180] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.647gitlab # [ 4.529640] systemd[1]: Stopped Find NixOS closure.648gitlab # [ 4.532149] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio649gitlab # [ 4.536712] systemd[1]: Starting rw-sysroot-nix-store.service...650gitlab # [ 4.538453] systemd[1]: systemd-sysctl.service: Deactivated successfully.651gitlab # [ 4.540111] systemd[1]: Stopped Apply Kernel Variables.652gitlab # [ 4.541425] systemd[1]: systemd-modules-load.service: Deactivated successfully.653gitlab # [ 4.543176] systemd[1]: Stopped Load Kernel Modules.654gitlab # [ 4.544468] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.655gitlab # [ 4.546461] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.656gitlab # [ 4.548293] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.657gitlab # [ 4.550054] systemd[1]: Stopped Create System Files and Directories.658gitlab # [ 4.551574] systemd[1]: Stopped target Local File Systems.659gitlab # [ 4.552932] systemd[1]: Stopped target Preparation for Local File Systems.660gitlab # [ 4.554593] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.661gitlab # [ 4.556300] systemd[1]: Stopped Coldplug All udev Devices.662gitlab # [ 4.557656] systemd[1]: Stopping Rule-based Manager for Device Events and Files...663gitlab # [ 4.559389] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.664gitlab # [ 4.561150] systemd[1]: Stopped Virtual Console Setup.665gitlab # [ 4.562423] systemd[1]: initrd-cleanup.service: Deactivated successfully.666gitlab # [ 4.564096] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.667gitlab # [ 4.565657] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.668gitlab # [ 4.567359] systemd[1]: Finished rw-sysroot-nix-store.service.669gitlab # [ 4.568791] systemd[1]: systemd-udevd.service: Deactivated successfully.670gitlab # [ 4.570373] systemd[1]: Stopped Rule-based Manager for Device Events and Files.671gitlab # [ 4.572200] systemd[1]: systemd-udevd.service: Consumed 1.067s CPU time over 2.112s wall clock time, 28.8M memory peak.672gitlab # [ 4.574890] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.673gitlab # [ 4.576622] systemd[1]: Closed udev Control Socket.674gitlab # [ 4.577863] systemd[1]: Starting Cleanup udev Database...675gitlab # [ 4.579217] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.676gitlab # [ 4.581048] systemd[1]: Stopped Create Static Device Nodes in /dev.677gitlab # [ 4.582528] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.678gitlab # [ 4.584498] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.679gitlab # [ 4.586224] systemd[1]: kmod-static-nodes.service: Deactivated successfully.680gitlab # [ 4.587883] systemd[1]: Stopped Create List of Static Device Nodes.681gitlab # [ 4.589409] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.682gitlab # [ 4.591255] systemd[1]: Finished Cleanup udev Database.683gitlab # [ 4.592540] systemd[1]: Reached target Switch Root.684gitlab # [ 4.593823] systemd[1]: Starting NixOS Activation...685gitlab # [ 4.692229] initrd-nixos-activation-start[228]: booting system configuration /nix/store/k5zd5llhc4a7a33jzm5l6bmf9mwqbmmh-nixos-system-gitlab-test686gitlab # [ 4.736117] initrd-nixos-activation-start[228]: running activation script...687gitlab # [ 4.987861] initrd-nixos-activation-start[251]: setting up /etc...688gitlab # [ 5.104528] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.689gitlab # [ 5.107236] systemd[1]: Finished NixOS Activation.690gitlab # [ 5.112342] systemd[1]: Starting Switch Root...691gitlab # [ 5.139614] systemd[1]: Switching root.692gitlab # [ 5.471909] systemd-journald[94]: Received SIGTERM from PID 1 (systemd).693gitlab # [ 5.580467] NET: Registered PF_VSOCK protocol family694gitlab # [ 5.948509] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)695gitlab # [ 5.958560] systemd[1]: Detected virtualization kvm.696gitlab # [ 5.961727] systemd[1]: Detected architecture x86-64.697gitlab # [ 5.964921] systemd[1]: Detected first boot.698gitlab # [ 5.968866] systemd[1]: Initializing machine ID from random generator.699gitlab # [ 6.113700] systemd[1]: bpf-restrict-fs: LSM BPF program attached700gitlab # [ 6.208108] systemd[1]: Applying preset policy.701gitlab # [ 6.349017] systemd[1]: Populated /etc with preset unit settings.702gitlab # [ 6.484181] systemd[1]: initrd-switch-root.service: Deactivated successfully.703gitlab # [ 6.486440] systemd[1]: Stopped initrd-switch-root.service.704gitlab # [ 6.490156] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.705gitlab # [ 6.493352] systemd[1]: Created slice Slice /system/getty.706gitlab # [ 6.495481] systemd[1]: Created slice GitLab DevOps Platform Slice.707gitlab # [ 6.497862] systemd[1]: Created slice User and Session Slice.708gitlab # [ 6.499561] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.709gitlab # [ 6.501709] systemd[1]: Started Forward Password Requests to Wall Directory Watch.710gitlab # [ 6.503676] systemd[1]: Expecting device /dev/hvc0...711gitlab # [ 6.504965] systemd[1]: Expecting device /dev/ttyS0...712gitlab # [ 6.506299] systemd[1]: Reached target Local Encrypted Volumes.713gitlab # [ 6.507807] systemd[1]: Stopped target initrd-fs.target.714gitlab # [ 6.509149] systemd[1]: Stopped target initrd-root-fs.target.715gitlab # [ 6.510609] systemd[1]: Stopped target initrd-switch-root.target.716gitlab # [ 6.512184] systemd[1]: Reached target Virtual Machines and Containers.717gitlab # [ 6.513839] systemd[1]: Reached target Path Units.718gitlab # [ 6.515130] systemd[1]: Reached target Remote File Systems.719gitlab # [ 6.516648] systemd[1]: Reached target Slice Units.720gitlab # [ 6.517957] systemd[1]: Reached target Swaps.721gitlab # [ 6.520116] systemd[1]: Listening on Query the User Interactively for a Password.722gitlab # [ 6.522973] systemd[1]: Listening on Process Core Dump Socket.723gitlab # [ 6.525104] systemd[1]: Listening on Credential Encryption/Decryption.724gitlab # [ 6.527404] systemd[1]: Listening on Factory Reset Management.725gitlab # [ 6.529070] systemd[1]: Listening on Hostname Service Socket.726gitlab # [ 6.532456] systemd[1]: Starting Journal Log Access Socket...727gitlab # [ 6.534854] systemd[1]: Listening on Journal Audit Socket.728gitlab # [ 6.537531] systemd[1]: Listening on Console Output Muting Service Socket.729gitlab # [ 6.539527] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.730gitlab # [ 6.541533] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os731gitlab # [ 6.543885] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki732gitlab # [ 6.547646] systemd[1]: Listening on Disk Repartitioning Service Socket.733gitlab # [ 6.549410] systemd[1]: Listening on udev Control Socket.734gitlab # [ 6.550996] systemd[1]: Listening on udev Varlink Socket.735gitlab # [ 6.554949] systemd[1]: Mounting Huge Pages File System...736gitlab # [ 6.558100] systemd[1]: Mounting POSIX Message Queue File System...737gitlab # [ 6.561134] systemd[1]: Mounting Kernel Debug File System...738gitlab # [ 6.571675] systemd[1]: Mounting Kernel Trace File System...739gitlab # [ 6.577299] systemd[1]: Starting Create List of Static Device Nodes...740gitlab # [ 6.582930] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio741gitlab # [ 6.602631] systemd[1]: Starting Load Kernel Module configfs...742gitlab # [ 6.604152] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm743gitlab # [ 6.606548] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore744gitlab # [ 6.609132] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse745gitlab # [ 6.612972] systemd[1]: Mounting FUSE Control File System...746gitlab # [ 6.614440] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67747gitlab # [ 6.620471] systemd[1]: Starting Journal Service...748gitlab # [ 6.623381] systemd[1]: Starting Load Kernel Modules...749gitlab # [ 6.644411] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...750gitlab # [ 6.651830] systemd[1]: Starting Remount Root and Kernel File Systems...751gitlab # [ 6.655391] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os752gitlab # [ 6.663208] systemd[1]: Starting Coldplug All udev Devices...753gitlab # [ 6.669861] loop: module loaded754gitlab # [ 6.672611] systemd-journald[323]: Collecting audit messages is enabled.755gitlab # [ 6.674795] systemd[1]: Listening on Journal Log Access Socket.756gitlab # [ 6.676474] systemd[1]: Mounted Huge Pages File System.757gitlab # [ 6.678045] systemd[1]: Mounted POSIX Message Queue File System.758gitlab # [ 6.679754] systemd[1]: Mounted Kernel Debug File System.759gitlab # [ 6.680741] EXT4-fs (vda): re-mounted 7b3ba74a-e7e9-4190-b09a-5ab98a028329.760gitlab # [ 6.684469] systemd[1]: Mounted Kernel Trace File System.761gitlab # [ 6.686844] systemd[1]: Finished Create List of Static Device Nodes.762gitlab # [ 6.689245] systemd[1]: modprobe@configfs.service: Deactivated successfully.763gitlab # [ 6.691837] systemd[1]: Finished Load Kernel Module configfs.764gitlab # [ 6.693726] systemd[1]: Mounted FUSE Control File System.765gitlab # [ 6.427871] systemd[1]: Queued start job for default target M[ 6.696048] systemd[1]: Finished Load Kernel Modules.766gitlab # ulti-User System.767gitlab # [ 6.698024] systemd[1]: Started Journal Service.768gitlab # [ 6.431203] systemd[1]: Unnecessary job was removed for /dev/vdb.769gitlab # [ 6.433665] systemd[1]: systemd-journald.service: Deactivated successfully.770gitlab # [ 6.435701] systemd-modules-load[324]: Using 3 probe threads771gitlab # [ 6.437491] systemd-modules-load[324]: Inserted module 'loop'772gitlab # [ 6.439257] systemd-modules-load[324]: Inserted module 'tls'773gitlab # [ 6.440910] systemd[1]: Finished Remount Root and Kernel File Systems.774gitlab # [ 6.442752] systemd[1]: Listening on Disk Image Download Service Socket.775gitlab # [ 6.445567] systemd[1]: Mounting Kernel Configuration File System...776gitlab # [ 6.447607] systemd[1]: Starting Firewall...777gitlab # [ 6.448997] systemd[1]: Starting Flush Journal to Persistent Storage...778gitlab # [ 6.452459] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore779gitlab # [ 6.455174] systemd[1]: Starting Load/Save OS Random Seed...780gitlab # [ 6.456660] systemd[1]: Starting Apply Kernel Variables...781gitlab # [ 6.458069] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...782gitlab # [ 6.459994] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os783gitlab # [ 6.462627] systemd-oomd[325]: No swap; memory pressure usage will be degraded784gitlab # [ 6.473148] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.785gitlab # [ 6.747846] systemd-journald[323]: Received client request to flush runtime journal.786gitlab # [ 6.548276] systemd[1]: Mounted Kernel Configuration File System.787gitlab # [ 6.552590] systemd[1]: Finished Load/Save OS Random Seed.788gitlab # [ 6.554296] systemd[1]: Finished Apply Kernel Variables.789gitlab # [ 6.556348] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.790gitlab # [ 6.558113] systemd[1]: Reached target First Boot Complete.791gitlab # [ 6.559477] systemd[1]: Starting Create Static Device Nodes in /dev...792gitlab # [ 6.561138] systemd[1]: Finished Create Static Device Nodes in /dev.793gitlab # [ 6.562870] systemd[1]: Reached target Preparation for Local File Systems.794gitlab # [ 6.564506] systemd[1]: Starting Rule-based Manager for Device Events and Files...795gitlab # [ 6.566343] systemd[1]: Finished Flush Journal to Persistent Storage.796gitlab # [ 6.568237] systemd-udevd[361]: Using default interface naming scheme 'v261'.797gitlab # [ 6.590735] systemd[1]: Finished Coldplug All udev Devices.798gitlab # [ 6.603109] systemd[1]: Started Rule-based Manager for Device Events and Files.799gitlab # [ 6.723716] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse800gitlab # [ 6.749899] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.801gitlab # [ 6.775421] systemd[1]: Finished Firewall.802gitlab # [ 6.780766] (udev-worker)[439]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.803gitlab # [ 6.784549] (udev-worker)[439]: Network interface NamePolicy= disabled on kernel command line.804gitlab # [ 6.803761] (udev-worker)[438]: Network interface NamePolicy= disabled on kernel command line.805gitlab # [ 6.821259] systemd[1]: Condition check resulted in Virtio network device being skipped.806gitlab # [ 6.824182] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.807gitlab # [ 6.826124] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore808gitlab # [ 6.828674] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67809gitlab # [ 6.832417] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore810gitlab # [ 6.835242] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os811gitlab # [ 6.837402] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os812gitlab # [ 7.128674] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3813gitlab # [ 7.150232] ACPI: button: Power Button [PWRF]814gitlab # [ 7.152267] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0815gitlab # [ 7.159623] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD816gitlab # [ 7.194633] rtc_cmos 00:05: RTC can wake from S4817gitlab # [ 7.196635] Floppy drive(s): fd0 is 2.88M AMI BIOS818gitlab # [ 7.196762] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console819gitlab # [ 7.208361] FDC 0 is a S82078B820gitlab # [ 7.208757] rtc_cmos 00:05: registered as rtc0821gitlab # [ 7.209162] rtc_cmos 00:05: setting system clock to 2026-08-11T11:34:50 UTC (1786448090)822gitlab # [ 7.209323] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs823gitlab # [ 7.214786] Console: switching to colour dummy device 80x25824gitlab # [ 7.221682] [drm] Found bochs VGA, ID 0xb0c5.825gitlab # [ 7.222566] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.826gitlab # [ 7.226263] parport_pc 00:03: reported by Plug and Play ACPI827gitlab # [ 7.226343] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic828gitlab # [ 7.229336] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0829gitlab # [ 7.230997] systemd-journald[323]: Time jumped backwards, rotating.830gitlab # [ 7.235722] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]831gitlab # [ 7.253029] Console: switching to colour frame buffer device 160x50832gitlab # [ 7.256683] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device833gitlab # [ 7.269366] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5834gitlab # [ 7.297629] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4835gitlab # [ 7.365459] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6836gitlab # [ 7.387754] mousedev: PS/2 mouse device common for all mice837gitlab # [ 7.394264] kvm_amd: TSC scaling supported838gitlab # [ 7.395797] kvm_amd: Nested Virtualization enabled839gitlab # [ 7.397440] kvm_amd: Nested Paging enabled840gitlab # [ 7.128226] systemd[1]: Start[ 7.398799] kvm_amd: LBR virtualization supported841gitlab # ing Virtual Cons[ 7.399909] kvm_amd: Virtual VMLOAD VMSAVE supported842gitlab # ole Setup...843gitlab # [ 7.401102] kvm_amd: Virtual GIF supported844gitlab # [ 7.402096] kvm_amd: Virtual NMI enabled845gitlab # [ 7.418626] ppdev: user-space parallel port driver846gitlab # [ 7.160530] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.847gitlab # [ 7.162570] systemd[1]: Stopped Virtual Console Setup.848gitlab # [ 7.167656] systemd[1]: Starting Virtual Console Setup...849gitlab # [ 7.462228] EDAC MC: Ver: 3.0.0850gitlab # [ 7.218806] systemd[1]: Mounting /run/wrappers...851gitlab # [ 7.232651] systemd-vconsole-setup[497]: Configuration of first virtual console was skipped, ignoring remaining ones.852gitlab # [ 7.236798] systemd[1]: Finished Virtual Console Setup.853gitlab # [ 7.241295] systemd[1]: Mounted /run/wrappers.854gitlab # [ 7.242489] systemd[1]: Reached target Local File Systems.855gitlab # [ 7.243863] systemd[1]: Listening on Boot Loader Control Service Socket.856gitlab # [ 7.245456] systemd[1]: Starting register-nix-paths.service...857gitlab # [ 7.247161] systemd[1]: Starting Create SUID/SGID Wrappers...858gitlab # [ 7.248587] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.859gitlab # [ 7.250710] systemd[1]: Starting Save Transient machine-id to Disk...860gitlab # [ 7.257823] systemd[1]: Starting Create System Files and Directories...861gitlab # [ 7.287162] systemd[1]: Finished Create System Files and Directories.862gitlab # [ 7.290376] systemd[1]: Starting Rebuild Journal Catalog...863gitlab # [ 7.293837] systemd[1]: Starting Record System Boot/Shutdown in UTMP...864gitlab # [ 7.305069] systemd[1]: Finished Save Transient machine-id to Disk.865gitlab # [ 7.318132] systemd[1]: Finished Record System Boot/Shutdown in UTMP.866gitlab # [ 7.335304] systemd[1]: Finished Rebuild Journal Catalog.867gitlab # [ 7.337480] systemd[1]: Starting Update is Completed...868gitlab # [ 7.356077] systemd[1]: Finished Update is Completed.869gitlab # [ 7.386678] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.870gitlab # [ 7.388721] systemd[1]: Finished Create SUID/SGID Wrappers.871gitlab # [ 7.636730] systemd[1]: Finished register-nix-paths.service.872gitlab # [ 7.640390] systemd[1]: Reached target System Initialization.873gitlab # [ 7.643918] systemd[1]: Started Discard unused filesystem blocks once a week.874gitlab # [ 7.648265] systemd[1]: Started logrotate.timer.875gitlab # [ 7.651369] systemd[1]: Started Daily Cleanup of Temporary Directories.876gitlab # [ 7.655382] systemd[1]: Reached target Timer Units.877gitlab # [ 7.658491] systemd[1]: Listening on D-Bus System Message Bus Socket.878gitlab # [ 7.662367] systemd[1]: Listening on Nix Daemon Socket.879gitlab # [ 7.665614] systemd[1]: Starting nixbot CI service socket...880gitlab # [ 7.669219] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.881gitlab # [ 7.674442] systemd[1]: Listening on nixbot CI service socket.882gitlab # [ 7.678678] systemd[1]: Reached target Socket Units.883gitlab # [ 7.681862] systemd[1]: Starting D-Bus System Message Bus...884gitlab # [ 7.730978] dbus-broker-launch[580]: Looking up NSS user entry for 'systemd-timesync'...885gitlab # [ 7.736903] dbus-broker-launch[580]: NSS returned no entry for 'systemd-timesync'886gitlab # [ 7.741746] dbus-broker-launch[580]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"887gitlab # [ 7.750643] systemd[1]: Started D-Bus System Message Bus.888gitlab # [ 7.754578] dbus-broker-launch[580]: Ready889gitlab # [ 7.757585] systemd[1]: Reached target Basic System.890gitlab # [ 7.761279] systemd[1]: Started backdoor.service.891gitlab # [ 7.764830] systemd[1]: Starting gitlab-config.service...892gitlab # [ 7.777517] systemd[1]: Starting Import lastlog data into lastlog2 database...893gitlab # [ 7.782424] systemd[1]: Starting Logrotate configuration check...894gitlab # [ 7.786555] systemd[1]: Starting Name Service Cache Daemon (nsncd)...895gitlab # connecting to host...896gitlab # [ 7.792215] systemd[1]: Starting Post-Boot Actions...897gitlab # [ 7.800307] systemd[1]: Started Reset console on configuration changes.898gitlab # [ 7.807169] systemd[1]: Starting resolvconf update...899gitlab: Guest shell says: b'Spawning backdoor root shell...\n'900gitlab # [ 7.812499] logrotate[585]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.901gitlab # [ 7.814272] logrotate[585]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf902gitlab: connected to guest root shell903gitlab # [ 7.815076] logrotate[585]: note: 'monthly' overrides previously specified 'weekly'904gitlab: (connecting took 8.65 seconds)905gitlab # [ 7.815851] logrotate[585]: Reading state from file: /var/lib/logrotate.status906gitlab: (finished: waiting for the VM to finish booting, in 8.65 seconds)907gitlab # [ 7.816795] logrotate[585]: state file /var/lib/logrotate.status does not exist908gitlab # [ 7.817842] logrotate[585]: Allocating hash table for state file, size 64 entries909gitlab # [ 7.818977] logrotate[585]: Handling 4 logs910gitlab # [ 7.819961] logrotate[585]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed911gitlab # [ 7.820763] logrotate[585]: considering log /var/log/btmp912gitlab # [ 7.821809] logrotate[585]: Creating new state913gitlab # [ 7.822596] logrotate[585]: Now: 2026-08-11 11:34914gitlab # [ 7.823687] logrotate[585]: Last rotated at 2026-08-11 11:00915gitlab # [ 7.824735] logrotate[585]: log does not need rotating (log has already been rotated)916gitlab # [ 7.825838] logrotate[585]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed917gitlab # [ 7.826958] logrotate[585]: considering log /var/log/wtmp918gitlab # [ 7.827966] logrotate[585]: Creating new state919gitlab # [ 7.829103] logrotate[585]: Now: 2026-08-11 11:34920gitlab # [ 7.829900] logrotate[585]: Last rotated at 2026-08-11 11:00921gitlab # [ 7.830942] logrotate[585]: log does not need rotating (log has already been rotated)922gitlab # [ 7.832061] logrotate[585]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed923gitlab # [ 7.833213] logrotate[585]: switching euid from 0 to 165 and egid from 0 to 165 (pid 585)924gitlab # [ 7.834219] logrotate[585]: considering log /var/gitlab/state/log/*.log925gitlab # [ 7.835088] logrotate[585]: log /var/gitlab/state/log/*.log does not exist -- skipping926gitlab # [ 7.835909] logrotate[585]: Creating new state927gitlab # [ 7.837053] logrotate[585]: switching euid from 165 to 0 and egid from 165 to 0 (pid 585)928gitlab # [ 7.837903] logrotate[585]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed929gitlab # [ 7.839052] logrotate[585]: switching euid from 0 to 60 and egid from 0 to 60 (pid 585)930gitlab # [ 7.839868] logrotate[585]: considering log /var/log/nginx/*.log931gitlab # [ 7.840483] logrotate[585]: log /var/log/nginx/*.log does not exist -- skipping932gitlab # [ 7.841736] logrotate[585]: Creating new state933gitlab # [ 7.842822] logrotate[585]: not running postrotate script, since no logs were rotated934gitlab # [ 7.843923] logrotate[585]: switching euid from 60 to 0 and egid from 60 to 0 (pid 585)935gitlab # [ 7.872540] systemd[1]: Finished Logrotate configuration check.936gitlab # [ 7.875393] systemd[1]: Finished Post-Boot Actions.937gitlab # [ 7.882815] systemd[1]: Started Name Service Cache Daemon (nsncd).938gitlab # [ 7.885096] nsncd[586]: Aug 11 11:34:51.443 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"939gitlab # [ 7.891192] systemd[1]: Finished Import lastlog data into lastlog2 database.940gitlab # [ 7.894925] systemd[1]: Reached target Host and Network Name Lookups.941gitlab # [ 7.897160] systemd[1]: Reached target User and Group Name Lookups.942gitlab # [ 7.900832] systemd[1]: Starting User Login Management...943gitlab # [ 7.941404] systemd[1]: Stopped target Host and Network Name Lookups.944gitlab # [ 7.944099] systemd[1]: Stopping Host and Network Name Lookups...945gitlab # [ 7.945915] systemd[1]: Stopped target User and Group Name Lookups.946gitlab # [ 7.948810] systemd[1]: Stopping User and Group Name Lookups...947gitlab # [ 7.951237] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...948gitlab # [ 7.953276] systemd-logind[635]: New seat seat0.949gitlab # [ 7.955213] systemd[1]: nscd.service: Deactivated successfully.950gitlab # [ 7.956826] systemd-logind[635]: Watching system buttons on /dev/input/event2 (Power Button)951gitlab # [ 7.959120] systemd-logind[635]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard)952gitlab # [ 7.961323] systemd-logind[635]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)953gitlab # [ 7.963702] systemd[1]: Stopped Name Service Cache Daemon (nsncd).954gitlab # [ 7.965284] systemd[1]: nscd.service: Consumed 68ms CPU time over 161ms wall clock time, 7.1M memory peak, 5.5M read from disk.955gitlab # [ 7.968216] systemd[1]: Started User Login Management.956gitlab # [ 7.969604] systemd[1]: Starting linger-users.service...957gitlab # [ 7.971094] systemd[1]: Starting Name Service Cache Daemon (nsncd)...958gitlab # [ 7.984489] systemd[1]: Finished resolvconf update.959gitlab # [ 7.985935] systemd[1]: linger-users.service: Deactivated successfully.960gitlab # [ 7.987826] systemd[1]: Finished linger-users.service.961gitlab # [ 7.989788] systemd[1]: Reached target Preparation for Network.962gitlab # [ 7.991840] nsncd[683]: Aug 11 11:34:51.549 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"963gitlab # [ 7.996736] systemd[1]: Starting DHCP Client...964gitlab # [ 7.998635] systemd[1]: Starting Address configuration of eth1...965gitlab # [ 7.999973] systemd[1]: Starting Extra networking commands....966gitlab # [ 8.003491] systemd[1]: Started Name Service Cache Daemon (nsncd).967gitlab # [ 8.005553] systemd[1]: Reached target Host and Network Name Lookups.968gitlab # [ 8.006734] systemd[1]: Reached target User and Group Name Lookups.969gitlab # [ 8.031818] network-addresses-eth1-start[703]: adding address 192.168.1.1/24... done970gitlab # [ 8.037622] network-addresses-eth1-start[703]: adding address 2001:db8:1::1/64... done971gitlab # [ 8.046587] systemd[1]: Finished Address configuration of eth1.972gitlab # [ 8.081566] dhcpcd[713]: dhcpcd-10.3.2 starting973gitlab # [ 8.083285] systemd[1]: Finished Extra networking commands..974gitlab # [ 8.085517] dhcpcd[767]: dev: loaded udev975gitlab # [ 8.087262] systemd[1]: Reached target Network.976gitlab # [ 8.088649] systemd[1]: Starting gitlab-workhorse.service...977gitlab # [ 8.093163] systemd[1]: Starting Nginx Web Server...978gitlab # [ 8.362786] 8021q: 802.1Q VLAN Support v1.8979gitlab # [ 8.363872] 8021q: adding VLAN 0 to HW filter on device eth1980gitlab # [ 8.097515] systemd[1]: Starting PostgreSQL Server...981gitlab # [ 8.102607] systemd[1]: Starting Redis Server - redis-gitlab...982gitlab # [ 8.104739] systemd[1]: Starting Permit User Sessions...983gitlab # [ 8.125055] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.984gitlab # [ 8.137964] systemd[1]: Finished Permit User Sessions.985gitlab # [ 8.144832] systemd[1]: Started Getty on tty1.986gitlab # [ 8.148504] systemd[1]: Reached target Login Prompts.987gitlab # [ 8.476277] cfg80211: Loading compiled-in X.509 certificates for regulatory database988gitlab # [ 8.485060] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'989gitlab # [ 8.218319] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.990gitlab # [ 8.488430] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'991gitlab # [ 8.490631] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2992gitlab # [ 8.493057] cfg80211: failed to load regulatory.db993gitlab # [ 8.521853] 8021q: adding VLAN 0 to HW filter on device eth0994gitlab # [ 8.256310] dhcpcd[767]: eth0: waiting for carrier995gitlab # [ 8.258233] dhcpcd[767]: eth0: carrier acquired996gitlab # [ 8.263698] dhcpcd[767]: DUID 00:01:00:01:32:0d:c5:5b:52:54:00:12:34:56997gitlab # [ 8.265917] dhcpcd[767]: eth0: IAID 00:12:34:56998gitlab # [ 8.267604] dhcpcd[767]: eth0: adding address fe80::5054:ff:fe12:3456999gitlab # [ 8.276170] nginx-pre-start[795]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok1000gitlab # [ 8.279308] nginx-pre-start[795]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful1001gitlab # [ 8.284457] systemd[1]: Started Nginx Web Server.1002gitlab # [ 8.293350] postgresql-pre-start[794]: The files belonging to this database system will be owned by user "postgres".1003gitlab # [ 8.295568] postgresql-pre-start[794]: This user must also own the server process.1004gitlab # [ 8.298204] postgresql-pre-start[794]: The database cluster will be initialized with locale "en_US.UTF-8".1005gitlab # [ 8.299310] postgresql-pre-start[794]: The default database encoding has accordingly been set to "UTF8".1006gitlab # [ 8.300254] postgresql-pre-start[794]: The default text search configuration will be set to "english".1007gitlab # [ 8.301169] postgresql-pre-start[794]: Data page checksums are enabled.1008gitlab # [ 8.301865] postgresql-pre-start[794]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1009gitlab # [ 8.302743] postgresql-pre-start[794]: creating subdirectories ... ok1010gitlab # [ 8.304136] postgresql-pre-start[794]: selecting dynamic shared memory implementation ... posix1011gitlab # [ 8.306244] redis-server[792]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.1012gitlab # [ 8.316674] redis-server[792]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1013gitlab # [ 8.318116] redis-server[792]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=792, just started1014gitlab # [ 8.322313] redis-server[792]: Configuration loaded1015gitlab # [ 8.327075] redis[792]: monotonic clock: POSIX clock_gettime1016gitlab # [ 8.328328] redis[792]: Running mode=standalone, port=0.1017gitlab # [ 8.328917] systemd[1]: Started Redis Server - redis-gitlab.1018gitlab # [ 8.330124] redis[792]: Server initialized1019gitlab # [ 8.330984] redis[792]: Ready to accept connections unix1020gitlab # [ 8.334213] redis[792]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1021gitlab # [ 8.347516] postgresql-pre-start[794]: selecting default "max_connections" ... 1001022gitlab # [ 8.396723] postgresql-pre-start[794]: selecting default "shared_buffers" ... 128MB1023gitlab # [ 8.637492] systemd[1]: Started gitlab-workhorse.service.1024gitlab # [ 8.798987] postgresql-pre-start[794]: selecting default time zone ... UTC1025gitlab # [ 8.803438] postgresql-pre-start[794]: creating configuration files ... ok1026gitlab # [ 8.823418] dhcpcd[767]: eth0: soliciting a DHCP lease1027gitlab # [ 9.098130] NET: Registered PF_PACKET protocol family1028gitlab # [ 8.836489] dhcpcd[767]: eth0: offered 10.0.2.15 from 10.0.2.21029gitlab # [ 8.842830] dhcpcd[767]: eth0: probing address 10.0.2.15/241030gitlab # [ 8.890446] gitlab-workhorse[828]: time="2026-08-11T11:34:52Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41031gitlab # [ 8.893379] gitlab-workhorse[828]: time="2026-08-11T11:34:52Z" level=info msg="Using redis/go-redis"1032gitlab # [ 8.895605] gitlab-workhorse[828]: time="2026-08-11T11:34:52Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1033gitlab # [ 8.999599] postgresql-pre-start[794]: running bootstrap script ... ok1034gitlab # [ 9.529503] postgresql-pre-start[794]: performing post-bootstrap initialization ... ok1035gitlab # [ 9.890325] postgresql-pre-start[794]: syncing data to disk ... ok1036gitlab # [ 9.892349] postgresql-pre-start[794]: initdb: warning: enabling "trust" authentication for local connections1037gitlab # [ 9.893979] postgresql-pre-start[794]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1038gitlab # [ 9.895221] postgresql-pre-start[794]: Success. You can now start the database server using:1039gitlab # [ 9.896949] postgresql-pre-start[794]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1040gitlab # [ 9.898954] dhcpcd[767]: eth0: soliciting an IPv6 router1041gitlab # [ 9.900462] dhcpcd[767]: eth0: Router Advertisement from fe80::21042gitlab # [ 9.902190] dhcpcd[767]: eth0: adding address fec0::5054:ff:fe12:3456/641043gitlab # [ 9.903635] dhcpcd[767]: eth0: adding route to fec0::/641044gitlab # [ 9.905257] dhcpcd[767]: eth0: adding default route via fe80::21045gitlab # [ 10.029994] postgres[853]: [853] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1046gitlab # [ 10.032274] postgres[853]: [853] LOG: listening on IPv6 address "::1", port 54321047gitlab # [ 10.033703] postgres[853]: [853] LOG: listening on IPv4 address "127.0.0.1", port 54321048gitlab # [ 10.041256] postgres[853]: [853] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1049gitlab # [ 10.057142] postgres[872]: [872] LOG: database system was shut down at 2026-08-11 11:34:53 GMT1050gitlab # [ 10.067300] postgres[853]: [853] LOG: database system is ready to accept connections1051gitlab # [ 10.074595] systemd[1]: Started PostgreSQL Server.1052gitlab # [ 10.078345] systemd[1]: Starting PostgreSQL Setup Scripts...1053gitlab # [ 10.312860] postgresql-setup-start[883]: CREATE DATABASE1054gitlab # [ 10.342925] postgresql-setup-start[888]: CREATE ROLE1055gitlab # [ 10.355514] postgresql-setup-start[890]: ALTER DATABASE1056gitlab # [ 10.383334] postgresql-setup-start[897]: CREATE ROLE1057gitlab # [ 10.388969] systemd[1]: Finished PostgreSQL Setup Scripts.1058gitlab # [ 10.390938] systemd[1]: Reached target PostgreSQL.1059gitlab # [ 10.395292] systemd[1]: Starting gitlab-postgresql.service...1060gitlab # [ 10.516760] gitlab-postgresql-start[908]: CREATE DATABASE1061gitlab # [ 10.519984] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[899]: mkdir -p /var/gitlab/state/home/.ssh: OK1062gitlab # [ 10.522558] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[899]: chmod 700 /var/gitlab/state/home/.ssh: OK1063gitlab # [ 10.572784] gitlab-postgresql-start[917]: CREATE EXTENSION1064gitlab # [ 10.575297] systemd[1]: Finished gitlab-config.service.1065gitlab # [ 10.580203] systemd[1]: Started gitaly.service.1066gitlab # [ 10.582182] systemd[1]: Starting gitlab-db-config.service...1067gitlab # [ 10.661669] gitlab-postgresql-start[926]: CREATE EXTENSION1068gitlab # [ 10.666206] systemd[1]: Finished gitlab-postgresql.service.1069gitlab # [ 11.137479] gitaly[927]: time="2026-08-11T11:34:54.694Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9271070gitlab # [ 11.171742] gitaly[927]: time="2026-08-11T11:34:54.695Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9271071gitlab # [ 11.174553] gitaly[927]: time="2026-08-11T11:34:54.695Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9271072gitlab # [ 11.182252] gitaly[927]: time="2026-08-11T11:34:54.695Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9271073gitlab # [ 11.185226] gitaly[927]: time="2026-08-11T11:34:54.695Z" level=info msg="Starting Gitaly" pid=927 version=1074gitlab # [ 11.346373] gitaly[927]: time="2026-08-11T11:34:54.904Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=208 pid=9271075gitlab # [ 11.349874] gitaly[927]: time="2026-08-11T11:34:54.904Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9271076gitlab # [ 11.352580] gitaly[927]: time="2026-08-11T11:34:54.905Z" level=info msg="finished initializing command factory" duration_ms=0 pid=9271077gitlab # [ 11.355796] gitaly[927]: time="2026-08-11T11:34:54.905Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-927/git-exec-3281724319.d/git pid=9271078gitlab # [ 11.359603] gitaly[927]: time="2026-08-11T11:34:54.910Z" level=info msg="finished detecting git version" duration_ms=5 pid=9271079gitlab # [ 11.362593] gitaly[927]: time="2026-08-11T11:34:54.910Z" level=info msg="using Git version" pid=927 version=2.53.g1080gitlab # [ 11.365249] gitaly[927]: time="2026-08-11T11:34:54.911Z" level=info msg="clearing disk cache object folder" pid=927 storage=default1081gitlab # [ 11.368374] gitaly[927]: time="2026-08-11T11:34:54.912Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1354142268 pid=927 storage=default1082gitlab # [ 11.373092] gitaly[927]: time="2026-08-11T11:34:54.912Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1354142268 pid=927 storage=default1083gitlab # [ 11.384952] gitaly[927]: time="2026-08-11T11:34:54.912Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9271084gitlab # [ 11.394817] gitaly[927]: time="2026-08-11T11:34:54.912Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9271085gitlab # [ 11.399612] gitaly[927]: time="2026-08-11T11:34:54.913Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1354142268 clear_duration_ms=0 pid=927 storage=default1086gitlab # [ 11.426702] gitaly[927]: time="2026-08-11T11:34:54.984Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9271087gitlab # [ 11.430570] gitaly[927]: time="2026-08-11T11:34:54.984Z" level=info msg="counting repositories" pid=9271088gitlab # [ 11.431895] gitaly[927]: time="2026-08-11T11:34:54.984Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=927 schema=unix1089gitlab # [ 11.433069] gitaly[927]: time="2026-08-11T11:34:54.984Z" level=info msg="starting to count repositories" pid=927 storage_path=/var/gitlab/state/repositories1090gitlab # [ 11.433908] gitaly[927]: time="2026-08-11T11:34:54.984Z" level=info msg="listening at address" address=/run/gitaly/gitaly-927/sock.d/intern pid=927 schema=unix1091gitlab # [ 11.435078] gitaly[927]: time="2026-08-11T11:34:54.984Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=927 storage_path=/var/gitlab/state/repositories1092gitlab # [ 11.435882] gitaly[927]: time="2026-08-11T11:34:54.985Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9271093gitlab # [ 11.437085] gitaly[927]: time="2026-08-11T11:34:54.985Z" level=info msg="finished tempdir cleaner walk" pid=927 storage=default time_ms=01094gitlab # [ 11.437852] gitaly[927]: time="2026-08-11T11:34:54.986Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9271095gitlab # [ 11.438980] gitaly[927]: time="2026-08-11T11:34:54.986Z" level=info msg="Started Gitaly" duration_ms=291 pid=9271096gitlab # [ 11.440114] gitaly[927]: time="2026-08-11T11:34:54.986Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9271097gitlab # [ 11.440661] gitaly[927]: time="2026-08-11T11:34:54.986Z" level=info msg="maintenance: daily scheduled" pid=927 scheduled="2026-08-11 12:00:00 +0000 UTC"1098gitlab # [ 12.043418] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[931]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1099gitlab # [ 12.047701] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[931]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1100gitlab # [ 12.073727] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[931]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1101gitlab # [ 13.459736] gitaly[927]: time="2026-08-11T11:34:57.017Z" level=info msg="License database preloaded" duration_ms=2322 pid=9271102gitlab # [ 14.191971] dhcpcd[767]: eth0: leased 10.0.2.15 for 86400 seconds1103gitlab # [ 14.195990] dhcpcd[767]: eth0: adding route to 10.0.2.0/241104gitlab # [ 14.198294] dhcpcd[767]: eth0: adding default route via 10.0.2.21105gitlab # [ 14.347408] systemd[1]: Started DHCP Client.1106gitlab # [ 14.350397] systemd[1]: Reached target Network is Online.1107gitlab # [ 44.398443] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[931]: W, [2026-08-11T11:35:27.955652 #931] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1108gitlab # [ 47.073204] postgres[1337]: [1337] ERROR: relation "feature_gates" does not exist at character 5231109gitlab # [ 47.075898] postgres[1337]: [1337] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1110gitlab # [ 47.079482] postgres[1337]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1111gitlab # [ 47.083706] postgres[1337]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1112gitlab # [ 47.087856] postgres[1337]: attidentity AS identity,1113gitlab # [ 47.091837] postgres[1337]: attgenerated as attgenerated1114gitlab # [ 47.095874] postgres[1337]: FROM pg_attribute a1115gitlab # [ 47.098579] postgres[1337]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1116gitlab # [ 47.100723] postgres[1337]: LEFT JOIN pg_type t ON a.atttypid = t.oid1117gitlab # [ 47.103385] postgres[1337]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1118gitlab # [ 47.106083] postgres[1337]: WHERE a.attrelid = '"feature_gates"'::regclass1119gitlab # [ 47.107407] postgres[1337]: AND a.attnum > 0 AND NOT a.attisdropped1120gitlab # [ 47.110727] postgres[1337]: ORDER BY a.attnum1121gitlab # [ 47.114103] postgres[1337]:1122gitlab # [ 48.947290] gitlab-workhorse[828]: time="2026-08-11T11:35:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1123gitlab # [ 51.028934] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1379]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1124gitlab # [ 51.031312] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1379]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1125gitlab # [ 58.957427] gitlab-workhorse[828]: time="2026-08-11T11:35:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1126gitlab # [ 68.967268] gitlab-workhorse[828]: time="2026-08-11T11:35:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1127gitlab # [ 70.238908] postgres[1472]: [1472] ERROR: relation "table_without_models" does not exist1128gitlab # [ 70.242943] postgres[1472]: [1472] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1129gitlab # [ 78.976928] gitlab-workhorse[828]: time="2026-08-11T11:36:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1130gitlab # [ 84.156442] systemd[1]: Finished gitlab-db-config.service.1131gitlab # [ 84.161735] systemd[1]: Started gitlab-sidekiq.service.1132gitlab # [ 84.165869] systemd[1]: Starting gitlab.service...1133gitlab # [ 84.585226] bundle[1666]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1134gitlab # [ 84.593562] bundle[1666]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1135gitlab # [ 84.601604] bundle[1666]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1136gitlab # [ 87.578613] sidekiq-cluster[1665]: {"severity":"INFO","time":"2026-08-11T11:36:11.117Z","message":"Starting cluster with 1 processes"}1137gitlab # [ 87.863538] bundle[1666]: {"timestamp":"2026-08-11T11:36:11.395Z","pid":1666,"message":"* Enabling systemd notification integration"}1138gitlab # [ 87.867577] bundle[1666]: {"timestamp":"2026-08-11T11:36:11.420Z","pid":1666,"message":"Puma starting in cluster mode..."}1139gitlab # [ 87.870989] bundle[1666]: {"timestamp":"2026-08-11T11:36:11.420Z","pid":1666,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1140gitlab # [ 87.873874] bundle[1666]: {"timestamp":"2026-08-11T11:36:11.420Z","pid":1666,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1141gitlab # [ 87.876548] bundle[1666]: {"timestamp":"2026-08-11T11:36:11.420Z","pid":1666,"message":"* Min threads: 0"}1142gitlab # [ 87.878774] bundle[1666]: {"timestamp":"2026-08-11T11:36:11.420Z","pid":1666,"message":"* Max threads: 4"}1143gitlab # [ 87.881407] bundle[1666]: {"timestamp":"2026-08-11T11:36:11.421Z","pid":1666,"message":"* Environment: production"}1144gitlab # [ 87.883557] bundle[1666]: {"timestamp":"2026-08-11T11:36:11.421Z","pid":1666,"message":"* Master PID: 1666"}1145gitlab # [ 87.885691] bundle[1666]: {"timestamp":"2026-08-11T11:36:11.421Z","pid":1666,"message":"* Workers: 2"}1146gitlab # [ 87.888469] bundle[1666]: {"timestamp":"2026-08-11T11:36:11.421Z","pid":1666,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1147gitlab # [ 87.890581] bundle[1666]: {"timestamp":"2026-08-11T11:36:11.421Z","pid":1666,"message":"* Preloading application"}1148gitlab # [ 88.987969] gitlab-workhorse[828]: time="2026-08-11T11:36:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1149gitlab # [ 98.989901] gitlab-workhorse[828]: time="2026-08-11T11:36:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1150gitlab # [ 109.000340] gitlab-workhorse[828]: time="2026-08-11T11:36:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1151gitlab # [ 114.512268] bundle[1666]: W, [2026-08-11T11:36:38.069494 #1666] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1152gitlab # [ 117.348834] sidekiq-cluster[1705]: 2026-08-11T11:36:40.905Z pid=1705 tid=we9 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1705, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>435511296}1153gitlab # [ 117.546676] sidekiq-cluster[1705]: W, [2026-08-11T11:36:41.104591 #1705] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1154gitlab # [ 117.589330] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:41.147Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1155gitlab # [ 119.010585] gitlab-workhorse[828]: time="2026-08-11T11:36:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1156gitlab # [ 119.790844] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.347Z","message":"GitLab reliable fetch activated!"}1157gitlab # [ 119.792927] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.348Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1158gitlab # [ 119.859944] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.417Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1159gitlab # [ 119.865203] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.423Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1160gitlab # [ 119.870947] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.429Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1161gitlab # [ 119.876732] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.434Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1162gitlab # [ 119.882213] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.440Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1163gitlab # [ 119.885988] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.444Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1164gitlab # [ 119.889238] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.447Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1165gitlab # [ 119.892527] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.450Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1166gitlab # [ 119.895605] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.453Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1167gitlab # [ 119.898645] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.456Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1168gitlab # [ 119.901766] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.459Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1169gitlab # [ 119.904933] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.463Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1170gitlab # [ 119.907469] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.465Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1171gitlab # [ 119.909922] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.468Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1172gitlab # [ 119.912475] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.470Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1173gitlab # [ 119.914981] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.473Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1174gitlab # [ 119.918281] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.476Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1175gitlab # [ 119.921247] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.479Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1176gitlab # [ 119.924342] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.482Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1177gitlab # [ 119.927467] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.485Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1178gitlab # [ 119.930498] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.488Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1179gitlab # [ 119.933252] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.491Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1180gitlab # [ 119.936222] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.494Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1181gitlab # [ 119.938656] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.496Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1182gitlab # [ 119.941237] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.499Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1183gitlab # [ 119.944172] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.502Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1184gitlab # [ 119.947144] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.505Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1185gitlab # [ 119.949995] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.508Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1186gitlab # [ 119.952946] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.511Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1187gitlab # [ 119.955864] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.514Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1188gitlab # [ 119.958336] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.516Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1189gitlab # [ 119.961246] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.519Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1190gitlab # [ 119.964150] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.522Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1191gitlab # [ 119.967102] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.525Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1192gitlab # [ 119.969580] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.527Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1193gitlab # [ 119.972257] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.530Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1194gitlab # [ 119.975183] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.533Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1195gitlab # [ 119.978328] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.536Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1196gitlab # [ 119.980800] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.539Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1197gitlab # [ 119.983575] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.541Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1198gitlab # [ 119.986166] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.544Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1199gitlab # [ 119.988796] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.546Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1200gitlab # [ 119.991316] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.549Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1201gitlab # [ 119.994325] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.552Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1202gitlab # [ 119.997488] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.555Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1203gitlab # [ 120.000330] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.558Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1204gitlab # [ 120.002818] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.561Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1205gitlab # [ 120.005694] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.563Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1206gitlab # [ 120.008706] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.566Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1207gitlab # [ 120.011405] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.569Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1208gitlab # [ 120.014150] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.572Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1209gitlab # [ 120.017553] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.575Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1210gitlab # [ 120.071470] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.629Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1211gitlab # [ 120.076328] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.633Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1212gitlab # [ 120.080772] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.636Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1213gitlab # [ 120.084695] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.642Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1214gitlab # [ 120.090271] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.648Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1215gitlab # [ 120.096664] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.654Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1216gitlab # [ 120.101821] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.660Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1217gitlab # [ 120.107207] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.665Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1218gitlab # [ 120.112426] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.670Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1219gitlab # [ 120.117571] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.675Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1220gitlab # [ 120.121826] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.680Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1221gitlab # [ 120.126263] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.684Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1222gitlab # [ 120.134117] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.692Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1223gitlab # [ 120.139203] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.697Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1224gitlab # [ 120.144567] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.702Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1225gitlab # [ 120.149150] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.707Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1226gitlab # [ 120.153975] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.712Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1227gitlab # [ 120.157264] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.715Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1228gitlab # [ 120.160061] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.718Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1229gitlab # [ 120.163562] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.721Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1230gitlab # [ 120.166669] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.725Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1231gitlab # [ 120.170640] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.728Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1232gitlab # [ 120.174066] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.732Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1233gitlab # [ 120.178077] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.736Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1234gitlab # [ 120.181230] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.739Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1235gitlab # [ 120.185174] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.743Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1236gitlab # [ 120.188647] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.746Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1237gitlab # [ 120.192107] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.750Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1238gitlab # [ 120.195515] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.753Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1239gitlab # [ 120.198645] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.756Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1240gitlab # [ 120.203102] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.761Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1241gitlab # [ 120.206199] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.764Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1242gitlab # [ 120.209208] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.767Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1243gitlab # [ 120.212551] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.770Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1244gitlab # [ 120.216496] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.774Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1245gitlab # [ 120.220199] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.778Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1246gitlab # [ 120.223890] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.782Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1247gitlab # [ 120.227364] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.785Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1248gitlab # [ 120.230594] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.788Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1249gitlab # [ 120.233634] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.791Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1250gitlab # [ 120.237532] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.795Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1251gitlab # [ 120.241090] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.799Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1252gitlab # [ 120.244815] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.803Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1253gitlab # [ 120.249125] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.807Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1254gitlab # [ 120.251947] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.810Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1255gitlab # [ 120.255814] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.814Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1256gitlab # [ 120.266687] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.824Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1257gitlab # [ 120.270157] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.828Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1258gitlab # [ 120.274128] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.832Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1259gitlab # [ 120.279078] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.837Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1260gitlab # [ 120.282657] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.840Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1261gitlab # [ 120.287074] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.845Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1262gitlab # [ 120.290775] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.849Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1263gitlab # [ 120.294142] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.852Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1264gitlab # [ 120.297375] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.855Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1265gitlab # [ 120.301199] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.859Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1266gitlab # [ 120.304216] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:36:43.862Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1267gitlab # [ 129.016159] gitlab-workhorse[828]: time="2026-08-11T11:36:52Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1268gitlab # [ 139.017974] gitlab-workhorse[828]: time="2026-08-11T11:37:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1269gitlab # [ 142.726271] postgres[2199]: [2199] ERROR: relation "table_without_models" does not exist1270gitlab # [ 142.727451] postgres[2199]: [2199] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1271gitlab # [ 144.362232] postgres[2219]: [2219] ERROR: relation "table_without_models" does not exist1272gitlab # [ 144.365617] postgres[2219]: [2219] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1273gitlab # [ 145.465186] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:09.020Z","message":"Booted Rails 7.2.3.1 application in production environment"}1274gitlab # [ 145.469697] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:09.026Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1275gitlab # [ 145.473981] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:09.031Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1276gitlab # [ 145.475286] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:09.031Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1277gitlab # [ 145.481559] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:09.039Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1278gitlab # [ 147.161772] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:10.718Z","message":"Cleaning working queues"}1279gitlab # [ 147.164400] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:10.720Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"51afa7073fe52cfaa876ecac","created_at":"2026-08-11T11:36:07.313Z","trace_propagation_headers":{"sentry-trace":"894a1ba726ec4077928849dafade91e6-d795dca6e8d24494","baggage":"sentry-trace_id=894a1ba726ec4077928849dafade91e6,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"840aea039b4b06762c3b1c049d592034","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T11:36:07.323Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-51afa7073fe52cfaa876ecac: start","job_status":"start","queue_duration_s":63.396942,"scheduling_latency_s":63.396999}1280gitlab # [ 147.385593] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:10.943Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"51afa7073fe52cfaa876ecac","created_at":"2026-08-11T11:36:07.313Z","trace_propagation_headers":{"sentry-trace":"894a1ba726ec4077928849dafade91e6-d795dca6e8d24494","baggage":"sentry-trace_id=894a1ba726ec4077928849dafade91e6,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"840aea039b4b06762c3b1c049d592034","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T11:36:07.323Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-51afa7073fe52cfaa876ecac: done: 0.22238 sec","job_status":"done","queue_duration_s":63.396942,"scheduling_latency_s":63.396999,"redis_calls":30,"redis_duration_s":0.01513,"redis_read_bytes":410,"redis_write_bytes":3701,"redis_feature_flag_calls":19,"redis_feature_flag_duration_s":0.008993,"redis_feature_flag_read_bytes":400,"redis_feature_flag_write_bytes":2454,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003877,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00226,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.107199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.104804102,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.22238,"completed_at":"2026-08-11T11:37:10.943Z","load_balancing_strategy":"primary","db_duration_s":0.07191,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1281gitlab # [ 147.511561] bundle[1666]: {"timestamp":"2026-08-11T11:37:11.068Z","pid":1666,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1282gitlab # [ 147.513388] bundle[1666]: {"timestamp":"2026-08-11T11:37:11.068Z","pid":1666,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1283gitlab # [ 147.514535] bundle[1666]: {"timestamp":"2026-08-11T11:37:11.068Z","pid":1666,"message":"! #\u003cThread:0x00007ffb10ed4910 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1284gitlab # [ 147.516417] bundle[1666]: {"timestamp":"2026-08-11T11:37:11.069Z","pid":1666,"message":"! #\u003cThread:0x00007ffb110d79b0 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1285gitlab # [ 147.517834] bundle[1666]: {"timestamp":"2026-08-11T11:37:11.069Z","pid":1666,"message":"Use Ctrl-C to stop"}1286gitlab # [ 147.519351] bundle[1666]: {"timestamp":"2026-08-11T11:37:11.070Z","pid":1666,"message":"Sending status to systemd every 1.0 sec"}1287gitlab # [ 148.366623] bundle[1666]: {"timestamp":"2026-08-11T11:37:11.923Z","pid":1666,"message":"- Worker 1 (PID: 2286) booted in 0.79s, phase: 0"}1288gitlab # [ 148.370042] bundle[1666]: {"timestamp":"2026-08-11T11:37:11.925Z","pid":1666,"message":"- Worker 0 (PID: 2282) booted in 0.81s, phase: 0"}1289gitlab # [ 148.381613] systemd[1]: Started gitlab.service.1290gitlab # [ 148.382921] systemd[1]: Reached target Common target for all GitLab services..1291gitlab # [ 148.387962] systemd[1]: Starting setup-gitlab.service...1292gitlab # [ 148.406752] setup-gitlab-start[2319]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1293gitlab # [ 150.651273] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:37:14 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 21981294gitlab # [ 150.656581] setup-gitlab-start[2319]: + TOKEN=nixbot-test-token-of-20-chars1295gitlab # [ 150.658377] setup-gitlab-start[2319]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1296gitlab # [ 150.675955] runuser[2342]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1297gitlab # [ 151.100725] setup-gitlab-start[2343]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1298gitlab # [ 151.104202] setup-gitlab-start[2343]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1299gitlab # [ 151.106935] setup-gitlab-start[2343]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1300gitlab # [ 151.743378] setup-gitlab-start[2343]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1301gitlab # [ 151.746477] setup-gitlab-start[2343]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1302gitlab # [ 151.749952] setup-gitlab-start[2343]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1303gitlab # [ 161.441690] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:24.999Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"df3f174b3138dfd58baea641","created_at":"2026-08-11T11:37:24.960Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2e916cac5112d43a3acd7854f300568b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:24.996Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-df3f174b3138dfd58baea641: start","job_status":"start","queue_duration_s":0.00284,"scheduling_latency_s":0.002902}1304gitlab # [ 161.542200] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.100Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"df3f174b3138dfd58baea641","created_at":"2026-08-11T11:37:24.960Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2e916cac5112d43a3acd7854f300568b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:24.996Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-df3f174b3138dfd58baea641: done: 0.101274 sec","job_status":"done","queue_duration_s":0.00284,"scheduling_latency_s":0.002902,"redis_calls":12,"redis_duration_s":0.016171,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001257,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004543,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.010371,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000640863,"exclusive_lock_hold_duration_s":0.007587557,"duration_s":0.101274,"completed_at":"2026-08-11T11:37:25.100Z","load_balancing_strategy":"primary","db_duration_s":0.005168,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 161.625254] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.183Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"055c0f56943b780da42aeea1","created_at":"2026-08-11T11:37:25.066Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"44fac0cec20aefc22204571646b58af4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:25.090Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-055c0f56943b780da42aeea1: start","job_status":"start","queue_duration_s":0.092838,"scheduling_latency_s":0.092882}1306gitlab # [ 161.681260] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.239Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1307gitlab # [ 161.695709] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.253Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"055c0f56943b780da42aeea1","created_at":"2026-08-11T11:37:25.066Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"44fac0cec20aefc22204571646b58af4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:25.090Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-055c0f56943b780da42aeea1: done: 0.070421 sec","job_status":"done","queue_duration_s":0.092838,"scheduling_latency_s":0.092882,"redis_calls":10,"redis_duration_s":0.016277,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001259,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.014086,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000587226,"duration_s":0.070421,"completed_at":"2026-08-11T11:37:25.253Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001215,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 161.704204] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.262Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"0118489bb6347cc05a2ef393","created_at":"2026-08-11T11:37:25.178Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c2631c2a12eff4bc0a69d1b0f70435a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:25.212Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-0118489bb6347cc05a2ef393: start","job_status":"start","queue_duration_s":0.049971,"scheduling_latency_s":0.049996}1309gitlab # [ 161.747301] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.305Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1310gitlab # [ 161.762470] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.320Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"0118489bb6347cc05a2ef393","created_at":"2026-08-11T11:37:25.178Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c2631c2a12eff4bc0a69d1b0f70435a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:25.212Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-0118489bb6347cc05a2ef393: done: 0.058069 sec","job_status":"done","queue_duration_s":0.049971,"scheduling_latency_s":0.049996,"redis_calls":10,"redis_duration_s":0.022484,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.011113,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007393,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003978,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001427835,"duration_s":0.058069,"completed_at":"2026-08-11T11:37:25.320Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003226,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 161.785135] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.324Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"38b4a7daf23b2179667651ba","created_at":"2026-08-11T11:37:25.234Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bcc33f6f08a9597def933ec3f3a6893","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:25.252Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-38b4a7daf23b2179667651ba: start","job_status":"start","queue_duration_s":0.071853,"scheduling_latency_s":0.071875}1312gitlab # [ 161.806501] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.358Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"38b4a7daf23b2179667651ba","created_at":"2026-08-11T11:37:25.234Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bcc33f6f08a9597def933ec3f3a6893","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:25.252Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-38b4a7daf23b2179667651ba: done: 0.034584 sec","job_status":"done","queue_duration_s":0.071853,"scheduling_latency_s":0.071875,"redis_calls":10,"redis_duration_s":0.002474,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00044,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001535,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000499,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000415136,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.034584,"completed_at":"2026-08-11T11:37:25.358Z","load_balancing_strategy":"primary","db_duration_s":0.013624,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313gitlab # [ 161.901223] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.360Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"4593ec1959aa10973a4f4f1b","created_at":"2026-08-11T11:37:25.260Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"889d4449a107e1cb43b8d02f758192cb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-11T11:37:25.279Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-4593ec1959aa10973a4f4f1b: start","job_status":"start","queue_duration_s":0.08119,"scheduling_latency_s":0.081212}1314gitlab # [ 161.902463] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.388Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"4593ec1959aa10973a4f4f1b","created_at":"2026-08-11T11:37:25.260Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"889d4449a107e1cb43b8d02f758192cb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-11T11:37:25.279Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-4593ec1959aa10973a4f4f1b: done: 0.027815 sec","job_status":"done","queue_duration_s":0.08119,"scheduling_latency_s":0.081212,"redis_calls":10,"redis_duration_s":0.002317,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000481,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001397,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000439,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000371835,"duration_s":0.027815,"completed_at":"2026-08-11T11:37:25.388Z","load_balancing_strategy":"primary","db_duration_s":0.003201,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 161.976974] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.389Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"5246911688c87088aa74d82e","created_at":"2026-08-11T11:37:25.299Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4933643722d875ad6acfcdd671e4d5f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:25.312Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-5246911688c87088aa74d82e: start","job_status":"start","queue_duration_s":0.077121,"scheduling_latency_s":0.077143}1316gitlab # [ 161.978406] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.419Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"5246911688c87088aa74d82e","created_at":"2026-08-11T11:37:25.299Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4933643722d875ad6acfcdd671e4d5f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:25.312Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-5246911688c87088aa74d82e: done: 0.030134 sec","job_status":"done","queue_duration_s":0.077121,"scheduling_latency_s":0.077143,"redis_calls":19,"redis_duration_s":0.003986,"redis_read_bytes":21,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000861,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000325,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002127,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000673,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000396419,"duration_s":0.030134,"completed_at":"2026-08-11T11:37:25.419Z","load_balancing_strategy":"primary","db_duration_s":0.001545,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 162.054893] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.421Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5aebdf95494c01b643c12be8","created_at":"2026-08-11T11:37:25.403Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-1ee6dd5595d3482d","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4933643722d875ad6acfcdd671e4d5f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:25.413Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5aebdf95494c01b643c12be8: start","job_status":"start","queue_duration_s":0.007983,"scheduling_latency_s":0.008004}1318gitlab # [ 162.056146] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.442Z","message":"No existing merge request to be cleaned up."}1319gitlab # [ 162.057049] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.454Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5aebdf95494c01b643c12be8","created_at":"2026-08-11T11:37:25.403Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-1ee6dd5595d3482d","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4933643722d875ad6acfcdd671e4d5f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:25.413Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5aebdf95494c01b643c12be8: done: 0.032965 sec","job_status":"done","queue_duration_s":0.007983,"scheduling_latency_s":0.008004,"redis_calls":13,"redis_duration_s":0.00317,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000558,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00108,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001532,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000413181,"duration_s":0.032965,"completed_at":"2026-08-11T11:37:25.454Z","load_balancing_strategy":"primary","db_duration_s":0.004677,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 162.169552] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.455Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a4d292069017bb3b7219fec1","created_at":"2026-08-11T11:37:25.403Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-1ee6dd5595d3482d","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4933643722d875ad6acfcdd671e4d5f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:25.413Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a4d292069017bb3b7219fec1: start","job_status":"start","queue_duration_s":0.042464,"scheduling_latency_s":0.042486}1321gitlab # [ 162.171055] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.466Z","message":"No existing merge request to be cleaned up."}1322gitlab # [ 162.171931] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.473Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a4d292069017bb3b7219fec1","created_at":"2026-08-11T11:37:25.403Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-1ee6dd5595d3482d","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4933643722d875ad6acfcdd671e4d5f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:25.413Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a4d292069017bb3b7219fec1: done: 0.017601 sec","job_status":"done","queue_duration_s":0.042464,"scheduling_latency_s":0.042486,"redis_calls":10,"redis_duration_s":0.002422,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000994,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001428,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011486,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017601,"completed_at":"2026-08-11T11:37:25.473Z","load_balancing_strategy":"primary","db_duration_s":0.001539,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 162.239292] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.474Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9a1bb2b4a0524039ba64482b","created_at":"2026-08-11T11:37:25.403Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-1ee6dd5595d3482d","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4933643722d875ad6acfcdd671e4d5f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:25.413Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9a1bb2b4a0524039ba64482b: start","job_status":"start","queue_duration_s":0.061609,"scheduling_latency_s":0.06163}1324gitlab # [ 162.240364] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.485Z","message":"No existing merge request to be cleaned up."}1325gitlab # [ 162.241322] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.492Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9a1bb2b4a0524039ba64482b","created_at":"2026-08-11T11:37:25.403Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-1ee6dd5595d3482d","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4933643722d875ad6acfcdd671e4d5f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:25.413Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9a1bb2b4a0524039ba64482b: done: 0.017455 sec","job_status":"done","queue_duration_s":0.061609,"scheduling_latency_s":0.06163,"redis_calls":10,"redis_duration_s":0.002347,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001114,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001233,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011308,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017455,"completed_at":"2026-08-11T11:37:25.492Z","load_balancing_strategy":"primary","db_duration_s":0.001555,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 162.308289] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.493Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6c7cd313a65bcc4166137798","created_at":"2026-08-11T11:37:25.403Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-1ee6dd5595d3482d","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4933643722d875ad6acfcdd671e4d5f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:25.413Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6c7cd313a65bcc4166137798: start","job_status":"start","queue_duration_s":0.080395,"scheduling_latency_s":0.080416}1327gitlab # [ 162.308965] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.503Z","message":"No existing merge request to be cleaned up."}1328gitlab # [ 162.310178] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.510Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6c7cd313a65bcc4166137798","created_at":"2026-08-11T11:37:25.403Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-1ee6dd5595d3482d","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4933643722d875ad6acfcdd671e4d5f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:25.413Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6c7cd313a65bcc4166137798: done: 0.016977 sec","job_status":"done","queue_duration_s":0.080395,"scheduling_latency_s":0.080416,"redis_calls":10,"redis_duration_s":0.002097,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001214,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016977,"completed_at":"2026-08-11T11:37:25.510Z","load_balancing_strategy":"primary","db_duration_s":0.001447,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 162.434568] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:25.992Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"608825171f58cbd3adc93e15","created_at":"2026-08-11T11:37:25.322Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"be4e85342e0ddeabcb4d421fa78c28fd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:25.990Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-608825171f58cbd3adc93e15: start","job_status":"start","queue_duration_s":0.002049,"scheduling_latency_s":0.002097}1330gitlab # [ 162.503692] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:26.060Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1331gitlab # [ 162.533290] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:26.090Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"608825171f58cbd3adc93e15","created_at":"2026-08-11T11:37:25.322Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"be4e85342e0ddeabcb4d421fa78c28fd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:25.990Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-608825171f58cbd3adc93e15: done: 0.098557 sec","job_status":"done","queue_duration_s":0.002049,"scheduling_latency_s":0.002097,"redis_calls":10,"redis_duration_s":0.016303,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005593,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008297,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002413,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02194,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002315658,"duration_s":0.098557,"completed_at":"2026-08-11T11:37:26.090Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002116,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 162.606540] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:26.164Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"b6b030007f68c48c3757076a","created_at":"2026-08-11T11:37:26.025Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"169cb642c1fbb9b9bd2b88eebff8c404","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T11:37:26.049Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-b6b030007f68c48c3757076a: start","job_status":"start","queue_duration_s":0.115377,"scheduling_latency_s":0.115421}1333gitlab # [ 162.673783] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:26.231Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1334gitlab # [ 162.719663] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:26.277Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"b6b030007f68c48c3757076a","created_at":"2026-08-11T11:37:26.025Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"169cb642c1fbb9b9bd2b88eebff8c404","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T11:37:26.049Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-b6b030007f68c48c3757076a: done: 0.112754 sec","job_status":"done","queue_duration_s":0.115377,"scheduling_latency_s":0.115421,"redis_calls":10,"redis_duration_s":0.035304,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003228,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.030117,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001959,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001291505,"duration_s":0.112754,"completed_at":"2026-08-11T11:37:26.277Z","load_balancing_strategy":"primary","db_duration_s":0.003119,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 162.797497] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:26.355Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"1f5a23a65278518ee5718e0d","created_at":"2026-08-11T11:37:26.076Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.162Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-1f5a23a65278518ee5718e0d: start","job_status":"start","queue_duration_s":0.192249,"scheduling_latency_s":0.192318}1336gitlab # [ 163.307597] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:26.865Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"1f5a23a65278518ee5718e0d","created_at":"2026-08-11T11:37:26.076Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.162Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-1f5a23a65278518ee5718e0d: done: 0.510191 sec","job_status":"done","queue_duration_s":0.192249,"scheduling_latency_s":0.192318,"redis_calls":71,"redis_duration_s":0.19420400000000002,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.021826,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.002058,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.1675,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00282,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.201376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000931682,"duration_s":0.510191,"completed_at":"2026-08-11T11:37:26.865Z","load_balancing_strategy":"primary","db_duration_s":0.014174,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 163.403867] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:26.961Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"878fa9690783477925f5ca16","created_at":"2026-08-11T11:37:26.207Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"221dbdc994faa9f70ae840fa3d9b7b10","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-11T11:37:26.225Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-878fa9690783477925f5ca16: start","job_status":"start","queue_duration_s":0.735655,"scheduling_latency_s":0.7358}1338gitlab # [ 163.450144] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:27.008Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1339gitlab # [ 163.467586] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:27.025Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"878fa9690783477925f5ca16","created_at":"2026-08-11T11:37:26.207Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"221dbdc994faa9f70ae840fa3d9b7b10","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-11T11:37:26.225Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-878fa9690783477925f5ca16: done: 0.06391 sec","job_status":"done","queue_duration_s":0.735655,"scheduling_latency_s":0.7358,"redis_calls":10,"redis_duration_s":0.006177,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001536,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003383,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001258,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000977778,"duration_s":0.06391,"completed_at":"2026-08-11T11:37:27.025Z","load_balancing_strategy":"primary","db_duration_s":0.001152,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 163.534989] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:27.091Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"5d2186be4b10afea60594eb5","created_at":"2026-08-11T11:37:26.272Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd61df795613ca6d1321940317961691","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.357Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-5d2186be4b10afea60594eb5: start","job_status":"start","queue_duration_s":0.733597,"scheduling_latency_s":0.733645}1341gitlab # [ 164.110527] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:27.668Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"5d2186be4b10afea60594eb5","created_at":"2026-08-11T11:37:26.272Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd61df795613ca6d1321940317961691","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.357Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-5d2186be4b10afea60594eb5: done: 0.576776 sec","job_status":"done","queue_duration_s":0.733597,"scheduling_latency_s":0.733645,"redis_calls":565,"redis_duration_s":0.231023,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000719,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002375,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.227929,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.360836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000553702,"duration_s":0.576776,"completed_at":"2026-08-11T11:37:27.668Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001093,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 164.115492] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:27.670Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"909131374101e4d4eaee8511","created_at":"2026-08-11T11:37:26.408Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18e61050504583ece408635cddf8e9ea","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.432Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-909131374101e4d4eaee8511: start","job_status":"start","queue_duration_s":1.23789,"scheduling_latency_s":1.237913}1343gitlab # [ 164.263130] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:27.820Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"909131374101e4d4eaee8511","created_at":"2026-08-11T11:37:26.408Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18e61050504583ece408635cddf8e9ea","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.432Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-909131374101e4d4eaee8511: done: 0.150325 sec","job_status":"done","queue_duration_s":1.23789,"scheduling_latency_s":1.237913,"redis_calls":12,"redis_duration_s":0.004181,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00067,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001844,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001667,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.118,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.118,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000789765,"exclusive_lock_hold_duration_s":0.005083886,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.150325,"completed_at":"2026-08-11T11:37:27.820Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.118196,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 164.334240] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:27.891Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"fc07fd5ad403dfcca617ccc8","created_at":"2026-08-11T11:37:26.452Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"71671ce68cb0f1b7c635948d380713b8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.468Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-fc07fd5ad403dfcca617ccc8: start","job_status":"start","queue_duration_s":1.422862,"scheduling_latency_s":1.422957}1345gitlab # [ 164.439789] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:27.996Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"fc07fd5ad403dfcca617ccc8","created_at":"2026-08-11T11:37:26.452Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"71671ce68cb0f1b7c635948d380713b8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.468Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-fc07fd5ad403dfcca617ccc8: done: 0.105244 sec","job_status":"done","queue_duration_s":1.422862,"scheduling_latency_s":1.422957,"redis_calls":14,"redis_duration_s":0.008457,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002415,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003393,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002649,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001333131,"exclusive_lock_hold_duration_s":0.047256564,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.105244,"completed_at":"2026-08-11T11:37:27.996Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013031,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 164.579864] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:28.137Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"efeba06652146379bc601a67","created_at":"2026-08-11T11:37:26.519Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"536f49e29a435e1a500982c951426f18","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.535Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-efeba06652146379bc601a67: start","job_status":"start","queue_duration_s":1.601097,"scheduling_latency_s":1.601139}1347gitlab # [ 164.681240] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:28.238Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"efeba06652146379bc601a67","created_at":"2026-08-11T11:37:26.519Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"536f49e29a435e1a500982c951426f18","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.535Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-efeba06652146379bc601a67: done: 0.102052 sec","job_status":"done","queue_duration_s":1.601097,"scheduling_latency_s":1.601139,"redis_calls":10,"redis_duration_s":0.020329,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003772,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011255,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005302,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001193727,"duration_s":0.102052,"completed_at":"2026-08-11T11:37:28.238Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011417,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 164.728179] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:28.249Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"6cbfd4db9952b904c5371b7e","created_at":"2026-08-11T11:37:26.553Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34dbb385013373911e6afe3d0e1f32fb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.568Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-6cbfd4db9952b904c5371b7e: start","job_status":"start","queue_duration_s":1.680975,"scheduling_latency_s":1.681}1349gitlab # [ 164.756347] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:28.314Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"6cbfd4db9952b904c5371b7e","created_at":"2026-08-11T11:37:26.553Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34dbb385013373911e6afe3d0e1f32fb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.568Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-6cbfd4db9952b904c5371b7e: done: 0.065076 sec","job_status":"done","queue_duration_s":1.680975,"scheduling_latency_s":1.681,"redis_calls":12,"redis_duration_s":0.010636,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001778,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005609,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003249,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000578565,"exclusive_lock_hold_duration_s":0.00994847,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.065076,"completed_at":"2026-08-11T11:37:28.314Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025332,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 164.833641] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:28.315Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e6202141e14da9cf6912d3b8","created_at":"2026-08-11T11:37:26.589Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08135db6b109a48dfe197620ebd5d54d","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.606Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e6202141e14da9cf6912d3b8: start","job_status":"start","queue_duration_s":1.709146,"scheduling_latency_s":1.70917}1351gitlab # [ 164.859119] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:28.416Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e6202141e14da9cf6912d3b8","created_at":"2026-08-11T11:37:26.589Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08135db6b109a48dfe197620ebd5d54d","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.606Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e6202141e14da9cf6912d3b8: done: 0.100944 sec","job_status":"done","queue_duration_s":1.709146,"scheduling_latency_s":1.70917,"redis_calls":16,"redis_duration_s":0.006022,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003667,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001795,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00056,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.079777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000713778,"duration_s":0.100944,"completed_at":"2026-08-11T11:37:28.416Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007519,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 164.864908] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:28.420Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"3bea0c82b1d1fa049bad2b3d","created_at":"2026-08-11T11:37:26.628Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93df84e2bf23f9c9f4bb0e706d4328e8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.647Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-3bea0c82b1d1fa049bad2b3d: start","job_status":"start","queue_duration_s":1.772054,"scheduling_latency_s":1.772096}1353gitlab # [ 164.938637] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:28.448Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"3bea0c82b1d1fa049bad2b3d","created_at":"2026-08-11T11:37:26.628Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93df84e2bf23f9c9f4bb0e706d4328e8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.647Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-3bea0c82b1d1fa049bad2b3d: done: 0.028767 sec","job_status":"done","queue_duration_s":1.772054,"scheduling_latency_s":1.772096,"redis_calls":12,"redis_duration_s":0.005194,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00335,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001364,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00048,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037435,"duration_s":0.028767,"completed_at":"2026-08-11T11:37:28.448Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003824,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 165.015078] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:28.451Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"06bda6ffc8d822818e992015","created_at":"2026-08-11T11:37:26.689Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"11f566a72c892417ec6187e89a77e37c","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.713Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-06bda6ffc8d822818e992015: start","job_status":"start","queue_duration_s":1.738137,"scheduling_latency_s":1.73816}1355gitlab # [ 165.016641] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:28.497Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"06bda6ffc8d822818e992015","created_at":"2026-08-11T11:37:26.689Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"11f566a72c892417ec6187e89a77e37c","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.713Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-06bda6ffc8d822818e992015: done: 0.045654 sec","job_status":"done","queue_duration_s":1.738137,"scheduling_latency_s":1.73816,"redis_calls":13,"redis_duration_s":0.011137,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001721,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.006147,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003269,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017307,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.012648534,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.045654,"completed_at":"2026-08-11T11:37:28.496Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008331,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1356gitlab # [ 165.042730] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:28.498Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e89dc563e2cc643bdda0e296","created_at":"2026-08-11T11:37:26.736Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac2ad12e090f0422a65b677e4c1097f9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.755Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-e89dc563e2cc643bdda0e296: start","job_status":"start","queue_duration_s":1.743087,"scheduling_latency_s":1.743109}1357gitlab # [ 165.365530] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:28.923Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e89dc563e2cc643bdda0e296","created_at":"2026-08-11T11:37:26.736Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac2ad12e090f0422a65b677e4c1097f9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.755Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-e89dc563e2cc643bdda0e296: done: 0.424796 sec","job_status":"done","queue_duration_s":1.743087,"scheduling_latency_s":1.743109,"redis_calls":12,"redis_duration_s":0.019355999999999998,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001748,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009973,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.007635,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.112,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.109,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.148902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001701892,"exclusive_lock_hold_duration_s":0.381640125,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.424796,"completed_at":"2026-08-11T11:37:28.923Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.303286,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 165.460643] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.018Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"45f50b739713bdf23690a947","created_at":"2026-08-11T11:37:26.774Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f370db554300637706a9f70d4297fcbf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.792Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-45f50b739713bdf23690a947: start","job_status":"start","queue_duration_s":2.225183,"scheduling_latency_s":2.225251}1359gitlab # [ 165.524322] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.081Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"45f50b739713bdf23690a947","created_at":"2026-08-11T11:37:26.774Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f370db554300637706a9f70d4297fcbf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.792Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-45f50b739713bdf23690a947: done: 0.063871 sec","job_status":"done","queue_duration_s":2.225183,"scheduling_latency_s":2.225251,"redis_calls":10,"redis_duration_s":0.023461999999999997,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00585,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.015658,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001954,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00268414,"duration_s":0.063871,"completed_at":"2026-08-11T11:37:29.081Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001988,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 165.603503] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.160Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"4006caeaa29f306c84ff291f","created_at":"2026-08-11T11:37:26.810Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d3589efc0b49eae81a02d2bfc0f2247","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.829Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-4006caeaa29f306c84ff291f: start","job_status":"start","queue_duration_s":2.330419,"scheduling_latency_s":2.330466}1361gitlab # [ 165.654343] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.209Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1362gitlab # [ 165.670293] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.228Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"4006caeaa29f306c84ff291f","created_at":"2026-08-11T11:37:26.810Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d3589efc0b49eae81a02d2bfc0f2247","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.829Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-4006caeaa29f306c84ff291f: done: 0.068098 sec","job_status":"done","queue_duration_s":2.330419,"scheduling_latency_s":2.330466,"redis_calls":10,"redis_duration_s":0.020817,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004005,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011691,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005121,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021721,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001879289,"duration_s":0.068098,"completed_at":"2026-08-11T11:37:29.228Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003348,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 165.705856] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"493e90f8b55e0d4f888887a1","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-493e90f8b55e0d4f888887a1: start","job_status":"start","queue_duration_s":2.39259,"scheduling_latency_s":2.392615}1364gitlab # [ 165.770613] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.328Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"493e90f8b55e0d4f888887a1","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-493e90f8b55e0d4f888887a1: done: 0.090818 sec","job_status":"done","queue_duration_s":2.39259,"scheduling_latency_s":2.392615,"redis_calls":16,"redis_duration_s":0.047295,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003994,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.025493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.017808,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018867,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001374197,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.090818,"completed_at":"2026-08-11T11:37:29.328Z","load_balancing_strategy":"primary","db_duration_s":0.002015,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 165.772177] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c28722cf246bf08ad0bc710b","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c28722cf246bf08ad0bc710b: start","job_status":"start","queue_duration_s":2.485098,"scheduling_latency_s":2.485122}1366gitlab # [ 165.788640] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c28722cf246bf08ad0bc710b","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c28722cf246bf08ad0bc710b: done: 0.016445 sec","job_status":"done","queue_duration_s":2.485098,"scheduling_latency_s":2.485122,"redis_calls":13,"redis_duration_s":0.002942,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000946,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010327,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016445,"completed_at":"2026-08-11T11:37:29.346Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 165.866223] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59bc296c1498c927fc66a4a4","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59bc296c1498c927fc66a4a4: start","job_status":"start","queue_duration_s":2.506846,"scheduling_latency_s":2.506868}1368gitlab # [ 165.867873] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59bc296c1498c927fc66a4a4","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59bc296c1498c927fc66a4a4: done: 0.015825 sec","job_status":"done","queue_duration_s":2.506846,"scheduling_latency_s":2.506868,"redis_calls":13,"redis_duration_s":0.0028339999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010509,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015825,"completed_at":"2026-08-11T11:37:29.367Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 165.955298] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80a8df9587b432dc536039d2","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80a8df9587b432dc536039d2: start","job_status":"start","queue_duration_s":2.523981,"scheduling_latency_s":2.524003}1370gitlab # [ 165.956935] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.384Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80a8df9587b432dc536039d2","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80a8df9587b432dc536039d2: done: 0.015534 sec","job_status":"done","queue_duration_s":2.523981,"scheduling_latency_s":2.524003,"redis_calls":13,"redis_duration_s":0.002875,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015534,"completed_at":"2026-08-11T11:37:29.384Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 166.025349] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"522a2ab57ba882a706e7628c","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-522a2ab57ba882a706e7628c: start","job_status":"start","queue_duration_s":2.540817,"scheduling_latency_s":2.540839}1372gitlab # [ 166.026961] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"522a2ab57ba882a706e7628c","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-522a2ab57ba882a706e7628c: done: 0.015604 sec","job_status":"done","queue_duration_s":2.540817,"scheduling_latency_s":2.540839,"redis_calls":13,"redis_duration_s":0.002837,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015604,"completed_at":"2026-08-11T11:37:29.401Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 166.098674] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.403Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"806380e0de316fae8ea4c560","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-806380e0de316fae8ea4c560: start","job_status":"start","queue_duration_s":2.557851,"scheduling_latency_s":2.557872}1374gitlab # [ 166.103414] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.420Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"806380e0de316fae8ea4c560","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-806380e0de316fae8ea4c560: done: 0.017546 sec","job_status":"done","queue_duration_s":2.557851,"scheduling_latency_s":2.557872,"redis_calls":13,"redis_duration_s":0.003752,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00111,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002642,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017546,"completed_at":"2026-08-11T11:37:29.420Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 166.206180] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90b96dbb811cbe0963be20dd","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90b96dbb811cbe0963be20dd: start","job_status":"start","queue_duration_s":2.57703,"scheduling_latency_s":2.577052}1376gitlab # [ 166.207710] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90b96dbb811cbe0963be20dd","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90b96dbb811cbe0963be20dd: done: 0.01891 sec","job_status":"done","queue_duration_s":2.57703,"scheduling_latency_s":2.577052,"redis_calls":13,"redis_duration_s":0.005322,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000994,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004328,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01891,"completed_at":"2026-08-11T11:37:29.441Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 166.279320] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb99b53ddeecd32f580ed501","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb99b53ddeecd32f580ed501: start","job_status":"start","queue_duration_s":2.597855,"scheduling_latency_s":2.597878}1378gitlab # [ 166.280101] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb99b53ddeecd32f580ed501","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb99b53ddeecd32f580ed501: done: 0.016242 sec","job_status":"done","queue_duration_s":2.597855,"scheduling_latency_s":2.597878,"redis_calls":13,"redis_duration_s":0.002728,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000851,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001877,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016242,"completed_at":"2026-08-11T11:37:29.459Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 166.366482] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1fc0acfd634d00b9607ca7f","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1fc0acfd634d00b9607ca7f: start","job_status":"start","queue_duration_s":2.615761,"scheduling_latency_s":2.615783}1380gitlab # [ 166.367754] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1fc0acfd634d00b9607ca7f","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1fc0acfd634d00b9607ca7f: done: 0.016013 sec","job_status":"done","queue_duration_s":2.615761,"scheduling_latency_s":2.615783,"redis_calls":13,"redis_duration_s":0.002723,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000831,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016013,"completed_at":"2026-08-11T11:37:29.476Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 166.439436] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3d2840603568816f5f0cb2c","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3d2840603568816f5f0cb2c: start","job_status":"start","queue_duration_s":2.633219,"scheduling_latency_s":2.633285}1382gitlab # [ 166.440908] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3d2840603568816f5f0cb2c","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3d2840603568816f5f0cb2c: done: 0.015705 sec","job_status":"done","queue_duration_s":2.633219,"scheduling_latency_s":2.633285,"redis_calls":13,"redis_duration_s":0.00257,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000793,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001777,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015705,"completed_at":"2026-08-11T11:37:29.494Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 166.525971] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d254a5863e37f3a0e84f9084","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d254a5863e37f3a0e84f9084: start","job_status":"start","queue_duration_s":2.650416,"scheduling_latency_s":2.650438}1384gitlab # [ 166.527379] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d254a5863e37f3a0e84f9084","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d254a5863e37f3a0e84f9084: done: 0.015994 sec","job_status":"done","queue_duration_s":2.650416,"scheduling_latency_s":2.650438,"redis_calls":13,"redis_duration_s":0.002959,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001864,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010843,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015994,"completed_at":"2026-08-11T11:37:29.511Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 166.594250] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9c38799f1d0b43e280ec97f","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9c38799f1d0b43e280ec97f: start","job_status":"start","queue_duration_s":2.66816,"scheduling_latency_s":2.668181}1386gitlab # [ 166.598125] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9c38799f1d0b43e280ec97f","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9c38799f1d0b43e280ec97f: done: 0.016593 sec","job_status":"done","queue_duration_s":2.66816,"scheduling_latency_s":2.668181,"redis_calls":13,"redis_duration_s":0.002959,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00202,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010847,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016593,"completed_at":"2026-08-11T11:37:29.529Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 166.670696] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce824f400039d18c7f5205cd","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce824f400039d18c7f5205cd: start","job_status":"start","queue_duration_s":2.686105,"scheduling_latency_s":2.686125}1388gitlab # [ 166.672167] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce824f400039d18c7f5205cd","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce824f400039d18c7f5205cd: done: 0.016571 sec","job_status":"done","queue_duration_s":2.686105,"scheduling_latency_s":2.686125,"redis_calls":13,"redis_duration_s":0.002959,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000982,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016571,"completed_at":"2026-08-11T11:37:29.547Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 166.749366] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58bca49bc1da9a64b06cd685","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58bca49bc1da9a64b06cd685: start","job_status":"start","queue_duration_s":2.704053,"scheduling_latency_s":2.704076}1390gitlab # [ 166.750904] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58bca49bc1da9a64b06cd685","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58bca49bc1da9a64b06cd685: done: 0.016638 sec","job_status":"done","queue_duration_s":2.704053,"scheduling_latency_s":2.704076,"redis_calls":13,"redis_duration_s":0.003052,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001025,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016638,"completed_at":"2026-08-11T11:37:29.565Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 166.825350] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6999f431c95da140bab27dd","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6999f431c95da140bab27dd: start","job_status":"start","queue_duration_s":2.722079,"scheduling_latency_s":2.722101}1392gitlab # [ 166.827541] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.584Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6999f431c95da140bab27dd","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6999f431c95da140bab27dd: done: 0.01685 sec","job_status":"done","queue_duration_s":2.722079,"scheduling_latency_s":2.722101,"redis_calls":13,"redis_duration_s":0.0030229999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01685,"completed_at":"2026-08-11T11:37:29.584Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 166.898204] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00d8b853136d2b532434db21","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00d8b853136d2b532434db21: start","job_status":"start","queue_duration_s":2.740324,"scheduling_latency_s":2.740346}1394gitlab # [ 166.899665] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00d8b853136d2b532434db21","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00d8b853136d2b532434db21: done: 0.017009 sec","job_status":"done","queue_duration_s":2.740324,"scheduling_latency_s":2.740346,"redis_calls":13,"redis_duration_s":0.003066,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017009,"completed_at":"2026-08-11T11:37:29.602Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 166.978285] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"091d30a0385700824164317d","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-091d30a0385700824164317d: start","job_status":"start","queue_duration_s":2.758716,"scheduling_latency_s":2.758737}1396gitlab # [ 166.979840] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.651Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"091d30a0385700824164317d","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-091d30a0385700824164317d: done: 0.047507 sec","job_status":"done","queue_duration_s":2.758716,"scheduling_latency_s":2.758737,"redis_calls":13,"redis_duration_s":0.015707,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005777,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.047507,"completed_at":"2026-08-11T11:37:29.651Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 167.063375] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"309e3642fe926f6fae595d93","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-309e3642fe926f6fae595d93: start","job_status":"start","queue_duration_s":2.811431,"scheduling_latency_s":2.811459}1398gitlab # [ 167.064909] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.734Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"309e3642fe926f6fae595d93","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-309e3642fe926f6fae595d93: done: 0.078085 sec","job_status":"done","queue_duration_s":2.811431,"scheduling_latency_s":2.811459,"redis_calls":13,"redis_duration_s":0.030545,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.006244,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.024301,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.078085,"completed_at":"2026-08-11T11:37:29.734Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 167.153423] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.746Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5fc5560743019e79fcfb1b2f","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5fc5560743019e79fcfb1b2f: start","job_status":"start","queue_duration_s":2.901641,"scheduling_latency_s":2.901673}1400gitlab # [ 167.155098] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.795Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5fc5560743019e79fcfb1b2f","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5fc5560743019e79fcfb1b2f: done: 0.048518 sec","job_status":"done","queue_duration_s":2.901641,"scheduling_latency_s":2.901673,"redis_calls":13,"redis_duration_s":0.018246,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.008677,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009569,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.048518,"completed_at":"2026-08-11T11:37:29.795Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 167.227336] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c9efcdd37ab174684573ed4","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c9efcdd37ab174684573ed4: start","job_status":"start","queue_duration_s":2.953728,"scheduling_latency_s":2.953753}1402gitlab # [ 167.228906] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c9efcdd37ab174684573ed4","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c9efcdd37ab174684573ed4: done: 0.035075 sec","job_status":"done","queue_duration_s":2.953728,"scheduling_latency_s":2.953753,"redis_calls":13,"redis_duration_s":0.015058,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004787,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010271,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035075,"completed_at":"2026-08-11T11:37:29.833Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 167.321326] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6586ff1459104ee6b50e76de","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6586ff1459104ee6b50e76de: start","job_status":"start","queue_duration_s":3.035971,"scheduling_latency_s":3.036007}1404gitlab # [ 167.322923] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6586ff1459104ee6b50e76de","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6586ff1459104ee6b50e76de: done: 0.073267 sec","job_status":"done","queue_duration_s":3.035971,"scheduling_latency_s":3.036007,"redis_calls":13,"redis_duration_s":0.019993,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.006196,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.013797,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.073267,"completed_at":"2026-08-11T11:37:29.954Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 167.393193] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db3fbf78919135129a234fcc","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db3fbf78919135129a234fcc: start","job_status":"start","queue_duration_s":3.117333,"scheduling_latency_s":3.11736}1406gitlab # [ 167.394821] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:29.994Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db3fbf78919135129a234fcc","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db3fbf78919135129a234fcc: done: 0.031737 sec","job_status":"done","queue_duration_s":3.117333,"scheduling_latency_s":3.11736,"redis_calls":13,"redis_duration_s":0.014187,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009698,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031737,"completed_at":"2026-08-11T11:37:29.994Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 167.466294] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d81ab3320fd072cae611b2dc","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d81ab3320fd072cae611b2dc: start","job_status":"start","queue_duration_s":3.158543,"scheduling_latency_s":3.158571}1408gitlab # [ 167.467175] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d81ab3320fd072cae611b2dc","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d81ab3320fd072cae611b2dc: done: 0.031978 sec","job_status":"done","queue_duration_s":3.158543,"scheduling_latency_s":3.158571,"redis_calls":13,"redis_duration_s":0.0053159999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001875,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003441,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010732,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031978,"completed_at":"2026-08-11T11:37:30.035Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 167.538237] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06ab73cc639270e388f145a4","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06ab73cc639270e388f145a4: start","job_status":"start","queue_duration_s":3.196068,"scheduling_latency_s":3.196092}1410gitlab # [ 167.540622] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06ab73cc639270e388f145a4","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06ab73cc639270e388f145a4: done: 0.024681 sec","job_status":"done","queue_duration_s":3.196068,"scheduling_latency_s":3.196092,"redis_calls":13,"redis_duration_s":0.007988,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005433,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010707,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024681,"completed_at":"2026-08-11T11:37:30.065Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 167.613254] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.070Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b235c5dd916dc642b119aade","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b235c5dd916dc642b119aade: start","job_status":"start","queue_duration_s":3.225095,"scheduling_latency_s":3.22512}1412gitlab # [ 167.614775] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b235c5dd916dc642b119aade","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b235c5dd916dc642b119aade: done: 0.038019 sec","job_status":"done","queue_duration_s":3.225095,"scheduling_latency_s":3.22512,"redis_calls":13,"redis_duration_s":0.018882,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.008544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010338,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038019,"completed_at":"2026-08-11T11:37:30.108Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 167.707733] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"614edbc9a86c9ce8f7c81cda","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-614edbc9a86c9ce8f7c81cda: start","job_status":"start","queue_duration_s":3.267927,"scheduling_latency_s":3.267952}1414gitlab # [ 167.709201] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"614edbc9a86c9ce8f7c81cda","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-614edbc9a86c9ce8f7c81cda: done: 0.02747 sec","job_status":"done","queue_duration_s":3.267927,"scheduling_latency_s":3.267952,"redis_calls":13,"redis_duration_s":0.00916,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006645,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02747,"completed_at":"2026-08-11T11:37:30.140Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 167.786067] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1607b335eea9e422d8a94f0e","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1607b335eea9e422d8a94f0e: start","job_status":"start","queue_duration_s":3.299434,"scheduling_latency_s":3.299461}1416gitlab # [ 167.787438] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1607b335eea9e422d8a94f0e","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1607b335eea9e422d8a94f0e: done: 0.066979 sec","job_status":"done","queue_duration_s":3.299434,"scheduling_latency_s":3.299461,"redis_calls":13,"redis_duration_s":0.040009,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.030908,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.066979,"completed_at":"2026-08-11T11:37:30.211Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 167.858267] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6057eceb97a93e3e32f85ee","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6057eceb97a93e3e32f85ee: start","job_status":"start","queue_duration_s":3.371599,"scheduling_latency_s":3.371628}1418gitlab # [ 167.859848] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6057eceb97a93e3e32f85ee","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6057eceb97a93e3e32f85ee: done: 0.057013 sec","job_status":"done","queue_duration_s":3.371599,"scheduling_latency_s":3.371628,"redis_calls":13,"redis_duration_s":0.033444,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.016554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.01689,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.057013,"completed_at":"2026-08-11T11:37:30.273Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 167.953549] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9207e4233cb5b430d05d5159","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9207e4233cb5b430d05d5159: start","job_status":"start","queue_duration_s":3.434837,"scheduling_latency_s":3.434877}1420gitlab # [ 167.954746] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9207e4233cb5b430d05d5159","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9207e4233cb5b430d05d5159: done: 0.044496 sec","job_status":"done","queue_duration_s":3.434837,"scheduling_latency_s":3.434877,"redis_calls":13,"redis_duration_s":0.021956,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003479,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.018477,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012384,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.044496,"completed_at":"2026-08-11T11:37:30.324Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 168.025683] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b88b0e10be643d0bb63795ab","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b88b0e10be643d0bb63795ab: start","job_status":"start","queue_duration_s":3.485043,"scheduling_latency_s":3.485078}1422gitlab # [ 168.027436] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b88b0e10be643d0bb63795ab","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b88b0e10be643d0bb63795ab: done: 0.036939 sec","job_status":"done","queue_duration_s":3.485043,"scheduling_latency_s":3.485078,"redis_calls":13,"redis_duration_s":0.013307,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004908,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008399,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036939,"completed_at":"2026-08-11T11:37:30.367Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 168.121829] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"851c9b2d4ae55651efbab6e8","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-851c9b2d4ae55651efbab6e8: start","job_status":"start","queue_duration_s":3.525841,"scheduling_latency_s":3.52587}1424gitlab # [ 168.123580] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"851c9b2d4ae55651efbab6e8","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-851c9b2d4ae55651efbab6e8: done: 0.045238 sec","job_status":"done","queue_duration_s":3.525841,"scheduling_latency_s":3.52587,"redis_calls":13,"redis_duration_s":0.012580000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003824,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008756,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.045238,"completed_at":"2026-08-11T11:37:30.416Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 168.142603] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.421Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e582df24506b0a2a1529b117","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e582df24506b0a2a1529b117: start","job_status":"start","queue_duration_s":3.576018,"scheduling_latency_s":3.576045}1426gitlab # [ 168.163391] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e582df24506b0a2a1529b117","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e582df24506b0a2a1529b117: done: 0.034202 sec","job_status":"done","queue_duration_s":3.576018,"scheduling_latency_s":3.576045,"redis_calls":13,"redis_duration_s":0.016536,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.011607,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034202,"completed_at":"2026-08-11T11:37:30.455Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 168.246345] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b878945424f742399b16cb35","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b878945424f742399b16cb35: start","job_status":"start","queue_duration_s":3.616351,"scheduling_latency_s":3.616377}1428gitlab # [ 168.248256] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b878945424f742399b16cb35","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b878945424f742399b16cb35: done: 0.052445 sec","job_status":"done","queue_duration_s":3.616351,"scheduling_latency_s":3.616377,"redis_calls":13,"redis_duration_s":0.024965,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.01427,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010695,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.052445,"completed_at":"2026-08-11T11:37:30.513Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 168.323565] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.519Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aebe6a709f1d9d0b808e3465","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aebe6a709f1d9d0b808e3465: start","job_status":"start","queue_duration_s":3.673816,"scheduling_latency_s":3.673846}1430gitlab # [ 168.325610] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aebe6a709f1d9d0b808e3465","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aebe6a709f1d9d0b808e3465: done: 0.042076 sec","job_status":"done","queue_duration_s":3.673816,"scheduling_latency_s":3.673846,"redis_calls":13,"redis_duration_s":0.008566,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00375,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004816,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.042076,"completed_at":"2026-08-11T11:37:30.561Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 168.424562] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a52aa170626583e552c3c186","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a52aa170626583e552c3c186: start","job_status":"start","queue_duration_s":3.720926,"scheduling_latency_s":3.720959}1432gitlab # [ 168.426734] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.596Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a52aa170626583e552c3c186","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a52aa170626583e552c3c186: done: 0.029926 sec","job_status":"done","queue_duration_s":3.720926,"scheduling_latency_s":3.720959,"redis_calls":13,"redis_duration_s":0.007587,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001444,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006143,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029926,"completed_at":"2026-08-11T11:37:30.596Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 168.500588] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.601Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"feb2b1acd3661ce1cdf824ff","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-feb2b1acd3661ce1cdf824ff: start","job_status":"start","queue_duration_s":3.756176,"scheduling_latency_s":3.756212}1434gitlab # [ 168.502503] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"feb2b1acd3661ce1cdf824ff","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-feb2b1acd3661ce1cdf824ff: done: 0.064705 sec","job_status":"done","queue_duration_s":3.756176,"scheduling_latency_s":3.756212,"redis_calls":13,"redis_duration_s":0.013139999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004034,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012415,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.064705,"completed_at":"2026-08-11T11:37:30.666Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 168.606781] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0423a058a44b1659e5e602a","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0423a058a44b1659e5e602a: start","job_status":"start","queue_duration_s":3.826153,"scheduling_latency_s":3.826184}1436gitlab # [ 168.608138] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0423a058a44b1659e5e602a","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0423a058a44b1659e5e602a: done: 0.03902 sec","job_status":"done","queue_duration_s":3.826153,"scheduling_latency_s":3.826184,"redis_calls":13,"redis_duration_s":0.014984999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004292,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010693,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03902,"completed_at":"2026-08-11T11:37:30.710Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 168.690977] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.723Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93c1e4a888e9c1d6e8113bc4","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93c1e4a888e9c1d6e8113bc4: start","job_status":"start","queue_duration_s":3.87834,"scheduling_latency_s":3.878373}1438gitlab # [ 168.692398] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93c1e4a888e9c1d6e8113bc4","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93c1e4a888e9c1d6e8113bc4: done: 0.053596 sec","job_status":"done","queue_duration_s":3.87834,"scheduling_latency_s":3.878373,"redis_calls":13,"redis_duration_s":0.013485,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008581,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.053596,"completed_at":"2026-08-11T11:37:30.777Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 168.764715] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8529fdbaed6371d544d54141","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8529fdbaed6371d544d54141: start","job_status":"start","queue_duration_s":3.936609,"scheduling_latency_s":3.936649}1440gitlab # [ 168.766195] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8529fdbaed6371d544d54141","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8529fdbaed6371d544d54141: done: 0.06895 sec","job_status":"done","queue_duration_s":3.936609,"scheduling_latency_s":3.936649,"redis_calls":13,"redis_duration_s":0.013925,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002257,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.011668,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.06895,"completed_at":"2026-08-11T11:37:30.850Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 168.845392] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.857Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0a63e80a45ae7b3d190fcb5","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0a63e80a45ae7b3d190fcb5: start","job_status":"start","queue_duration_s":4.011953,"scheduling_latency_s":4.011992}1442gitlab # [ 168.846979] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0a63e80a45ae7b3d190fcb5","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0a63e80a45ae7b3d190fcb5: done: 0.031333 sec","job_status":"done","queue_duration_s":4.011953,"scheduling_latency_s":4.011992,"redis_calls":13,"redis_duration_s":0.005534,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001834,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031333,"completed_at":"2026-08-11T11:37:30.888Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 168.915936] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.893Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a29c6052a165d8394d5bd8d","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a29c6052a165d8394d5bd8d: start","job_status":"start","queue_duration_s":4.047886,"scheduling_latency_s":4.047915}1444gitlab # [ 168.917275] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a29c6052a165d8394d5bd8d","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a29c6052a165d8394d5bd8d: done: 0.049841 sec","job_status":"done","queue_duration_s":4.047886,"scheduling_latency_s":4.047915,"redis_calls":13,"redis_duration_s":0.026815,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004238,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.022577,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.049841,"completed_at":"2026-08-11T11:37:30.942Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 168.986278] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e107747c248ec8eafc7a275","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e107747c248ec8eafc7a275: start","job_status":"start","queue_duration_s":4.10375,"scheduling_latency_s":4.103784}1446gitlab # [ 168.987967] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e107747c248ec8eafc7a275","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e107747c248ec8eafc7a275: done: 0.039416 sec","job_status":"done","queue_duration_s":4.10375,"scheduling_latency_s":4.103784,"redis_calls":13,"redis_duration_s":0.015935,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004632,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.011303,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039416,"completed_at":"2026-08-11T11:37:30.988Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 169.060903] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:30.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c13c2c7486c5778135f0cfc8","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c13c2c7486c5778135f0cfc8: start","job_status":"start","queue_duration_s":4.148464,"scheduling_latency_s":4.148496}1448gitlab # [ 169.062190] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:31.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c13c2c7486c5778135f0cfc8","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c13c2c7486c5778135f0cfc8: done: 0.036071 sec","job_status":"done","queue_duration_s":4.148464,"scheduling_latency_s":4.148496,"redis_calls":13,"redis_duration_s":0.014816,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002398,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.012418,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036071,"completed_at":"2026-08-11T11:37:31.029Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 169.133099] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:31.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d14f12a8974c649a3fd52b21","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d14f12a8974c649a3fd52b21: start","job_status":"start","queue_duration_s":4.188854,"scheduling_latency_s":4.188884}1450gitlab # [ 169.134438] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:31.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d14f12a8974c649a3fd52b21","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d14f12a8974c649a3fd52b21: done: 0.037844 sec","job_status":"done","queue_duration_s":4.188854,"scheduling_latency_s":4.188884,"redis_calls":13,"redis_duration_s":0.01454,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004209,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010331,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037844,"completed_at":"2026-08-11T11:37:31.071Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 169.202563] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:31.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63cb77bbe823d5903712d6d3","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63cb77bbe823d5903712d6d3: start","job_status":"start","queue_duration_s":4.231533,"scheduling_latency_s":4.231565}1452gitlab # [ 169.203822] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:31.127Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63cb77bbe823d5903712d6d3","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63cb77bbe823d5903712d6d3: done: 0.050847 sec","job_status":"done","queue_duration_s":4.231533,"scheduling_latency_s":4.231565,"redis_calls":13,"redis_duration_s":0.018121,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.012599,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.050847,"completed_at":"2026-08-11T11:37:31.127Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 169.274144] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:31.132Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"471ce483b41a20c9160878c0","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-471ce483b41a20c9160878c0: start","job_status":"start","queue_duration_s":4.287189,"scheduling_latency_s":4.287217}1454gitlab # [ 169.342112] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:31.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"471ce483b41a20c9160878c0","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-471ce483b41a20c9160878c0: done: 0.053197 sec","job_status":"done","queue_duration_s":4.287189,"scheduling_latency_s":4.287217,"redis_calls":13,"redis_duration_s":0.027104000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.016816,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010288,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.053197,"completed_at":"2026-08-11T11:37:31.185Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 169.343717] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:31.196Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9f0c441303cbce460405ea8","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9f0c441303cbce460405ea8: start","job_status":"start","queue_duration_s":4.351342,"scheduling_latency_s":4.351371}1456gitlab # [ 169.418629] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:31.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9f0c441303cbce460405ea8","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9f0c441303cbce460405ea8: done: 0.063601 sec","job_status":"done","queue_duration_s":4.351342,"scheduling_latency_s":4.351371,"redis_calls":13,"redis_duration_s":0.032337000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.020111,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.012226,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.063601,"completed_at":"2026-08-11T11:37:31.260Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 169.420903] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:31.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a65ff2c3b634e246d88a621","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a65ff2c3b634e246d88a621: start","job_status":"start","queue_duration_s":4.436964,"scheduling_latency_s":4.437004}1458gitlab # [ 169.501632] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:31.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a65ff2c3b634e246d88a621","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a65ff2c3b634e246d88a621: done: 0.039279 sec","job_status":"done","queue_duration_s":4.436964,"scheduling_latency_s":4.437004,"redis_calls":13,"redis_duration_s":0.013047999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002721,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010327,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012767,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039279,"completed_at":"2026-08-11T11:37:31.321Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 169.503586] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:31.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ea1898e0512000fc8608d9b","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ea1898e0512000fc8608d9b: start","job_status":"start","queue_duration_s":4.479506,"scheduling_latency_s":4.479537}1460gitlab # [ 169.571578] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:31.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ea1898e0512000fc8608d9b","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ea1898e0512000fc8608d9b: done: 0.042013 sec","job_status":"done","queue_duration_s":4.479506,"scheduling_latency_s":4.479537,"redis_calls":13,"redis_duration_s":0.01301,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004368,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008642,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.042013,"completed_at":"2026-08-11T11:37:31.366Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 169.639949] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:31.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3aff0387817f1a37893a10e","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3aff0387817f1a37893a10e: start","job_status":"start","queue_duration_s":4.527134,"scheduling_latency_s":4.52716}1462gitlab # [ 169.641308] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:37:31.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3aff0387817f1a37893a10e","created_at":"2026-08-11T11:37:26.466Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-40af86070e3e4f4a","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d474b9da52163228161360e778968422","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:37:26.845Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3aff0387817f1a37893a10e: done: 0.035615 sec","job_status":"done","queue_duration_s":4.527134,"scheduling_latency_s":4.52716,"redis_calls":13,"redis_duration_s":0.014653,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005323,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035615,"completed_at":"2026-08-11T11:37:31.407Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 169.994363] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 3443026473 wd_nsec: 34430254281464gitlab # [ 179.595166] setup-gitlab-start[2343]: W, [2026-08-11T11:37:43.152305 #2343] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1465gitlab # [ 199.839934] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.395Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"4bddc2d3556408396b6ced26","created_at":"2026-08-11T11:38:03.355Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"860ce479d6e204cf1334b3c5721732da","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.392Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-4bddc2d3556408396b6ced26: start","job_status":"start","queue_duration_s":0.003018,"scheduling_latency_s":0.003097}1466gitlab # [ 199.953829] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.511Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"4bddc2d3556408396b6ced26","created_at":"2026-08-11T11:38:03.355Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"860ce479d6e204cf1334b3c5721732da","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.392Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-4bddc2d3556408396b6ced26: done: 0.116447 sec","job_status":"done","queue_duration_s":0.003018,"scheduling_latency_s":0.003097,"redis_calls":12,"redis_duration_s":0.014658000000000001,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.002895,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001328,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009251,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001184,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002208381,"duration_s":0.116447,"completed_at":"2026-08-11T11:38:03.511Z","load_balancing_strategy":"primary","db_duration_s":0.013659,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 199.958861] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.516Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"04b3cedd0ca2367ad0ebb80a","created_at":"2026-08-11T11:38:03.403Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"022ec012b43f58dd6c912ecf8945b605","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.408Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-04b3cedd0ca2367ad0ebb80a: start","job_status":"start","queue_duration_s":0.107871,"scheduling_latency_s":0.107942}1468gitlab # [ 200.033427] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.580Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"04b3cedd0ca2367ad0ebb80a","created_at":"2026-08-11T11:38:03.403Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"022ec012b43f58dd6c912ecf8945b605","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.408Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-04b3cedd0ca2367ad0ebb80a: done: 0.063996 sec","job_status":"done","queue_duration_s":0.107871,"scheduling_latency_s":0.107942,"redis_calls":9,"redis_duration_s":0.024548,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.017292,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.007256,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001951924,"exclusive_lock_hold_duration_s":0.007173817,"duration_s":0.063996,"completed_at":"2026-08-11T11:38:03.580Z","load_balancing_strategy":"primary","db_duration_s":0.003089,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469gitlab # [ 200.035937] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.593Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"76f1470bbbec54c3d7eb494e","created_at":"2026-08-11T11:38:03.420Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b20949180c45cb2bcd3cf0e07cc7a933","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.423Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-76f1470bbbec54c3d7eb494e: start","job_status":"start","queue_duration_s":0.170077,"scheduling_latency_s":0.170138}1470gitlab # [ 200.109700] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.624Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1471gitlab # [ 200.110931] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.645Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"76f1470bbbec54c3d7eb494e","created_at":"2026-08-11T11:38:03.420Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b20949180c45cb2bcd3cf0e07cc7a933","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.423Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-76f1470bbbec54c3d7eb494e: done: 0.051627 sec","job_status":"done","queue_duration_s":0.170077,"scheduling_latency_s":0.170138,"redis_calls":7,"redis_duration_s":0.018466,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0173,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001166,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051627,"completed_at":"2026-08-11T11:38:03.645Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 200.182243] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.650Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"d7036dc40d2464d1ffbc41bc","created_at":"2026-08-11T11:38:03.445Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55920deb21f4f2d93966a3d1bfab6f80","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.452Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-d7036dc40d2464d1ffbc41bc: start","job_status":"start","queue_duration_s":0.197894,"scheduling_latency_s":0.197942}1473gitlab # [ 200.183705] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.667Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1474gitlab # [ 200.184985] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.683Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"d7036dc40d2464d1ffbc41bc","created_at":"2026-08-11T11:38:03.445Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55920deb21f4f2d93966a3d1bfab6f80","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.452Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-d7036dc40d2464d1ffbc41bc: done: 0.033259 sec","job_status":"done","queue_duration_s":0.197894,"scheduling_latency_s":0.197942,"redis_calls":7,"redis_duration_s":0.014123,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008307,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005816,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033259,"completed_at":"2026-08-11T11:38:03.683Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 200.253482] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.687Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"75736e0dcc697cb74074151e","created_at":"2026-08-11T11:38:03.467Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"01fba69985921166f6e611524f3b3fdd","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.471Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-75736e0dcc697cb74074151e: start","job_status":"start","queue_duration_s":0.215821,"scheduling_latency_s":0.215848}1476gitlab # [ 200.254739] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.732Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"75736e0dcc697cb74074151e","created_at":"2026-08-11T11:38:03.467Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"01fba69985921166f6e611524f3b3fdd","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.471Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-75736e0dcc697cb74074151e: done: 0.045198 sec","job_status":"done","queue_duration_s":0.215821,"scheduling_latency_s":0.215848,"redis_calls":7,"redis_duration_s":0.012866,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012011,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000855,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.045198,"completed_at":"2026-08-11T11:38:03.732Z","load_balancing_strategy":"primary","db_duration_s":0.007651,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 200.344222] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.735Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"866924ce1e8df5358bc772fb","created_at":"2026-08-11T11:38:03.481Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"45cfa9cd24c8016849b6fa5974bd143c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-11T11:38:03.484Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-866924ce1e8df5358bc772fb: start","job_status":"start","queue_duration_s":0.250992,"scheduling_latency_s":0.251022}1478gitlab # [ 200.345471] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.772Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"866924ce1e8df5358bc772fb","created_at":"2026-08-11T11:38:03.481Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"45cfa9cd24c8016849b6fa5974bd143c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-11T11:38:03.484Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-866924ce1e8df5358bc772fb: done: 0.037551 sec","job_status":"done","queue_duration_s":0.250992,"scheduling_latency_s":0.251022,"redis_calls":7,"redis_duration_s":0.007623,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006657,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037551,"completed_at":"2026-08-11T11:38:03.772Z","load_balancing_strategy":"primary","db_duration_s":0.002522,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 200.433151] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.777Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"0b52baa2818ebc3a55f437e4","created_at":"2026-08-11T11:38:03.499Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a7cf36f8f848f62ec28da635d71690a6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.505Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-0b52baa2818ebc3a55f437e4: start","job_status":"start","queue_duration_s":0.272185,"scheduling_latency_s":0.272216}1480gitlab # [ 200.434554] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.845Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"0b52baa2818ebc3a55f437e4","created_at":"2026-08-11T11:38:03.499Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a7cf36f8f848f62ec28da635d71690a6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.505Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-0b52baa2818ebc3a55f437e4: done: 0.068402 sec","job_status":"done","queue_duration_s":0.272185,"scheduling_latency_s":0.272216,"redis_calls":14,"redis_duration_s":0.024187,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.002044,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.020426,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001717,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.068402,"completed_at":"2026-08-11T11:38:03.845Z","load_balancing_strategy":"primary","db_duration_s":0.003935,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 200.506569] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.849Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"cb5542acbafe016b4aa981b6","created_at":"2026-08-11T11:38:03.514Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5028b15231c8c56727d58fbb6c777b8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.517Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-cb5542acbafe016b4aa981b6: start","job_status":"start","queue_duration_s":0.331965,"scheduling_latency_s":0.331993}1482gitlab # [ 200.508273] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.858Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1483gitlab # [ 200.510166] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.863Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"cb5542acbafe016b4aa981b6","created_at":"2026-08-11T11:38:03.514Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5028b15231c8c56727d58fbb6c777b8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.517Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-cb5542acbafe016b4aa981b6: done: 0.01368 sec","job_status":"done","queue_duration_s":0.331965,"scheduling_latency_s":0.331993,"redis_calls":7,"redis_duration_s":0.001798,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001205,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000593,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01368,"completed_at":"2026-08-11T11:38:03.863Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 200.583746] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.864Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f87aa441d6b988d25abaad5b","created_at":"2026-08-11T11:38:03.549Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5fec2a5d845e03d9bc8b1e96bb16a494","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T11:38:03.557Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f87aa441d6b988d25abaad5b: start","job_status":"start","queue_duration_s":0.306963,"scheduling_latency_s":0.306985}1485gitlab # [ 200.585285] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.872Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1486gitlab # [ 200.587130] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.877Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f87aa441d6b988d25abaad5b","created_at":"2026-08-11T11:38:03.549Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5fec2a5d845e03d9bc8b1e96bb16a494","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T11:38:03.557Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f87aa441d6b988d25abaad5b: done: 0.012325 sec","job_status":"done","queue_duration_s":0.306963,"scheduling_latency_s":0.306985,"redis_calls":7,"redis_duration_s":0.0017139999999999998,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001225,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000489,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012325,"completed_at":"2026-08-11T11:38:03.877Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 200.709444] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.878Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"928a78404fc3ba66219b90cf","created_at":"2026-08-11T11:38:03.571Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.573Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-928a78404fc3ba66219b90cf: start","job_status":"start","queue_duration_s":0.304801,"scheduling_latency_s":0.304822}1488gitlab # [ 200.711053] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.982Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"928a78404fc3ba66219b90cf","created_at":"2026-08-11T11:38:03.571Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.573Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-928a78404fc3ba66219b90cf: done: 0.103984 sec","job_status":"done","queue_duration_s":0.304801,"scheduling_latency_s":0.304822,"redis_calls":60,"redis_duration_s":0.015210000000000001,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000819,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.013655,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000736,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.08887,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.103984,"completed_at":"2026-08-11T11:38:03.982Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 200.786828] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.984Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"37f01a9b09e64b7c32680f3e","created_at":"2026-08-11T11:38:03.594Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1f7a73bc70d600de39701294cbb9ae48","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-11T11:38:03.597Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-37f01a9b09e64b7c32680f3e: start","job_status":"start","queue_duration_s":0.386685,"scheduling_latency_s":0.386715}1490gitlab # [ 200.788104] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.992Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1491gitlab # [ 200.789057] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.997Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"37f01a9b09e64b7c32680f3e","created_at":"2026-08-11T11:38:03.594Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1f7a73bc70d600de39701294cbb9ae48","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-11T11:38:03.597Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-37f01a9b09e64b7c32680f3e: done: 0.012953 sec","job_status":"done","queue_duration_s":0.386685,"scheduling_latency_s":0.386715,"redis_calls":7,"redis_duration_s":0.001805,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001253,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000552,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012953,"completed_at":"2026-08-11T11:38:03.997Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 200.859629] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:03.999Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"68a0d12554f91d5ea2746515","created_at":"2026-08-11T11:38:03.620Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e02203ebfd9533b1216f84b0d3a258b1","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.625Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-68a0d12554f91d5ea2746515: start","job_status":"start","queue_duration_s":0.373245,"scheduling_latency_s":0.373655}1493gitlab # [ 200.861073] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.417Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"68a0d12554f91d5ea2746515","created_at":"2026-08-11T11:38:03.620Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e02203ebfd9533b1216f84b0d3a258b1","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.625Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-68a0d12554f91d5ea2746515: done: 0.419099 sec","job_status":"done","queue_duration_s":0.373245,"scheduling_latency_s":0.373655,"redis_calls":562,"redis_duration_s":0.129946,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001246,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.1287,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.336899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.419099,"completed_at":"2026-08-11T11:38:04.417Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 200.928515] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.419Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"62054db9efeadc6c9c0bf0e2","created_at":"2026-08-11T11:38:03.642Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2df44cd76ed7b5f9ea6c3b6ea735a792","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.662Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-62054db9efeadc6c9c0bf0e2: start","job_status":"start","queue_duration_s":0.757263,"scheduling_latency_s":0.757294}1495gitlab # [ 200.929921] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.450Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"62054db9efeadc6c9c0bf0e2","created_at":"2026-08-11T11:38:03.642Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2df44cd76ed7b5f9ea6c3b6ea735a792","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.662Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-62054db9efeadc6c9c0bf0e2: done: 0.030514 sec","job_status":"done","queue_duration_s":0.757263,"scheduling_latency_s":0.757294,"redis_calls":11,"redis_duration_s":0.004744,"redis_read_bytes":137,"redis_write_bytes":1274,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001401,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":390,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002502,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000841,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000559289,"duration_s":0.030514,"completed_at":"2026-08-11T11:38:04.450Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005156,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 200.997617] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.452Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c36f6d96f08b244d4b57661b","created_at":"2026-08-11T11:38:03.675Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3cfb76b6fec2738935aabcf7f5b8b222","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.681Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c36f6d96f08b244d4b57661b: start","job_status":"start","queue_duration_s":0.770472,"scheduling_latency_s":0.770494}1497gitlab # [ 201.066256] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.471Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c36f6d96f08b244d4b57661b","created_at":"2026-08-11T11:38:03.675Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3cfb76b6fec2738935aabcf7f5b8b222","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.681Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c36f6d96f08b244d4b57661b: done: 0.01894 sec","job_status":"done","queue_duration_s":0.770472,"scheduling_latency_s":0.770494,"redis_calls":9,"redis_duration_s":0.004762000000000001,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002743,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002019,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000746743,"exclusive_lock_hold_duration_s":0.002924674,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.01894,"completed_at":"2026-08-11T11:38:04.471Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001588,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 201.137293] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.473Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"66b9907f21d060e8baa5f797","created_at":"2026-08-11T11:38:03.692Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2774d55c4cbbd05df7f7496b85a4513f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.694Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-66b9907f21d060e8baa5f797: start","job_status":"start","queue_duration_s":0.779251,"scheduling_latency_s":0.779273}1499gitlab # [ 201.138143] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.512Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"66b9907f21d060e8baa5f797","created_at":"2026-08-11T11:38:03.692Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2774d55c4cbbd05df7f7496b85a4513f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.694Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-66b9907f21d060e8baa5f797: done: 0.03893 sec","job_status":"done","queue_duration_s":0.779251,"scheduling_latency_s":0.779273,"redis_calls":9,"redis_duration_s":0.004726,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002686,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00204,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000710426,"exclusive_lock_hold_duration_s":0.022703444,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.03893,"completed_at":"2026-08-11T11:38:04.512Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013061,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 201.211430] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.515Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"2a7443cfb8a51dc99e4c91db","created_at":"2026-08-11T11:38:03.713Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dfcd61b1ded7e9df4d3cdb708d974522","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.719Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-2a7443cfb8a51dc99e4c91db: start","job_status":"start","queue_duration_s":0.795157,"scheduling_latency_s":0.795182}1501gitlab # [ 201.212806] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.542Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"2a7443cfb8a51dc99e4c91db","created_at":"2026-08-11T11:38:03.713Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dfcd61b1ded7e9df4d3cdb708d974522","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.719Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-2a7443cfb8a51dc99e4c91db: done: 0.027233 sec","job_status":"done","queue_duration_s":0.795157,"scheduling_latency_s":0.795182,"redis_calls":12,"redis_duration_s":0.005527,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000993,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002512,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002022,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000728305,"exclusive_lock_hold_duration_s":0.005958857,"duration_s":0.027233,"completed_at":"2026-08-11T11:38:04.542Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003975,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 201.285269] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.544Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"469996449831ba72f2ecbfbd","created_at":"2026-08-11T11:38:03.727Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b5ac8ba297ba9b3b92606de42491d66","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.730Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-469996449831ba72f2ecbfbd: start","job_status":"start","queue_duration_s":0.813334,"scheduling_latency_s":0.813355}1503gitlab # [ 201.286415] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.559Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"469996449831ba72f2ecbfbd","created_at":"2026-08-11T11:38:03.727Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b5ac8ba297ba9b3b92606de42491d66","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.730Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-469996449831ba72f2ecbfbd: done: 0.015588 sec","job_status":"done","queue_duration_s":0.813334,"scheduling_latency_s":0.813355,"redis_calls":7,"redis_duration_s":0.0030749999999999996,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002175,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0009,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015588,"completed_at":"2026-08-11T11:38:04.559Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000833,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 201.354998] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.562Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"9a2a2c996594200a3662e7ed","created_at":"2026-08-11T11:38:03.737Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d7f3741db86e163c0d456535fc44b3b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.739Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-9a2a2c996594200a3662e7ed: start","job_status":"start","queue_duration_s":0.822998,"scheduling_latency_s":0.82302}1505gitlab # [ 201.356446] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.598Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"9a2a2c996594200a3662e7ed","created_at":"2026-08-11T11:38:03.737Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d7f3741db86e163c0d456535fc44b3b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.739Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-9a2a2c996594200a3662e7ed: done: 0.036438 sec","job_status":"done","queue_duration_s":0.822998,"scheduling_latency_s":0.82302,"redis_calls":9,"redis_duration_s":0.003476,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00185,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001626,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000805968,"exclusive_lock_hold_duration_s":0.015302783,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.036438,"completed_at":"2026-08-11T11:38:04.598Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014902,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 201.424514] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.600Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"55074cb83f26c6dd4bcb3c02","created_at":"2026-08-11T11:38:03.753Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a046c01b1fdd954b6d6c646a6050a2ae","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.761Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-55074cb83f26c6dd4bcb3c02: start","job_status":"start","queue_duration_s":0.838767,"scheduling_latency_s":0.838789}1507gitlab # [ 201.443871] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.618Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"55074cb83f26c6dd4bcb3c02","created_at":"2026-08-11T11:38:03.753Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a046c01b1fdd954b6d6c646a6050a2ae","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.761Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-55074cb83f26c6dd4bcb3c02: done: 0.018425 sec","job_status":"done","queue_duration_s":0.838767,"scheduling_latency_s":0.838789,"redis_calls":7,"redis_duration_s":0.001624,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001184,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00044,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018425,"completed_at":"2026-08-11T11:38:04.618Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00414,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 201.516080] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.620Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"48617286d381b823debe2247","created_at":"2026-08-11T11:38:03.773Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"212fbf8cd4d1de3e50b23b72b3455b82","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.776Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-48617286d381b823debe2247: start","job_status":"start","queue_duration_s":0.84416,"scheduling_latency_s":0.844182}1509gitlab # [ 201.584678] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.635Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"48617286d381b823debe2247","created_at":"2026-08-11T11:38:03.773Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"212fbf8cd4d1de3e50b23b72b3455b82","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.776Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-48617286d381b823debe2247: done: 0.014998 sec","job_status":"done","queue_duration_s":0.84416,"scheduling_latency_s":0.844182,"redis_calls":8,"redis_duration_s":0.003272,"redis_read_bytes":133,"redis_write_bytes":901,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000296,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002072,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000904,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014998,"completed_at":"2026-08-11T11:38:04.635Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 201.652349] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.637Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"7fbe21395f19115a89e9d39b","created_at":"2026-08-11T11:38:03.793Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fabb591a1d7f416197e65fc8ea571b3b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.802Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-7fbe21395f19115a89e9d39b: start","job_status":"start","queue_duration_s":0.835054,"scheduling_latency_s":0.835076}1511gitlab # [ 201.653952] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.658Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"7fbe21395f19115a89e9d39b","created_at":"2026-08-11T11:38:03.793Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fabb591a1d7f416197e65fc8ea571b3b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.802Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-7fbe21395f19115a89e9d39b: done: 0.021385 sec","job_status":"done","queue_duration_s":0.835054,"scheduling_latency_s":0.835076,"redis_calls":10,"redis_duration_s":0.004512,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002612,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0019,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011682,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.004451683,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.021385,"completed_at":"2026-08-11T11:38:04.658Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00265,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1512gitlab # [ 201.722322] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.660Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"f46648298dd2ac586a8c3aa3","created_at":"2026-08-11T11:38:03.816Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"257a8782dc73023c68048c8307064966","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.820Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-f46648298dd2ac586a8c3aa3: start","job_status":"start","queue_duration_s":0.840268,"scheduling_latency_s":0.840289}1513gitlab # [ 201.723081] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.849Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"f46648298dd2ac586a8c3aa3","created_at":"2026-08-11T11:38:03.816Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"257a8782dc73023c68048c8307064966","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.820Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-f46648298dd2ac586a8c3aa3: done: 0.188806 sec","job_status":"done","queue_duration_s":0.840268,"scheduling_latency_s":0.840289,"redis_calls":11,"redis_duration_s":0.00498,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000901,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002116,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001963,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.044,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.12324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000731658,"exclusive_lock_hold_duration_s":0.168571983,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.188806,"completed_at":"2026-08-11T11:38:04.849Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.072275,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 201.796593] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.851Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"e7f462ec24631d5749401d50","created_at":"2026-08-11T11:38:03.824Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25a5a80099a96f12dd22af740b9c34b7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.828Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-e7f462ec24631d5749401d50: start","job_status":"start","queue_duration_s":1.023559,"scheduling_latency_s":1.023583}1515gitlab # [ 201.798141] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.866Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"e7f462ec24631d5749401d50","created_at":"2026-08-11T11:38:03.824Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25a5a80099a96f12dd22af740b9c34b7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.828Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-e7f462ec24631d5749401d50: done: 0.015139 sec","job_status":"done","queue_duration_s":1.023559,"scheduling_latency_s":1.023583,"redis_calls":7,"redis_duration_s":0.003151,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002282,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000869,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015139,"completed_at":"2026-08-11T11:38:04.866Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 201.879339] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.869Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b876407b21325e4368cd4701","created_at":"2026-08-11T11:38:03.804Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-18c7643ff14c4f1e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a7cf36f8f848f62ec28da635d71690a6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.832Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b876407b21325e4368cd4701: start","job_status":"start","queue_duration_s":1.036302,"scheduling_latency_s":1.036324}1517gitlab # [ 201.880746] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.881Z","message":"No existing merge request to be cleaned up."}1518gitlab # [ 201.881945] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.888Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b876407b21325e4368cd4701","created_at":"2026-08-11T11:38:03.804Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-18c7643ff14c4f1e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a7cf36f8f848f62ec28da635d71690a6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.832Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b876407b21325e4368cd4701: done: 0.01996 sec","job_status":"done","queue_duration_s":1.036302,"scheduling_latency_s":1.036324,"redis_calls":10,"redis_duration_s":0.004724,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002065,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002659,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011524,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01996,"completed_at":"2026-08-11T11:38:04.888Z","load_balancing_strategy":"primary","db_duration_s":0.00175,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 201.954142] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.891Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"58687fdf5adfc59d83cbb8e6","created_at":"2026-08-11T11:38:03.804Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-18c7643ff14c4f1e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a7cf36f8f848f62ec28da635d71690a6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.832Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-58687fdf5adfc59d83cbb8e6: start","job_status":"start","queue_duration_s":1.058288,"scheduling_latency_s":1.05831}1520gitlab # [ 201.954813] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.902Z","message":"No existing merge request to be cleaned up."}1521gitlab # [ 201.957160] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.909Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"58687fdf5adfc59d83cbb8e6","created_at":"2026-08-11T11:38:03.804Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-18c7643ff14c4f1e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a7cf36f8f848f62ec28da635d71690a6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.832Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-58687fdf5adfc59d83cbb8e6: done: 0.018626 sec","job_status":"done","queue_duration_s":1.058288,"scheduling_latency_s":1.05831,"redis_calls":10,"redis_duration_s":0.004376,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001633,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002743,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010672,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018626,"completed_at":"2026-08-11T11:38:04.909Z","load_balancing_strategy":"primary","db_duration_s":0.00154,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 202.032972] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.911Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bef17d8d358fc2c860adabcb","created_at":"2026-08-11T11:38:03.804Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-18c7643ff14c4f1e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a7cf36f8f848f62ec28da635d71690a6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.832Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bef17d8d358fc2c860adabcb: start","job_status":"start","queue_duration_s":1.078993,"scheduling_latency_s":1.079015}1523gitlab # [ 202.100228] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.922Z","message":"No existing merge request to be cleaned up."}1524gitlab # [ 202.101830] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.930Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bef17d8d358fc2c860adabcb","created_at":"2026-08-11T11:38:03.804Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-18c7643ff14c4f1e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a7cf36f8f848f62ec28da635d71690a6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.832Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bef17d8d358fc2c860adabcb: done: 0.018689 sec","job_status":"done","queue_duration_s":1.078993,"scheduling_latency_s":1.079015,"redis_calls":10,"redis_duration_s":0.004342,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001738,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002604,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018689,"completed_at":"2026-08-11T11:38:04.930Z","load_balancing_strategy":"primary","db_duration_s":0.001583,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 202.103167] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.932Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0305d7aaddcfd04a8b725091","created_at":"2026-08-11T11:38:03.804Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-18c7643ff14c4f1e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a7cf36f8f848f62ec28da635d71690a6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.832Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0305d7aaddcfd04a8b725091: start","job_status":"start","queue_duration_s":1.099703,"scheduling_latency_s":1.099725}1526gitlab # [ 202.115811] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.943Z","message":"No existing merge request to be cleaned up."}1527gitlab # [ 202.118894] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.950Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0305d7aaddcfd04a8b725091","created_at":"2026-08-11T11:38:03.804Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-18c7643ff14c4f1e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a7cf36f8f848f62ec28da635d71690a6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.832Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0305d7aaddcfd04a8b725091: done: 0.018605 sec","job_status":"done","queue_duration_s":1.099703,"scheduling_latency_s":1.099725,"redis_calls":10,"redis_duration_s":0.004461,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001756,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002705,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018605,"completed_at":"2026-08-11T11:38:04.950Z","load_balancing_strategy":"primary","db_duration_s":0.001598,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528gitlab # [ 202.193062] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.953Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"73958f8600d8ab160884bf56","created_at":"2026-08-11T11:38:03.831Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d31914b62d5deb2e620b0ca348fbd47f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.837Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-73958f8600d8ab160884bf56: start","job_status":"start","queue_duration_s":1.115035,"scheduling_latency_s":1.115058}1529gitlab # [ 202.260224] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.961Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1530gitlab # [ 202.261850] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.966Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"73958f8600d8ab160884bf56","created_at":"2026-08-11T11:38:03.831Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-0916158c752542d9","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d31914b62d5deb2e620b0ca348fbd47f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.837Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-73958f8600d8ab160884bf56: done: 0.013477 sec","job_status":"done","queue_duration_s":1.115035,"scheduling_latency_s":1.115058,"redis_calls":7,"redis_duration_s":0.002945,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00206,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013477,"completed_at":"2026-08-11T11:38:04.966Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 202.267406] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b8d31c3c2192d4d8ada81b3","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b8d31c3c2192d4d8ada81b3: start","job_status":"start","queue_duration_s":0.993002,"scheduling_latency_s":0.993024}1532gitlab # [ 202.337284] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b8d31c3c2192d4d8ada81b3","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b8d31c3c2192d4d8ada81b3: done: 0.018652 sec","job_status":"done","queue_duration_s":0.993002,"scheduling_latency_s":0.993024,"redis_calls":13,"redis_duration_s":0.005592,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001728,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003864,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018652,"completed_at":"2026-08-11T11:38:04.987Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 202.404981] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:04.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5844355406c98d64cf996e46","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5844355406c98d64cf996e46: start","job_status":"start","queue_duration_s":1.013653,"scheduling_latency_s":1.013675}1534gitlab # [ 202.406408] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5844355406c98d64cf996e46","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5844355406c98d64cf996e46: done: 0.028202 sec","job_status":"done","queue_duration_s":1.013653,"scheduling_latency_s":1.013675,"redis_calls":13,"redis_duration_s":0.005779,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001587,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004192,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019403,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028202,"completed_at":"2026-08-11T11:38:05.017Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 202.477344] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.020Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0ae6415188e4d09aa3e0f34","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0ae6415188e4d09aa3e0f34: start","job_status":"start","queue_duration_s":1.044529,"scheduling_latency_s":1.044577}1536gitlab # [ 202.478178] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0ae6415188e4d09aa3e0f34","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0ae6415188e4d09aa3e0f34: done: 0.022515 sec","job_status":"done","queue_duration_s":1.044529,"scheduling_latency_s":1.044577,"redis_calls":13,"redis_duration_s":0.003134,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002075,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022515,"completed_at":"2026-08-11T11:38:05.042Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 202.554153] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.043Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4b22ebece08d43b5ba559c1","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4b22ebece08d43b5ba559c1: start","job_status":"start","queue_duration_s":1.068343,"scheduling_latency_s":1.068366}1538gitlab # [ 202.555485] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4b22ebece08d43b5ba559c1","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4b22ebece08d43b5ba559c1: done: 0.015322 sec","job_status":"done","queue_duration_s":1.068343,"scheduling_latency_s":1.068366,"redis_calls":13,"redis_duration_s":0.00289,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015322,"completed_at":"2026-08-11T11:38:05.059Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 202.641135] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.060Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc7476e0d413980b77de03bc","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc7476e0d413980b77de03bc: start","job_status":"start","queue_duration_s":1.085199,"scheduling_latency_s":1.085228}1540gitlab # [ 202.642447] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc7476e0d413980b77de03bc","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc7476e0d413980b77de03bc: done: 0.015324 sec","job_status":"done","queue_duration_s":1.085199,"scheduling_latency_s":1.085228,"redis_calls":13,"redis_duration_s":0.003156,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00109,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015324,"completed_at":"2026-08-11T11:38:05.076Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 202.713940] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67a8ab4e9cf8aa0cea0a340f","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67a8ab4e9cf8aa0cea0a340f: start","job_status":"start","queue_duration_s":1.101841,"scheduling_latency_s":1.101861}1542gitlab # [ 202.715257] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67a8ab4e9cf8aa0cea0a340f","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67a8ab4e9cf8aa0cea0a340f: done: 0.015743 sec","job_status":"done","queue_duration_s":1.101841,"scheduling_latency_s":1.101861,"redis_calls":13,"redis_duration_s":0.003171,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000861,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00231,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015743,"completed_at":"2026-08-11T11:38:05.093Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 202.784344] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.094Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b21882a18424406f947381ea","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b21882a18424406f947381ea: start","job_status":"start","queue_duration_s":1.11898,"scheduling_latency_s":1.119001}1544gitlab # [ 202.785932] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b21882a18424406f947381ea","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b21882a18424406f947381ea: done: 0.015441 sec","job_status":"done","queue_duration_s":1.11898,"scheduling_latency_s":1.119001,"redis_calls":13,"redis_duration_s":0.002827,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015441,"completed_at":"2026-08-11T11:38:05.109Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 202.859205] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"240bcf5ed200e7b9f5deab9a","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-240bcf5ed200e7b9f5deab9a: start","job_status":"start","queue_duration_s":1.135761,"scheduling_latency_s":1.135782}1546gitlab # [ 202.860488] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"240bcf5ed200e7b9f5deab9a","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-240bcf5ed200e7b9f5deab9a: done: 0.015418 sec","job_status":"done","queue_duration_s":1.135761,"scheduling_latency_s":1.135782,"redis_calls":13,"redis_duration_s":0.002814,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00196,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015418,"completed_at":"2026-08-11T11:38:05.126Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 202.931474] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"332181d60198fb6799c2f765","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-332181d60198fb6799c2f765: start","job_status":"start","queue_duration_s":1.152918,"scheduling_latency_s":1.152941}1548gitlab # [ 202.932922] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"332181d60198fb6799c2f765","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-332181d60198fb6799c2f765: done: 0.018282 sec","job_status":"done","queue_duration_s":1.152918,"scheduling_latency_s":1.152941,"redis_calls":13,"redis_duration_s":0.0031349999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001086,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002049,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018282,"completed_at":"2026-08-11T11:38:05.146Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 203.004119] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55a94c862d7b8c47c5c53e8e","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55a94c862d7b8c47c5c53e8e: start","job_status":"start","queue_duration_s":1.173337,"scheduling_latency_s":1.17337}1550gitlab # [ 203.004890] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.167Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55a94c862d7b8c47c5c53e8e","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55a94c862d7b8c47c5c53e8e: done: 0.019085 sec","job_status":"done","queue_duration_s":1.173337,"scheduling_latency_s":1.17337,"redis_calls":13,"redis_duration_s":0.00315,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001032,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019085,"completed_at":"2026-08-11T11:38:05.167Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 203.074933] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.169Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99c7ea537d34b988eb0ef191","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99c7ea537d34b988eb0ef191: start","job_status":"start","queue_duration_s":1.193757,"scheduling_latency_s":1.193779}1552gitlab # [ 203.078302] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99c7ea537d34b988eb0ef191","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99c7ea537d34b988eb0ef191: done: 0.015739 sec","job_status":"done","queue_duration_s":1.193757,"scheduling_latency_s":1.193779,"redis_calls":13,"redis_duration_s":0.002975,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010524,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015739,"completed_at":"2026-08-11T11:38:05.185Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 203.146944] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"84db2352723a92ff2be1986b","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-84db2352723a92ff2be1986b: start","job_status":"start","queue_duration_s":1.211148,"scheduling_latency_s":1.211171}1554gitlab # [ 203.217310] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"84db2352723a92ff2be1986b","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-84db2352723a92ff2be1986b: done: 0.015447 sec","job_status":"done","queue_duration_s":1.211148,"scheduling_latency_s":1.211171,"redis_calls":13,"redis_duration_s":0.003012,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015447,"completed_at":"2026-08-11T11:38:05.202Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 203.218695] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01f77f73d5c916d5157783b2","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01f77f73d5c916d5157783b2: start","job_status":"start","queue_duration_s":1.227971,"scheduling_latency_s":1.227994}1556gitlab # [ 203.294422] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.218Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01f77f73d5c916d5157783b2","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01f77f73d5c916d5157783b2: done: 0.015403 sec","job_status":"done","queue_duration_s":1.227971,"scheduling_latency_s":1.227994,"redis_calls":13,"redis_duration_s":0.003206,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000869,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002337,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015403,"completed_at":"2026-08-11T11:38:05.218Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 203.297261] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d08a41f5bd18f9b2fe0dadf","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d08a41f5bd18f9b2fe0dadf: start","job_status":"start","queue_duration_s":1.244712,"scheduling_latency_s":1.244733}1558gitlab # [ 203.374347] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.236Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d08a41f5bd18f9b2fe0dadf","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d08a41f5bd18f9b2fe0dadf: done: 0.016676 sec","job_status":"done","queue_duration_s":1.244712,"scheduling_latency_s":1.244733,"redis_calls":13,"redis_duration_s":0.003943,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001141,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002802,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010391,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016676,"completed_at":"2026-08-11T11:38:05.236Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 203.376376] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66a459fcfe25ca3fbe6a2919","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66a459fcfe25ca3fbe6a2919: start","job_status":"start","queue_duration_s":1.262754,"scheduling_latency_s":1.262777}1560gitlab # [ 203.444406] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.254Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66a459fcfe25ca3fbe6a2919","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66a459fcfe25ca3fbe6a2919: done: 0.015795 sec","job_status":"done","queue_duration_s":1.262754,"scheduling_latency_s":1.262777,"redis_calls":13,"redis_duration_s":0.003016,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000888,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015795,"completed_at":"2026-08-11T11:38:05.254Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561gitlab # [ 203.455674] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.255Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90a66b49ea2ad62992dc4218","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90a66b49ea2ad62992dc4218: start","job_status":"start","queue_duration_s":1.280299,"scheduling_latency_s":1.280319}1562gitlab # [ 203.524124] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90a66b49ea2ad62992dc4218","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90a66b49ea2ad62992dc4218: done: 0.015338 sec","job_status":"done","queue_duration_s":1.280299,"scheduling_latency_s":1.280319,"redis_calls":13,"redis_duration_s":0.002859,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015338,"completed_at":"2026-08-11T11:38:05.271Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 203.535305] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12657b9a3a356058fb25a7de","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12657b9a3a356058fb25a7de: start","job_status":"start","queue_duration_s":1.296987,"scheduling_latency_s":1.297008}1564gitlab # [ 203.607927] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12657b9a3a356058fb25a7de","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12657b9a3a356058fb25a7de: done: 0.015669 sec","job_status":"done","queue_duration_s":1.296987,"scheduling_latency_s":1.297008,"redis_calls":13,"redis_duration_s":0.0030350000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002151,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015669,"completed_at":"2026-08-11T11:38:05.288Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 203.677350] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9d58da118a372472522d323","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9d58da118a372472522d323: start","job_status":"start","queue_duration_s":1.314322,"scheduling_latency_s":1.314344}1566gitlab # [ 203.678891] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9d58da118a372472522d323","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9d58da118a372472522d323: done: 0.015556 sec","job_status":"done","queue_duration_s":1.314322,"scheduling_latency_s":1.314344,"redis_calls":13,"redis_duration_s":0.002859,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000908,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015556,"completed_at":"2026-08-11T11:38:05.305Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567gitlab # [ 203.694915] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0bef53fde6ad6aa2117f530","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0bef53fde6ad6aa2117f530: start","job_status":"start","queue_duration_s":1.331225,"scheduling_latency_s":1.331247}1568gitlab # [ 203.767460] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0bef53fde6ad6aa2117f530","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0bef53fde6ad6aa2117f530: done: 0.015554 sec","job_status":"done","queue_duration_s":1.331225,"scheduling_latency_s":1.331247,"redis_calls":13,"redis_duration_s":0.002849,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000881,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015554,"completed_at":"2026-08-11T11:38:05.322Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569gitlab # [ 203.836164] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5899e2c3cb0daa66392f5ab","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5899e2c3cb0daa66392f5ab: start","job_status":"start","queue_duration_s":1.348136,"scheduling_latency_s":1.348158}1570gitlab # [ 203.837492] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5899e2c3cb0daa66392f5ab","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5899e2c3cb0daa66392f5ab: done: 0.015273 sec","job_status":"done","queue_duration_s":1.348136,"scheduling_latency_s":1.348158,"redis_calls":13,"redis_duration_s":0.003013,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015273,"completed_at":"2026-08-11T11:38:05.338Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571gitlab # [ 203.906875] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c5a2ee463cd6cb221cbcd73","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c5a2ee463cd6cb221cbcd73: start","job_status":"start","queue_duration_s":1.364734,"scheduling_latency_s":1.364755}1572gitlab # [ 203.908222] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c5a2ee463cd6cb221cbcd73","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c5a2ee463cd6cb221cbcd73: done: 0.015324 sec","job_status":"done","queue_duration_s":1.364734,"scheduling_latency_s":1.364755,"redis_calls":13,"redis_duration_s":0.002875,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010384,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015324,"completed_at":"2026-08-11T11:38:05.355Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573gitlab # [ 203.980374] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7841bcc785ec4b4027dac345","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7841bcc785ec4b4027dac345: start","job_status":"start","queue_duration_s":1.381373,"scheduling_latency_s":1.381394}1574gitlab # [ 203.981489] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7841bcc785ec4b4027dac345","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7841bcc785ec4b4027dac345: done: 0.01505 sec","job_status":"done","queue_duration_s":1.381373,"scheduling_latency_s":1.381394,"redis_calls":13,"redis_duration_s":0.002772,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01505,"completed_at":"2026-08-11T11:38:05.371Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575gitlab # [ 204.060379] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.373Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eedda7f826a121d1e7061651","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eedda7f826a121d1e7061651: start","job_status":"start","queue_duration_s":1.397748,"scheduling_latency_s":1.39777}1576gitlab # [ 204.061937] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eedda7f826a121d1e7061651","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eedda7f826a121d1e7061651: done: 0.015009 sec","job_status":"done","queue_duration_s":1.397748,"scheduling_latency_s":1.39777,"redis_calls":13,"redis_duration_s":0.002712,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001854,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015009,"completed_at":"2026-08-11T11:38:05.388Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577gitlab # [ 204.129394] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4957071f32ffe4f13256b257","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4957071f32ffe4f13256b257: start","job_status":"start","queue_duration_s":1.414294,"scheduling_latency_s":1.414315}1578gitlab # [ 204.131112] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4957071f32ffe4f13256b257","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4957071f32ffe4f13256b257: done: 0.015175 sec","job_status":"done","queue_duration_s":1.414294,"scheduling_latency_s":1.414315,"redis_calls":13,"redis_duration_s":0.002832,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015175,"completed_at":"2026-08-11T11:38:05.405Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1579gitlab # [ 204.203090] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8966cf31bb003bb5c3bbd17e","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8966cf31bb003bb5c3bbd17e: start","job_status":"start","queue_duration_s":1.430783,"scheduling_latency_s":1.430805}1580gitlab # [ 204.204322] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.421Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8966cf31bb003bb5c3bbd17e","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8966cf31bb003bb5c3bbd17e: done: 0.01524 sec","job_status":"done","queue_duration_s":1.430783,"scheduling_latency_s":1.430805,"redis_calls":13,"redis_duration_s":0.0028079999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001924,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01524,"completed_at":"2026-08-11T11:38:05.421Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1581gitlab # [ 204.272096] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.423Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95ea1b0b57495e0c60187d3c","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95ea1b0b57495e0c60187d3c: start","job_status":"start","queue_duration_s":1.447558,"scheduling_latency_s":1.447578}1582gitlab # [ 204.273432] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95ea1b0b57495e0c60187d3c","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95ea1b0b57495e0c60187d3c: done: 0.015234 sec","job_status":"done","queue_duration_s":1.447558,"scheduling_latency_s":1.447578,"redis_calls":13,"redis_duration_s":0.002879,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015234,"completed_at":"2026-08-11T11:38:05.438Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583gitlab # [ 204.348121] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2985e3a1c8f8a0bbdcd0dc5","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2985e3a1c8f8a0bbdcd0dc5: start","job_status":"start","queue_duration_s":1.464159,"scheduling_latency_s":1.46418}1584gitlab # [ 204.349485] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2985e3a1c8f8a0bbdcd0dc5","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2985e3a1c8f8a0bbdcd0dc5: done: 0.015213 sec","job_status":"done","queue_duration_s":1.464159,"scheduling_latency_s":1.46418,"redis_calls":13,"redis_duration_s":0.002898,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010256,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015213,"completed_at":"2026-08-11T11:38:05.454Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585gitlab # [ 204.418916] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.456Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70201310f0938e365e6bf7fa","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70201310f0938e365e6bf7fa: start","job_status":"start","queue_duration_s":1.480692,"scheduling_latency_s":1.480714}1586gitlab # [ 204.489393] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70201310f0938e365e6bf7fa","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70201310f0938e365e6bf7fa: done: 0.015203 sec","job_status":"done","queue_duration_s":1.480692,"scheduling_latency_s":1.480714,"redis_calls":13,"redis_duration_s":0.002822,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000881,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015203,"completed_at":"2026-08-11T11:38:05.471Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587gitlab # [ 204.491121] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"728787a95c8425a5c61a57ec","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-728787a95c8425a5c61a57ec: start","job_status":"start","queue_duration_s":1.497693,"scheduling_latency_s":1.497715}1588gitlab # [ 204.507167] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"728787a95c8425a5c61a57ec","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-728787a95c8425a5c61a57ec: done: 0.015366 sec","job_status":"done","queue_duration_s":1.497693,"scheduling_latency_s":1.497715,"redis_calls":13,"redis_duration_s":0.002805,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010392,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015366,"completed_at":"2026-08-11T11:38:05.488Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589gitlab # [ 204.601164] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.490Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4196cbb63f6175534efae52b","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4196cbb63f6175534efae52b: start","job_status":"start","queue_duration_s":1.514615,"scheduling_latency_s":1.514637}1590gitlab # [ 204.602448] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4196cbb63f6175534efae52b","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4196cbb63f6175534efae52b: done: 0.015428 sec","job_status":"done","queue_duration_s":1.514615,"scheduling_latency_s":1.514637,"redis_calls":13,"redis_duration_s":0.003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015428,"completed_at":"2026-08-11T11:38:05.505Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591gitlab # [ 204.693774] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.506Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7bba5c4b76ccf6e6f16ef117","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7bba5c4b76ccf6e6f16ef117: start","job_status":"start","queue_duration_s":1.531363,"scheduling_latency_s":1.531384}1592gitlab # [ 204.695125] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.522Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7bba5c4b76ccf6e6f16ef117","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7bba5c4b76ccf6e6f16ef117: done: 0.015282 sec","job_status":"done","queue_duration_s":1.531363,"scheduling_latency_s":1.531384,"redis_calls":13,"redis_duration_s":0.002826,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000885,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010342,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015282,"completed_at":"2026-08-11T11:38:05.522Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593gitlab # [ 204.774362] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.523Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f1beae315770b26c8f419ce","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f1beae315770b26c8f419ce: start","job_status":"start","queue_duration_s":1.548207,"scheduling_latency_s":1.548238}1594gitlab # [ 204.775944] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.539Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f1beae315770b26c8f419ce","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f1beae315770b26c8f419ce: done: 0.015396 sec","job_status":"done","queue_duration_s":1.548207,"scheduling_latency_s":1.548238,"redis_calls":13,"redis_duration_s":0.002924,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015396,"completed_at":"2026-08-11T11:38:05.539Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1595gitlab # [ 204.846940] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.540Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c87e19043ecfe5d6391b077","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c87e19043ecfe5d6391b077: start","job_status":"start","queue_duration_s":1.564934,"scheduling_latency_s":1.564956}1596gitlab # [ 204.848068] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.555Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c87e19043ecfe5d6391b077","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c87e19043ecfe5d6391b077: done: 0.015224 sec","job_status":"done","queue_duration_s":1.564934,"scheduling_latency_s":1.564956,"redis_calls":13,"redis_duration_s":0.002851,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000846,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015224,"completed_at":"2026-08-11T11:38:05.555Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1597gitlab # [ 204.926304] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.557Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c31dfad165feddcbb1ded509","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c31dfad165feddcbb1ded509: start","job_status":"start","queue_duration_s":1.581469,"scheduling_latency_s":1.581491}1598gitlab # [ 204.927864] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c31dfad165feddcbb1ded509","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c31dfad165feddcbb1ded509: done: 0.015279 sec","job_status":"done","queue_duration_s":1.581469,"scheduling_latency_s":1.581491,"redis_calls":13,"redis_duration_s":0.002735,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000885,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00185,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015279,"completed_at":"2026-08-11T11:38:05.572Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1599gitlab # [ 204.998909] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.573Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8504502e9b00375008374214","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8504502e9b00375008374214: start","job_status":"start","queue_duration_s":1.598115,"scheduling_latency_s":1.598137}1600gitlab # [ 205.000175] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.589Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8504502e9b00375008374214","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8504502e9b00375008374214: done: 0.015515 sec","job_status":"done","queue_duration_s":1.598115,"scheduling_latency_s":1.598137,"redis_calls":13,"redis_duration_s":0.0027930000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015515,"completed_at":"2026-08-11T11:38:05.589Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1601gitlab # [ 205.084807] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea86ee605637392ba34acea4","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea86ee605637392ba34acea4: start","job_status":"start","queue_duration_s":1.615236,"scheduling_latency_s":1.615257}1602gitlab # [ 205.086248] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea86ee605637392ba34acea4","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea86ee605637392ba34acea4: done: 0.015335 sec","job_status":"done","queue_duration_s":1.615236,"scheduling_latency_s":1.615257,"redis_calls":13,"redis_duration_s":0.0028399999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000877,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015335,"completed_at":"2026-08-11T11:38:05.606Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603gitlab # [ 205.154786] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75bdb2c0801f0c2f2feb7738","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75bdb2c0801f0c2f2feb7738: start","job_status":"start","queue_duration_s":1.632067,"scheduling_latency_s":1.632089}1604gitlab # [ 205.156206] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75bdb2c0801f0c2f2feb7738","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75bdb2c0801f0c2f2feb7738: done: 0.015214 sec","job_status":"done","queue_duration_s":1.632067,"scheduling_latency_s":1.632089,"redis_calls":13,"redis_duration_s":0.0028669999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000882,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015214,"completed_at":"2026-08-11T11:38:05.622Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1605gitlab # [ 205.226069] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.624Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"433d2390e74ba579828942ac","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-433d2390e74ba579828942ac: start","job_status":"start","queue_duration_s":1.648592,"scheduling_latency_s":1.648615}1606gitlab # [ 205.227395] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.639Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"433d2390e74ba579828942ac","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-433d2390e74ba579828942ac: done: 0.015223 sec","job_status":"done","queue_duration_s":1.648592,"scheduling_latency_s":1.648615,"redis_calls":13,"redis_duration_s":0.002789,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000859,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00193,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015223,"completed_at":"2026-08-11T11:38:05.639Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1607gitlab # [ 205.301183] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e9d086affc657d3ab52dac3","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e9d086affc657d3ab52dac3: start","job_status":"start","queue_duration_s":1.66539,"scheduling_latency_s":1.665411}1608gitlab # [ 205.302782] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e9d086affc657d3ab52dac3","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e9d086affc657d3ab52dac3: done: 0.015314 sec","job_status":"done","queue_duration_s":1.66539,"scheduling_latency_s":1.665411,"redis_calls":13,"redis_duration_s":0.002762,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000881,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001881,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010371,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015314,"completed_at":"2026-08-11T11:38:05.656Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1609gitlab # [ 205.379383] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ec3ebec017a45c9de3bcfeb","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ec3ebec017a45c9de3bcfeb: start","job_status":"start","queue_duration_s":1.682063,"scheduling_latency_s":1.682085}1610gitlab # [ 205.381112] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ec3ebec017a45c9de3bcfeb","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ec3ebec017a45c9de3bcfeb: done: 0.015449 sec","job_status":"done","queue_duration_s":1.682063,"scheduling_latency_s":1.682085,"redis_calls":13,"redis_duration_s":0.0029159999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000957,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015449,"completed_at":"2026-08-11T11:38:05.673Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1611gitlab # [ 205.461997] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.674Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1f518c597f607483c908415","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1f518c597f607483c908415: start","job_status":"start","queue_duration_s":1.698845,"scheduling_latency_s":1.698901}1612gitlab # [ 205.463285] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1f518c597f607483c908415","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1f518c597f607483c908415: done: 0.015384 sec","job_status":"done","queue_duration_s":1.698845,"scheduling_latency_s":1.698901,"redis_calls":13,"redis_duration_s":0.002892,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015384,"completed_at":"2026-08-11T11:38:05.689Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1613gitlab # [ 205.552227] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.691Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8cc14686cc9915e06a1a03ea","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8cc14686cc9915e06a1a03ea: start","job_status":"start","queue_duration_s":1.715797,"scheduling_latency_s":1.715818}1614gitlab # [ 205.553482] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8cc14686cc9915e06a1a03ea","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8cc14686cc9915e06a1a03ea: done: 0.01525 sec","job_status":"done","queue_duration_s":1.715797,"scheduling_latency_s":1.715818,"redis_calls":13,"redis_duration_s":0.002772,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000872,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01525,"completed_at":"2026-08-11T11:38:05.706Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1615gitlab # [ 205.626182] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d46f324785a044a24c9e446","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d46f324785a044a24c9e446: start","job_status":"start","queue_duration_s":1.732606,"scheduling_latency_s":1.732628}1616gitlab # [ 205.627472] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.726Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d46f324785a044a24c9e446","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d46f324785a044a24c9e446: done: 0.018422 sec","job_status":"done","queue_duration_s":1.732606,"scheduling_latency_s":1.732628,"redis_calls":13,"redis_duration_s":0.002827,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00191,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018422,"completed_at":"2026-08-11T11:38:05.726Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617gitlab # [ 205.705055] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.727Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64ced0cc915c65e66affa6b2","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64ced0cc915c65e66affa6b2: start","job_status":"start","queue_duration_s":1.752356,"scheduling_latency_s":1.752378}1618gitlab # [ 205.706457] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64ced0cc915c65e66affa6b2","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64ced0cc915c65e66affa6b2: done: 0.015058 sec","job_status":"done","queue_duration_s":1.752356,"scheduling_latency_s":1.752378,"redis_calls":13,"redis_duration_s":0.002804,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000886,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010144,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015058,"completed_at":"2026-08-11T11:38:05.742Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1619gitlab # [ 205.776192] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83e9ddef3c897a6e4288fa29","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83e9ddef3c897a6e4288fa29: start","job_status":"start","queue_duration_s":1.768809,"scheduling_latency_s":1.76883}1620gitlab # [ 205.778049] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.762Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83e9ddef3c897a6e4288fa29","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83e9ddef3c897a6e4288fa29: done: 0.01761 sec","job_status":"done","queue_duration_s":1.768809,"scheduling_latency_s":1.76883,"redis_calls":13,"redis_duration_s":0.0031969999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002237,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01761,"completed_at":"2026-08-11T11:38:05.761Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621gitlab # [ 205.876187] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f6a1f33a0af6bea0e860676","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f6a1f33a0af6bea0e860676: start","job_status":"start","queue_duration_s":1.788316,"scheduling_latency_s":1.788349}1622gitlab # [ 205.877815] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f6a1f33a0af6bea0e860676","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f6a1f33a0af6bea0e860676: done: 0.016862 sec","job_status":"done","queue_duration_s":1.788316,"scheduling_latency_s":1.788349,"redis_calls":13,"redis_duration_s":0.002855,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000864,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016862,"completed_at":"2026-08-11T11:38:05.780Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623gitlab # [ 205.972429] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf92dd1a7d5affeb345978a5","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf92dd1a7d5affeb345978a5: start","job_status":"start","queue_duration_s":1.806469,"scheduling_latency_s":1.806491}1624gitlab # [ 205.974092] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf92dd1a7d5affeb345978a5","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf92dd1a7d5affeb345978a5: done: 0.015605 sec","job_status":"done","queue_duration_s":1.806469,"scheduling_latency_s":1.806491,"redis_calls":13,"redis_duration_s":0.003228,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002309,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015605,"completed_at":"2026-08-11T11:38:05.797Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1625gitlab # [ 206.047629] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5a24fe11f1a25cd096c2b19","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5a24fe11f1a25cd096c2b19: start","job_status":"start","queue_duration_s":1.823414,"scheduling_latency_s":1.823436}1626gitlab # [ 206.049095] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.814Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5a24fe11f1a25cd096c2b19","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5a24fe11f1a25cd096c2b19: done: 0.01524 sec","job_status":"done","queue_duration_s":1.823414,"scheduling_latency_s":1.823436,"redis_calls":13,"redis_duration_s":0.002967,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000987,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00198,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01524,"completed_at":"2026-08-11T11:38:05.814Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1627gitlab # [ 206.129573] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae78df7877c1c16b37ef4f59","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae78df7877c1c16b37ef4f59: start","job_status":"start","queue_duration_s":1.840003,"scheduling_latency_s":1.840026}1628gitlab # [ 206.131183] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae78df7877c1c16b37ef4f59","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae78df7877c1c16b37ef4f59: done: 0.015079 sec","job_status":"done","queue_duration_s":1.840003,"scheduling_latency_s":1.840026,"redis_calls":13,"redis_duration_s":0.0028439999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015079,"completed_at":"2026-08-11T11:38:05.830Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1629gitlab # [ 206.213289] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.832Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b364a3a5c9cd6605e496644e","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b364a3a5c9cd6605e496644e: start","job_status":"start","queue_duration_s":1.856431,"scheduling_latency_s":1.856453}1630gitlab # [ 206.214933] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:05.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b364a3a5c9cd6605e496644e","created_at":"2026-08-11T11:38:03.909Z","trace_propagation_headers":{"sentry-trace":"ab9da398452f40b1a828727afbe1708c-9c57a62a53044b2e","baggage":"sentry-trace_id=ab9da398452f40b1a828727afbe1708c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"236faabe07c610bc51d563deb8b19f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:03.975Z","job_size_bytes":2,"pid":1705,"sidekiq_tid":"makd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b364a3a5c9cd6605e496644e: done: 0.015097 sec","job_status":"done","queue_duration_s":1.856431,"scheduling_latency_s":1.856453,"redis_calls":13,"redis_duration_s":0.00279,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000879,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015097,"completed_at":"2026-08-11T11:38:05.847Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1631gitlab # [ 209.758889] postgres[2577]: [2577] ERROR: relation "table_without_models" does not exist1632gitlab # [ 209.762852] postgres[2577]: [2577] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1633gitlab # [ 212.859866] runuser[2342]: pam_unix(runuser:session): session closed for user gitlab1634gitlab # [ 212.863303] setup-gitlab-start[2319]: + systemctl restart gitlab-sidekiq.service1635gitlab # [ 212.885102] systemd[1]: Stopping gitlab-sidekiq.service...1636gitlab # [ 212.892342] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:16.450Z","message":"Shutting down"}1637gitlab # [ 212.894786] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:16.450Z","message":"Scheduler exiting..."}1638gitlab # [ 212.897241] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:16.451Z","message":"Terminating quiet threads for default capsule"}1639gitlab # [ 212.900126] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:16.452Z","message":"Scheduler exiting..."}1640gitlab # [ 213.396199] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:16.953Z","message":"Pausing to allow jobs to finish..."}1641gitlab # [ 217.403229] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:20.960Z","message":"Bye!"}1642gitlab # [ 217.431947] sidekiq-cluster[1705]: {"severity":"INFO","time":"2026-08-11T11:38:20.989Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1705,"worker_id":"sidekiq_0","memwd_rss_bytes":943747072,"retry":0}1643gitlab # [ 218.622699] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1644gitlab # [ 218.626992] systemd[1]: Stopped gitlab-sidekiq.service.1645gitlab # [ 218.630382] systemd[1]: gitlab-sidekiq.service: Consumed 1min 8.335s CPU time over 2min 14.460s wall clock time, 950.6M memory peak, 4.4M read from disk.1646gitlab # [ 218.639278] systemd[1]: Started gitlab-sidekiq.service.1647gitlab # [ 218.645189] setup-gitlab-start[2319]: + mkdir -p /var/lib/secrets1648gitlab # [ 218.650666] setup-gitlab-start[2319]: + echo nixbot-test-token-of-20-chars1649gitlab # [ 218.656571] setup-gitlab-start[2319]: + chmod 644 /var/lib/secrets/gitlab-token1650gitlab # [ 218.660655] setup-gitlab-start[2319]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1651gitlab # [ 219.695114] gitaly[927]: time="2026-08-11T11:38:23.252Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VM510WKX8BVQHWM7QBBG error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T11:38:33.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:23.251" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1652gitlab # [ 219.699389] gitaly[927]: time="2026-08-11T11:38:23.252Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VM510WKX8BVQHWM7QBBG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T11:38:33.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:23.251" grpc.time_ms=0.512 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1653gitlab # [ 219.840131] gitaly[927]: time="2026-08-11T11:38:23.398Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VM510WKX8BVQHWM7QBBG error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T11:38:33.147" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:23.397" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1654gitlab # [ 219.843906] gitaly[927]: time="2026-08-11T11:38:23.398Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VM510WKX8BVQHWM7QBBG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T11:38:33.147" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:23.397" grpc.time_ms=0.293 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1655gitlab # [ 219.968659] gitaly[927]: time="2026-08-11T11:38:23.526Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VM510WKX8BVQHWM7QBBG diskcache=e8d8547b-c231-4832-acd2-f9718cf625a1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T11:38:33.209" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:23.460" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1656gitlab # [ 219.996465] gitaly[927]: time="2026-08-11T11:38:23.527Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1586 command.oublock=32 command.real_time_ms=31 command.spawn_token_fork_ms=2 command.system_time_ms=18 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VM510WKX8BVQHWM7QBBG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T11:38:33.209" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:23.460" grpc.time_ms=66.322 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1657gitlab # [ 220.019259] gitaly[927]: time="2026-08-11T11:38:23.577Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VM510WKX8BVQHWM7QBBG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T11:38:33.326" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:23.576" pid=927 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1658gitlab # [ 220.036115] gitaly[927]: time="2026-08-11T11:38:23.594Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VM510WKX8BVQHWM7QBBG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T11:38:33.326" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:23.576" grpc.time_ms=0.578 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1659gitlab # [ 220.064465] gitaly[927]: time="2026-08-11T11:38:23.622Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VM510WKX8BVQHWM7QBBG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T11:38:33.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:23.604" grpc.time_ms=17.216 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1660gitlab # [ 220.146858] gitaly[927]: time="2026-08-11T11:38:23.704Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VM510WKX8BVQHWM7QBBG error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T11:38:33.103" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:23.704" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1661gitlab # [ 220.162235] gitaly[927]: time="2026-08-11T11:38:23.704Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VM510WKX8BVQHWM7QBBG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T11:38:33.103" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:23.704" grpc.time_ms=0.324 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1662gitlab # [ 220.218345] gitaly[927]: time="2026-08-11T11:38:23.776Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VM510WKX8BVQHWM7QBBG diskcache=b4445ec6-51db-4b6a-8e71-380959686307 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T11:38:33.108" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:23.709" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1663gitlab # [ 220.220070] gitaly[927]: time="2026-08-11T11:38:23.776Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1584 command.oublock=32 command.real_time_ms=16 command.spawn_token_fork_ms=5 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VM510WKX8BVQHWM7QBBG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T11:38:33.108" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:23.709" grpc.time_ms=66.721 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1664gitlab # [ 220.229568] gitaly[927]: time="2026-08-11T11:38:23.787Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VM510WKX8BVQHWM7QBBG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T11:38:33.186" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:23.787" pid=927 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1665gitlab # [ 220.230757] gitaly[927]: time="2026-08-11T11:38:23.787Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VM510WKX8BVQHWM7QBBG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T11:38:33.186" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:23.787" grpc.time_ms=0.507 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1666gitlab # [ 220.304238] gitaly[927]: time="2026-08-11T11:38:23.862Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VM510WKX8BVQHWM7QBBG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T11:38:33.255" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:23.855" grpc.time_ms=6.626 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1667gitlab # [ 220.359792] gitaly[927]: time="2026-08-11T11:38:23.917Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VM510WKX8BVQHWM7QBBG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T11:38:33.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:23.917" grpc.time_ms=0.388 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1668gitlab # [ 220.391497] gitaly[927]: time="2026-08-11T11:38:23.949Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VM510WKX8BVQHWM7QBBG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T11:38:33.038" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:23.948" grpc.time_ms=0.34 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1669gitlab # [ 220.899791] gitaly[927]: time="2026-08-11T11:38:24.456Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VM510WKX8BVQHWM7QBBG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T11:38:34.190" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:24.441" grpc.time_ms=14.442 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1670gitlab # [ 221.300638] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:24 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 26151671gitlab # [ 221.309766] setup-gitlab-start[2319]: + mkdir -p /tmp/test-flake1672gitlab # [ 221.313844] setup-gitlab-start[2319]: + cd /tmp/test-flake1673gitlab # [ 221.317611] setup-gitlab-start[2319]: + git init -b master1674gitlab # [ 221.321644] setup-gitlab-start[2682]: Initialized empty Git repository in /tmp/test-flake/.git/1675gitlab # [ 221.327283] setup-gitlab-start[2319]: + git config user.name test1676gitlab # [ 221.331231] setup-gitlab-start[2319]: + git config user.email test@example.com1677gitlab # [ 221.340675] setup-gitlab-start[2319]: + cat1678gitlab # [ 221.343970] setup-gitlab-start[2319]: + git add flake.nix1679gitlab # [ 221.349781] setup-gitlab-start[2319]: + git commit -m 'initial commit'1680gitlab # [ 221.375269] setup-gitlab-start[2688]: [master (root-commit) 4e3c03a] initial commit1681gitlab # [ 221.377850] setup-gitlab-start[2688]: 1 file changed, 10 insertions(+)1682gitlab # [ 221.379922] setup-gitlab-start[2688]: create mode 100644 flake.nix1683gitlab # [ 221.384225] setup-gitlab-start[2319]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1684gitlab # [ 221.386855] setup-gitlab-start[2319]: + git push -u origin master1685gitlab # [ 221.437144] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:24 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 361686gitlab # [ 221.810517] gitaly[927]: time="2026-08-11T11:38:25.368Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VPV6SF8J03DNB435K70B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:25.350" grpc.time_ms=17.689 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1687gitlab # [ 221.859192] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:25 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 4181688gitlab # [ 222.168710] gitaly[927]: time="2026-08-11T11:38:25.726Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T11:38:35.110" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:25.711" grpc.time_ms=14.502 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1689gitlab # [ 222.242785] sidekiq-cluster[2632]: {"severity":"INFO","time":"2026-08-11T11:38:25.781Z","message":"Starting cluster with 1 processes"}1690gitlab # [ 222.252848] gitaly[927]: time="2026-08-11T11:38:25.811Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-11T11:38:55.095" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-11T11:38:25.796" grpc.time_ms=14.707 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1691gitlab # [ 222.307920] gitaly[927]: time="2026-08-11T11:38:25.866Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR duration_ms=221ns method=POST pid=927 status=200 url="http://unix/api/v4/internal/allowed"1692gitlab # [ 222.407310] gitaly[927]: time="2026-08-11T11:38:25.965Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR duration_ms=96ns method=POST pid=927 status=200 url="http://unix/api/v4/internal/pre_receive"1693gitlab # [ 222.419137] gitaly[927]: time="2026-08-11T11:38:25.977Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5311 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:38:25.644" grpc.time_ms=332.779 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1694gitlab # [ 222.506541] gitaly[927]: time="2026-08-11T11:38:26.064Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:38:26.063" grpc.time_ms=0.675 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1695gitlab # [ 222.560539] gitaly[927]: time="2026-08-11T11:38:26.118Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:38:26.118" grpc.time_ms=0.53 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1696gitlab # [ 222.602818] gitaly[927]: time="2026-08-11T11:38:26.161Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:38:26.159" grpc.time_ms=1.233 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1697gitlab # [ 222.706721] gitaly[927]: time="2026-08-11T11:38:26.264Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T11:38:36.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:26.254" grpc.time_ms=10.708 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1698gitlab # [ 222.759318] gitaly[927]: time="2026-08-11T11:38:26.317Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1563 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-11T11:38:36.051" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:38:26.301" grpc.time_ms=15.672 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1699gitlab # [ 222.786678] gitaly[927]: time="2026-08-11T11:38:26.344Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR duration_ms=140ns method=POST pid=927 status=200 url="http://unix/api/v4/internal/post_receive"1700gitlab # [ 222.788605] gitaly[927]: time="2026-08-11T11:38:26.346Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4805 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:38:26.202" grpc.time_ms=143.949 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1701gitlab # [ 222.816245] gitaly[927]: time="2026-08-11T11:38:26.374Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR diskcache=cb36433c-1e80-4a5b-afd5-2ed341e74d28 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:25.552" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1702gitlab # [ 222.817380] gitaly[927]: time="2026-08-11T11:38:26.374Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=239 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13924 command.oublock=32 command.real_time_ms=813 command.spawn_token_fork_ms=0 command.system_time_ms=149 command.user_time_ms=90 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:25.552" grpc.time_ms=822.443 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1703gitlab # [ 222.818549] gitlab-workhorse[828]: time="2026-08-11T11:38:26Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521704gitlab # [ 222.820518] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:26 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 9391705gitlab # [ 222.859532] setup-gitlab-start[2692]: To http://gitlab/root/test-flake.git1706gitlab # [ 222.861526] setup-gitlab-start[2692]: * [new branch] master -> master1707gitlab # [ 222.864122] setup-gitlab-start[2692]: branch 'master' set up to track 'origin/master'.1708gitlab # [ 222.868858] systemd[1]: Finished setup-gitlab.service.1709gitlab # [ 222.872472] systemd[1]: Starting nixbot CI service...1710gitlab: (finished: waiting for unit setup-gitlab.service, in 224.32 seconds)1711gitlab: waiting for unit nixbot.service1712gitlab # [ 224.024628] nixbot[2776]: {"ts": "2026-08-11T11:38:27.581Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1713gitlab # [ 224.058970] nixbot[2776]: {"ts": "2026-08-11T11:38:27.616Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1714gitlab # [ 224.075680] nixbot[2776]: {"ts": "2026-08-11T11:38:27.633Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1715gitlab # [ 224.086145] nixbot[2776]: {"ts": "2026-08-11T11:38:27.638Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1716gitlab # [ 224.089314] nixbot[2776]: {"ts": "2026-08-11T11:38:27.642Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1717gitlab # [ 224.105729] nixbot[2776]: {"ts": "2026-08-11T11:38:27.663Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1718gitlab # [ 224.120629] nixbot[2776]: {"ts": "2026-08-11T11:38:27.678Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1719gitlab # [ 224.133324] nixbot[2776]: {"ts": "2026-08-11T11:38:27.691Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1720gitlab # [ 224.144190] nixbot[2776]: {"ts": "2026-08-11T11:38:27.702Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1721gitlab # [ 224.148943] nixbot[2776]: {"ts": "2026-08-11T11:38:27.706Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1722gitlab # [ 224.167117] nixbot[2776]: {"ts": "2026-08-11T11:38:27.725Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1723gitlab # [ 224.185471] nixbot[2776]: {"ts": "2026-08-11T11:38:27.743Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1724gitlab # [ 224.199966] nixbot[2776]: {"ts": "2026-08-11T11:38:27.758Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1725gitlab # [ 224.213685] nixbot[2776]: {"ts": "2026-08-11T11:38:27.771Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1726gitlab # [ 224.220949] nixbot[2776]: {"ts": "2026-08-11T11:38:27.778Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1727gitlab # [ 224.225699] nixbot[2776]: {"ts": "2026-08-11T11:38:27.783Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1728gitlab # [ 224.230239] nixbot[2776]: {"ts": "2026-08-11T11:38:27.788Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1729gitlab # [ 224.233765] nixbot[2776]: {"ts": "2026-08-11T11:38:27.791Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1730gitlab # [ 224.243233] nixbot[2776]: {"ts": "2026-08-11T11:38:27.800Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1731gitlab # [ 224.247593] nixbot[2776]: {"ts": "2026-08-11T11:38:27.805Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1732gitlab # [ 224.250891] nixbot[2776]: {"ts": "2026-08-11T11:38:27.809Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1733gitlab # [ 224.258318] nixbot[2776]: {"ts": "2026-08-11T11:38:27.816Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1734gitlab # [ 224.265447] nixbot[2776]: {"ts": "2026-08-11T11:38:27.823Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1735gitlab # [ 224.272245] nixbot[2776]: {"ts": "2026-08-11T11:38:27.830Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1736gitlab # [ 224.279925] nixbot[2776]: {"ts": "2026-08-11T11:38:27.837Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1737gitlab # [ 224.674982] nixbot[2776]: INFO: Started server process [2776]1738gitlab # [ 224.678509] nixbot[2776]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1739gitlab # [ 224.695559] nixbot[2776]: INFO: ::ffff:127.0.0.1:52206 - "GET /health HTTP/1.1" 200 OK1740gitlab # [ 224.705933] systemd[1]: Started nixbot CI service.1741gitlab # [ 224.710276] systemd[1]: Reached target Multi-User System.1742gitlab # [ 224.713231] systemd[1]: Startup finished in 1.535s (kernel) + 3.748s (initrd) + 3min 39.428s (userspace) = 3min 44.712s.1743gitlab # [ 224.968472] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:28 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2741744gitlab # [ 224.971116] nixbot[2776]: {"ts": "2026-08-11T11:38:28.528Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1745gitlab # [ 225.007607] nixbot[2776]: {"ts": "2026-08-11T11:38:28.565Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1746gitlab # [ 225.095557] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:28 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 621747gitlab # [ 225.105859] nixbot[2776]: {"ts": "2026-08-11T11:38:28.655Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1748gitlab # [ 225.115132] nixbot[2776]: {"ts": "2026-08-11T11:38:28.658Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1749gitlab # [ 225.412503] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:28 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 3071750gitlab # [ 225.418597] nixbot[2776]: {"ts": "2026-08-11T11:38:28.976Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1751gitlab: (finished: waiting for unit nixbot.service, in 2.11 seconds)1752gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1753gitlab # [ 225.646554] nixbot[2776]: INFO: ::ffff:127.0.0.1:59984 - "GET /health HTTP/1.1" 200 OK1754gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1755subtest: project discovered and webhook registered1756gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1757gitlab # [ 225.767239] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 821758gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.12 seconds)1759(finished: subtest: project discovered and webhook registered, in 0.12 seconds)1760subtest: push delivers the webhook1761gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1762gitlab # [ 225.852424] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:29 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 311763gitlab # [ 225.941154] gitaly[927]: time="2026-08-11T11:38:29.498Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=7 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VV550CQHTCGE0DW3BTM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:29.483" grpc.time_ms=14.377 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1764gitlab # [ 225.947719] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:29 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 203 "" "git/2.55.0" 901765gitlab # Enumerating objects: 5, done.1766gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1767gitlab # Delta compression using up to 4 threads1768gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1769gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done.1770gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1771gitlab # [ 226.087888] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:29 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 6521772gitlab # [ 226.089050] nixbot[2776]: {"ts": "2026-08-11T11:38:29.646Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1773gitlab # [ 226.150166] nixbot[2776]: {"ts": "2026-08-11T11:38:29.707Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1774gitlab # [ 226.151319] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 521775gitlab # [ 226.176327] gitaly[927]: time="2026-08-11T11:38:29.734Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=330 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-11T11:38:59.026" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-11T11:38:29.726" grpc.time_ms=7.649 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1776gitlab # [ 226.210147] gitaly[927]: time="2026-08-11T11:38:29.768Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KZR9VV8PEAXSH4B46318DFV0 duration_ms=107ns method=POST pid=927 status=200 url="http://unix/api/v4/internal/allowed"1777gitlab # [ 226.225158] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:29 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 711778gitlab # [ 226.229669] nixbot[2776]: {"ts": "2026-08-11T11:38:29.787Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1779gitlab # [ 226.246159] gitaly[927]: time="2026-08-11T11:38:29.804Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KZR9VV8PEAXSH4B46318DFV0 duration_ms=34ns method=POST pid=927 status=200 url="http://unix/api/v4/internal/pre_receive"1780gitlab # [ 226.250930] gitaly[927]: time="2026-08-11T11:38:29.804Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5311 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:38:29.657" grpc.time_ms=146.89 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1781gitlab # [ 226.284208] gitaly[927]: time="2026-08-11T11:38:29.842Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:38:29.841" grpc.time_ms=0.548 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1782gitlab # [ 226.311049] gitaly[927]: time="2026-08-11T11:38:29.869Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VVH5T9FC6CS6625WKS5P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-11T11:38:59.053" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:38:29.854" grpc.time_ms=14.956 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1783gitlab # [ 226.334661] gitaly[927]: time="2026-08-11T11:38:29.883Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VVH5T9FC6CS6625WKS5P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:38:59.081" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:38:29.882" grpc.time_ms=0.762 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1784gitlab # [ 226.354343] gitaly[927]: time="2026-08-11T11:38:29.896Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VVH5T9FC6CS6625WKS5P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-11T11:38:39.005" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:38:29.885" grpc.time_ms=9.904 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1785gitlab # [ 226.375322] gitaly[927]: time="2026-08-11T11:38:29.906Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:38:29.905" grpc.time_ms=0.536 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1786gitlab # [ 226.391513] nixbot[2776]: {"ts": "2026-08-11T11:38:29.928Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1787gitlab # [ 226.395589] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1301788gitlab # [ 226.399325] gitaly[927]: time="2026-08-11T11:38:29.949Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:38:29.949" grpc.time_ms=0.369 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1789gitlab # [ 226.469332] gitaly[927]: time="2026-08-11T11:38:30.027Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KZR9VV8PEAXSH4B46318DFV0 duration_ms=45ns method=POST pid=927 status=200 url="http://unix/api/v4/internal/post_receive"1790gitlab # [ 226.475855] gitaly[927]: time="2026-08-11T11:38:30.028Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4805 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:38:29.981" grpc.time_ms=46.857 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1791gitlab # [ 226.492638] nixbot[2776]: {"ts": "2026-08-11T11:38:30.032Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1792gitlab # [ 226.497456] nixbot[2776]: {"ts": "2026-08-11T11:38:30.036Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1793gitlab # [ 226.498906] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:30 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 991794gitlab # [ 226.507410] gitaly[927]: time="2026-08-11T11:38:30.065Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 diskcache=4dd4149d-b3bb-46c3-a7bc-0c60fb6934f9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:29.599" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1795gitlab # [ 226.523683] gitaly[927]: time="2026-08-11T11:38:30.081Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=173 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=876544 command.minflt=13391 command.oublock=32 command.real_time_ms=449 command.spawn_token_fork_ms=4 command.system_time_ms=117 command.user_time_ms=56 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:29.599" grpc.time_ms=466.686 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1796gitlab # [ 226.525375] gitlab-workhorse[828]: time="2026-08-11T11:38:30Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521797gitlab # [ 226.526262] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:30 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5561798gitlab # To http://gitlab/root/test-flake.git1799gitlab # 4e3c03a..57f1ed8 master -> master1800gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.78 seconds)1801gitlab: must succeed: git -C /tmp/test-flake rev-parse master1802gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1803gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1804gitlab # [ 226.626893] nixbot[2776]: INFO: ::ffff:127.0.0.1:59994 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1805gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.07 seconds)1806gitlab # [ 226.631311] gitaly[927]: time="2026-08-11T11:38:30.188Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VVVE5HS1AMRVPWTK94R2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:30.176" grpc.time_ms=12.277 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc1807gitlab # [ 226.651692] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:30 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 631808gitlab # [ 226.722533] gitaly[927]: time="2026-08-11T11:38:30.280Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VVXHCRT90MBK6W3V17ES grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:30.268" pid=927 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1809gitlab # [ 226.738701] gitaly[927]: time="2026-08-11T11:38:30.280Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VVXHCRT90MBK6W3V17ES grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:30.268" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc1810gitlab # [ 226.759092] gitaly[927]: time="2026-08-11T11:38:30.281Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VVXHCRT90MBK6W3V17ES grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:30.268" grpc.time_ms=12.648 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc1811gitlab # [ 226.781981] gitlab-workhorse[828]: time="2026-08-11T11:38:30Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131812gitlab # [ 226.785705] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:30 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1461813gitlab # [ 226.903476] gitaly[927]: time="2026-08-11T11:38:30.455Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VW28BW6NFN53BH3JNT8F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:30.432" pid=927 remote_ip="2001:db8:1::1" request_sha=36df3ada9c0915827e0d528bb07ba1d60a201557 response_bytes=419 span.kind=server system=grpc1814gitlab # [ 226.928847] gitlab-workhorse[828]: time="2026-08-11T11:38:30Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=4191815gitlab # [ 226.932170] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:30 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 419 "" "git/2.55.0" 1141816gitlab # [ 226.935515] gitaly[927]: time="2026-08-11T11:38:30.456Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1200 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VW28BW6NFN53BH3JNT8F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:30.432" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc1817gitlab # [ 226.956889] gitaly[927]: time="2026-08-11T11:38:30.456Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1200 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VW28BW6NFN53BH3JNT8F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:30.432" grpc.time_ms=23.755 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc1818gitlab # [ 227.049571] gitaly[927]: time="2026-08-11T11:38:30.607Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VW8HYEY5C24ZCQQQ4Z1A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:30.596" grpc.time_ms=10.672 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc1819gitlab # [ 227.052446] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:30 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 611820gitlab # [ 227.164509] gitaly[927]: time="2026-08-11T11:38:30.722Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VWB7PQM9NMRZP496RAHB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:30.705" pid=927 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1821gitlab # [ 227.168173] gitaly[927]: time="2026-08-11T11:38:30.722Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VWB7PQM9NMRZP496RAHB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:30.705" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc1822gitlab # [ 227.172431] gitlab-workhorse[828]: time="2026-08-11T11:38:30Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671823gitlab # [ 227.174920] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:30 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 921824gitlab # [ 227.179201] gitaly[927]: time="2026-08-11T11:38:30.723Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VWB7PQM9NMRZP496RAHB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:30.705" grpc.time_ms=18.16 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc1825gitlab # [ 227.342330] gitaly[927]: time="2026-08-11T11:38:30.900Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VWHP1W18FABE50M85H55 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:30.885" grpc.time_ms=14.53 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc1826gitlab # [ 227.369188] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:30 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 881827gitlab # [ 227.543886] gitaly[927]: time="2026-08-11T11:38:31.101Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VWMMC0RMCZQHQTSFT63P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:31.079" pid=927 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1828gitlab # [ 227.547764] gitaly[927]: time="2026-08-11T11:38:31.101Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VWMMC0RMCZQHQTSFT63P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:31.079" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc1829gitlab # [ 227.602188] gitaly[927]: time="2026-08-11T11:38:31.160Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VWMMC0RMCZQHQTSFT63P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:31.079" grpc.time_ms=80.503 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc1830gitlab # [ 227.604343] gitlab-workhorse[828]: time="2026-08-11T11:38:31Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091831gitlab # [ 227.606709] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:31 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 2271832gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1833gitlab # [ 227.671614] nixbot[2776]: INFO: ::ffff:127.0.0.1:60000 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1834gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.04 seconds)1835gitlab # [ 227.733385] gitaly[927]: time="2026-08-11T11:38:31.291Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VWXPR895KAS8CNF3R3GR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:39:01.088" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:38:31.289" grpc.time_ms=0.988 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1836gitlab # [ 227.800333] gitaly[927]: time="2026-08-11T11:38:31.358Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VWXPR895KAS8CNF3R3GR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-11T11:39:01.143" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:38:31.344" grpc.time_ms=14.027 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1837gitlab # [ 227.866877] gitaly[927]: time="2026-08-11T11:38:31.425Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VWXPR895KAS8CNF3R3GR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T11:38:41.162" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:38:31.413" grpc.time_ms=11.652 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1838gitlab # [ 227.919111] gitaly[927]: time="2026-08-11T11:38:31.477Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VWXPR895KAS8CNF3R3GR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T11:38:41.214" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:38:31.465" grpc.time_ms=12.019 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1839gitlab # [ 228.011608] gitaly[927]: time="2026-08-11T11:38:31.568Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VWXPR895KAS8CNF3R3GR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T11:38:41.006" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:31.567" grpc.time_ms=0.576 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1840gitlab # [ 228.035619] gitaly[927]: time="2026-08-11T11:38:31.593Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VWXPR895KAS8CNF3R3GR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T11:38:41.018" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:38:31.579" grpc.time_ms=13.816 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1841gitlab # [ 228.134172] gitaly[927]: time="2026-08-11T11:38:31.692Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9VWXPR895KAS8CNF3R3GR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4149 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:38:31.691" grpc.time_ms=1.09 pid=927 span.kind=server system=grpc1842gitlab # [ 228.179455] gitaly[927]: time="2026-08-11T11:38:31.737Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9VWXPR895KAS8CNF3R3GR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4151 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:38:31.737" grpc.time_ms=0.442 pid=927 span.kind=server system=grpc1843gitlab # [ 228.208131] gitaly[927]: time="2026-08-11T11:38:31.766Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VWXPR895KAS8CNF3R3GR diskcache=8855fd52-0ded-4bed-a5e3-a87596c493c9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T11:38:41.072" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:31.633" pid=927 ref=refs/keep-around/4e3c03ae7d5f74718228646f4699aec07988098e remote_ip="2001:db8:1::1" revision=4e3c03ae7d5f74718228646f4699aec07988098e span.kind=server system=grpc username=root1844gitlab # [ 228.226833] gitaly[927]: time="2026-08-11T11:38:31.767Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=99 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5569 command.oublock=8 command.real_time_ms=122 command.spawn_token_fork_ms=0 command.system_time_ms=62 command.user_time_ms=37 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VWXPR895KAS8CNF3R3GR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T11:38:41.072" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:38:31.633" grpc.time_ms=133.117 pid=927 ref=refs/keep-around/4e3c03ae7d5f74718228646f4699aec07988098e remote_ip="2001:db8:1::1" revision=4e3c03ae7d5f74718228646f4699aec07988098e span.kind=server system=grpc username=root1845gitlab # [ 228.228422] gitaly[927]: time="2026-08-11T11:38:31.772Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VWXPR895KAS8CNF3R3GR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:39:01.071" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:38:31.771" grpc.time_ms=0.584 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1846gitlab # [ 228.444908] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:32 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4e3c03ae7d5f74718228646f4699aec07988098e HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 7781847gitlab # [ 228.448311] nixbot[2776]: {"ts": "2026-08-11T11:38:32.002Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4e3c03ae7d5f74718228646f4699aec07988098e \"HTTP/1.1 201 Created\""}1848gitlab # [ 228.476739] nixbot[2776]: {"ts": "2026-08-11T11:38:32.034Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-4e3c03ae7d5f-0"}1849gitlab # [ 228.560628] systemd[1]: Started Nix Daemon.1850gitlab # [ 228.616613] nix-daemon[2988]: accepted connection from pid 2982, user nixbot1851gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1852gitlab # [ 228.693517] nix-daemon[2988]: accepted connection from pid 2995, user nixbot1853gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1854gitlab # [ 228.717932] nixbot[2776]: INFO: ::ffff:127.0.0.1:60008 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1855gitlab # [ 228.726548] nixbot[2776]: {"ts": "2026-08-11T11:38:32.280Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-4e3c03ae7d5f-0", "argv0": "bwrap"}1856gitlab # [ 228.855561] nix-daemon[2988]: accepted connection from pid 3008, user nixbot1857gitlab # [ 228.916283] nix-daemon[2988]: accepted connection from pid 3018, user nixbot1858gitlab # [ 228.938210] nix-daemon[2988]: accepted connection from pid 3008, user nixbot1859gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1860gitlab # [ 229.771121] nixbot[2776]: INFO: ::ffff:127.0.0.1:60022 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1861gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.06 seconds)1862gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1863gitlab # [ 230.824934] nixbot[2776]: INFO: ::ffff:127.0.0.1:60038 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1864gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1865gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1866gitlab # [ 231.879425] nixbot[2776]: INFO: ::ffff:127.0.0.1:60046 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1867gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1868gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1869gitlab # [ 232.931103] nixbot[2776]: INFO: ::ffff:127.0.0.1:60054 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1870gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1871gitlab # [ 233.603177] nix-daemon[2988]: accepted connection from pid 3047, user nixbot1872gitlab # [ 233.618531] gitaly[927]: time="2026-08-11T11:38:37.175Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9W2NS9Q3363MCYHFFJKNH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:39:07.072" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:38:37.173" grpc.time_ms=1.496 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1873gitlab # [ 233.659528] gitaly[927]: time="2026-08-11T11:38:37.217Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR9W2NS9Q3363MCYHFFJKNH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T11:38:47.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:38:37.206" grpc.time_ms=11.306 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1874gitlab # [ 233.701131] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:37 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4e3c03ae7d5f74718228646f4699aec07988098e HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 1441875gitlab # [ 233.705877] nixbot[2776]: {"ts": "2026-08-11T11:38:37.264Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4e3c03ae7d5f74718228646f4699aec07988098e \"HTTP/1.1 201 Created\""}1876gitlab # [ 233.793903] gitaly[927]: time="2026-08-11T11:38:37.352Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9W2TKZBV8ZRY942CJJZE6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:39:07.050" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:38:37.351" grpc.time_ms=0.852 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1877gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1878gitlab # [ 233.989702] nixbot[2776]: INFO: ::ffff:127.0.0.1:48932 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1879gitlab # [ 233.993903] gitaly[927]: time="2026-08-11T11:38:37.546Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9W2TKZBV8ZRY942CJJZE6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T11:38:47.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:38:37.539" grpc.time_ms=6.585 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1880gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.09 seconds)1881gitlab # [ 234.098420] nixbot[2776]: {"ts": "2026-08-11T11:38:37.655Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4e3c03ae7d5f74718228646f4699aec07988098e \"HTTP/1.1 201 Created\""}1882gitlab # [ 234.109869] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:37 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4e3c03ae7d5f74718228646f4699aec07988098e HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3891883gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1884gitlab # [ 235.068941] nixbot[2776]: INFO: ::ffff:127.0.0.1:48946 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1885gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1886gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1887gitlab # [ 236.120983] nixbot[2776]: INFO: ::ffff:127.0.0.1:48952 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1888gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1889gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1890gitlab # [ 237.173834] nixbot[2776]: INFO: ::ffff:127.0.0.1:48954 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1891gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1892gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1893gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.03 seconds)1894gitlab # [ 238.209456] nixbot[2776]: INFO: ::ffff:127.0.0.1:48966 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1895gitlab # [ 238.327379] nix-daemon[2988]: accepted connection from pid 3092, user nixbot1896gitlab # [ 238.436672] gitaly[927]: time="2026-08-11T11:38:41.993Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9W7CK1D64G2AHJCYC3K1V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:39:11.191" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:38:41.992" grpc.time_ms=1.232 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1897gitlab # [ 238.520141] gitaly[927]: time="2026-08-11T11:38:42.077Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9W7CK1D64G2AHJCYC3K1V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T11:38:52.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:38:42.065" grpc.time_ms=12.613 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1898gitlab # [ 238.629173] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:42 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4e3c03ae7d5f74718228646f4699aec07988098e HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2451899gitlab # [ 238.639589] nixbot[2776]: {"ts": "2026-08-11T11:38:42.197Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4e3c03ae7d5f74718228646f4699aec07988098e \"HTTP/1.1 201 Created\""}1900gitlab # [ 238.776398] nix-daemon[2988]: accepted connection from pid 3107, user nixbot1901gitlab # [ 238.903112] gitaly[927]: time="2026-08-11T11:38:42.461Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9W7TZA79F7V2ZT8NJHNKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:42.447" grpc.time_ms=12.949 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc1902gitlab # [ 238.907283] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:42 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 651903gitlab # [ 239.026062] gitaly[927]: time="2026-08-11T11:38:42.584Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9W7YGRM01W8BGJABHHFCX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:42.571" pid=927 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1904gitlab # [ 239.028425] gitaly[927]: time="2026-08-11T11:38:42.584Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9W7YGRM01W8BGJABHHFCX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:42.571" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc1905gitlab # [ 239.030648] gitaly[927]: time="2026-08-11T11:38:42.586Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9W7YGRM01W8BGJABHHFCX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:38:42.571" grpc.time_ms=14.769 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc1906gitlab # [ 239.033439] gitlab-workhorse[828]: time="2026-08-11T11:38:42Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671907gitlab # [ 239.035472] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:38:42 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 751908gitlab # [ 239.171583] nix-daemon[2988]: accepted connection from pid 3132, user nixbot1909gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1910gitlab # [ 239.246943] nixbot[2776]: INFO: ::ffff:127.0.0.1:48982 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1911gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.04 seconds)1912gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1913gitlab # [ 240.294976] nixbot[2776]: INFO: ::ffff:127.0.0.1:48992 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1914gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1915gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1916gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.03 seconds)1917gitlab # [ 241.332457] nixbot[2776]: INFO: ::ffff:127.0.0.1:49004 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1918gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1919gitlab # [ 242.376418] nixbot[2776]: INFO: ::ffff:127.0.0.1:49016 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1920gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1921gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1922gitlab # [ 243.425711] nixbot[2776]: INFO: ::ffff:127.0.0.1:40328 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1923gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1924gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1925gitlab # [ 244.474892] nixbot[2776]: INFO: ::ffff:127.0.0.1:40342 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1926gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1927gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1928gitlab # [ 245.523660] nixbot[2776]: INFO: ::ffff:127.0.0.1:40350 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1929gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1930gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1931gitlab # [ 246.573763] nixbot[2776]: INFO: ::ffff:127.0.0.1:40356 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1932gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1933gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1934gitlab # [ 247.621802] nixbot[2776]: INFO: ::ffff:127.0.0.1:40370 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1935gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1936gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1937gitlab # [ 248.671308] nixbot[2776]: INFO: ::ffff:127.0.0.1:40376 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1938gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1939gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1940gitlab # [ 249.723844] nixbot[2776]: INFO: ::ffff:127.0.0.1:40392 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1941gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1942gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1943gitlab # [ 250.773848] nixbot[2776]: INFO: ::ffff:127.0.0.1:40396 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1944gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1945gitlab # [ 251.142900] sidekiq-cluster[2726]: 2026-08-11T11:38:54.699Z pid=2726 tid=x72 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2726, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>434163712}1946gitlab # [ 251.332546] sidekiq-cluster[2726]: W, [2026-08-11T11:38:54.890559 #2726] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1947gitlab # [ 251.372206] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:38:54.930Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1948gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1949gitlab # [ 251.826125] nixbot[2776]: INFO: ::ffff:127.0.0.1:40400 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1950gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1951gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1952gitlab # [ 252.877914] nixbot[2776]: INFO: ::ffff:127.0.0.1:40406 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1953gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1954gitlab # [ 253.447849] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:38:57.004Z","message":"GitLab reliable fetch activated!"}1955gitlab # [ 253.454694] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:38:57.005Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1956gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1957gitlab # [ 253.924964] nixbot[2776]: INFO: ::ffff:127.0.0.1:53232 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1958gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1959gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1960gitlab # [ 254.975944] nixbot[2776]: INFO: ::ffff:127.0.0.1:53242 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1961gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1962gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1963gitlab # [ 256.024195] nixbot[2776]: INFO: ::ffff:127.0.0.1:53254 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1964gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1965gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1966gitlab # [ 257.075772] nixbot[2776]: INFO: ::ffff:127.0.0.1:53258 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1967gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1968gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1969gitlab # [ 258.125890] nixbot[2776]: INFO: ::ffff:127.0.0.1:53260 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1970gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1971gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1972gitlab # [ 259.175790] nixbot[2776]: INFO: ::ffff:127.0.0.1:53272 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1973gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)1974gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1975gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.03 seconds)1976gitlab # [ 260.214653] nixbot[2776]: INFO: ::ffff:127.0.0.1:53278 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1977gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1978gitlab # [ 261.258990] nixbot[2776]: INFO: ::ffff:127.0.0.1:53290 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1979gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.04 seconds)1980gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1981gitlab # [ 262.302604] nixbot[2776]: INFO: ::ffff:127.0.0.1:53304 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1982gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.04 seconds)1983gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1984gitlab # [ 263.346421] nixbot[2776]: INFO: ::ffff:127.0.0.1:52950 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1985gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.04 seconds)1986gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1987gitlab # [ 264.389931] nixbot[2776]: INFO: ::ffff:127.0.0.1:52954 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1988gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.04 seconds)1989gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1990gitlab # [ 265.433791] nixbot[2776]: INFO: ::ffff:127.0.0.1:52970 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1991gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.04 seconds)1992gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1993gitlab # [ 266.477808] nixbot[2776]: INFO: ::ffff:127.0.0.1:52984 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1994gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.04 seconds)1995gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1996gitlab # [ 267.520793] nixbot[2776]: INFO: ::ffff:127.0.0.1:52998 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK1997gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.04 seconds)1998gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'1999gitlab # [ 268.564801] nixbot[2776]: INFO: ::ffff:127.0.0.1:53012 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK2000gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.04 seconds)2001gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'2002gitlab # [ 269.609209] nixbot[2776]: INFO: ::ffff:127.0.0.1:53026 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK2003gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.04 seconds)2004gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'2005gitlab # [ 270.655545] nixbot[2776]: INFO: ::ffff:127.0.0.1:53036 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK2006gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)2007gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'2008gitlab # [ 271.700705] nixbot[2776]: INFO: ::ffff:127.0.0.1:53040 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK2009gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.04 seconds)2010gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'2011gitlab # [ 272.743877] nixbot[2776]: INFO: ::ffff:127.0.0.1:53042 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK2012gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)2013gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'2014gitlab # [ 273.790918] nixbot[2776]: INFO: ::ffff:127.0.0.1:37174 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK2015gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)2016gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'2017gitlab # [ 274.840479] nixbot[2776]: INFO: ::ffff:127.0.0.1:37180 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK2018gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)2019gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'2020gitlab # [ 275.889578] nixbot[2776]: INFO: ::ffff:127.0.0.1:37182 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK2021gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)2022gitlab # [ 276.559282] postgres[3260]: [3260] ERROR: relation "table_without_models" does not exist2023gitlab # [ 276.563371] postgres[3260]: [3260] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2024gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'2025gitlab # [ 276.940865] nixbot[2776]: INFO: ::ffff:127.0.0.1:37196 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK2026gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)2027gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'2028gitlab # [ 277.993337] nixbot[2776]: INFO: ::ffff:127.0.0.1:37202 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK2029gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)2030gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'2031gitlab # [ 279.046110] nixbot[2776]: INFO: ::ffff:127.0.0.1:37212 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK2032gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)2033gitlab # [ 279.449590] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:23.007Z","message":"Booted Rails 7.2.3.1 application in production environment"}2034gitlab # [ 279.456945] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:23.015Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}2035gitlab # [ 279.460484] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:23.015Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2036gitlab # [ 279.462966] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:23.015Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2037gitlab # [ 279.482154] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:23.040Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2038gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'2039gitlab # [ 280.098549] nixbot[2776]: INFO: ::ffff:127.0.0.1:37218 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK2040gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)2041gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'2042gitlab # [ 281.148830] nixbot[2776]: INFO: ::ffff:127.0.0.1:37226 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK2043gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)2044gitlab # [ 281.248135] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:24.804Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"651e47813bde6c4cb6e22d63","created_at":"2026-08-11T11:38:23.643Z","trace_propagation_headers":{"sentry-trace":"9d0ad392ca19405e846453b5766886b8-4a889c2ff1c54755","baggage":"sentry-trace_id=9d0ad392ca19405e846453b5766886b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9VM510WKX8BVQHWM7QBBG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:23.681Z","job_size_bytes":2,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-651e47813bde6c4cb6e22d63: start","job_status":"start","queue_duration_s":61.123021,"scheduling_latency_s":61.123118}2045gitlab # [ 281.513736] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:25.070Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"651e47813bde6c4cb6e22d63","created_at":"2026-08-11T11:38:23.643Z","trace_propagation_headers":{"sentry-trace":"9d0ad392ca19405e846453b5766886b8-4a889c2ff1c54755","baggage":"sentry-trace_id=9d0ad392ca19405e846453b5766886b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9VM510WKX8BVQHWM7QBBG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:23.681Z","job_size_bytes":2,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-651e47813bde6c4cb6e22d63: done: 0.266597 sec","job_status":"done","queue_duration_s":61.123021,"scheduling_latency_s":61.123118,"redis_calls":24,"redis_duration_s":0.015054999999999999,"redis_read_bytes":1038,"redis_write_bytes":2604,"redis_feature_flag_calls":14,"redis_feature_flag_duration_s":0.008563,"redis_feature_flag_read_bytes":1030,"redis_feature_flag_write_bytes":1439,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003787,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002705,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.103651442,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.266597,"completed_at":"2026-08-11T11:39:25.070Z","load_balancing_strategy":"primary","db_duration_s":0.078093,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2046gitlab # [ 281.591567] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:25.149Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"299ad772eb2129bc480bda17","created_at":"2026-08-11T11:38:23.691Z","trace_propagation_headers":{"sentry-trace":"9d0ad392ca19405e846453b5766886b8-4a889c2ff1c54755","baggage":"sentry-trace_id=9d0ad392ca19405e846453b5766886b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9VM510WKX8BVQHWM7QBBG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:23.698Z","job_size_bytes":2,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-299ad772eb2129bc480bda17: start","job_status":"start","queue_duration_s":61.451117,"scheduling_latency_s":61.451161}2047gitlab # [ 281.759764] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:25.317Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"299ad772eb2129bc480bda17","created_at":"2026-08-11T11:38:23.691Z","trace_propagation_headers":{"sentry-trace":"9d0ad392ca19405e846453b5766886b8-4a889c2ff1c54755","baggage":"sentry-trace_id=9d0ad392ca19405e846453b5766886b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9VM510WKX8BVQHWM7QBBG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:23.698Z","job_size_bytes":2,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-299ad772eb2129bc480bda17: done: 0.167979 sec","job_status":"done","queue_duration_s":61.451117,"scheduling_latency_s":61.451161,"redis_calls":14,"redis_duration_s":0.009004999999999999,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.002692,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003526,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002787,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.098821778,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.167979,"completed_at":"2026-08-11T11:39:25.317Z","load_balancing_strategy":"primary","db_duration_s":0.034733,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2048gitlab # [ 281.765815] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:25.319Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"ba250d6249e7d2545828928d","created_at":"2026-08-11T11:38:24.342Z","trace_propagation_headers":{"sentry-trace":"9d0ad392ca19405e846453b5766886b8-4a889c2ff1c54755","baggage":"sentry-trace_id=9d0ad392ca19405e846453b5766886b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9VM510WKX8BVQHWM7QBBG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:24.349Z","job_size_bytes":5,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-ba250d6249e7d2545828928d: start","job_status":"start","queue_duration_s":60.969878,"scheduling_latency_s":60.969901}2049gitlab # [ 281.904913] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:25.462Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"ba250d6249e7d2545828928d","created_at":"2026-08-11T11:38:24.342Z","trace_propagation_headers":{"sentry-trace":"9d0ad392ca19405e846453b5766886b8-4a889c2ff1c54755","baggage":"sentry-trace_id=9d0ad392ca19405e846453b5766886b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9VM510WKX8BVQHWM7QBBG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:24.349Z","job_size_bytes":5,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-ba250d6249e7d2545828928d: done: 0.143035 sec","job_status":"done","queue_duration_s":60.969878,"scheduling_latency_s":60.969901,"redis_calls":12,"redis_duration_s":0.005653,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001557,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003133,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.099049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000577447,"duration_s":0.143035,"completed_at":"2026-08-11T11:39:25.462Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033839,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2050gitlab # [ 281.907806] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:25.465Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"c9846a03a20fbd1aa6896178","created_at":"2026-08-11T11:38:24.378Z","trace_propagation_headers":{"sentry-trace":"9d0ad392ca19405e846453b5766886b8-4a889c2ff1c54755","baggage":"sentry-trace_id=9d0ad392ca19405e846453b5766886b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9VM510WKX8BVQHWM7QBBG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:24.383Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-c9846a03a20fbd1aa6896178: start","job_status":"start","queue_duration_s":61.081229,"scheduling_latency_s":61.081252}2051gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'2052gitlab # [ 282.126185] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:25.683Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"c9846a03a20fbd1aa6896178","created_at":"2026-08-11T11:38:24.378Z","trace_propagation_headers":{"sentry-trace":"9d0ad392ca19405e846453b5766886b8-4a889c2ff1c54755","baggage":"sentry-trace_id=9d0ad392ca19405e846453b5766886b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9VM510WKX8BVQHWM7QBBG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:24.383Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-c9846a03a20fbd1aa6896178: done: 0.218938 sec","job_status":"done","queue_duration_s":61.081229,"scheduling_latency_s":61.081252,"redis_calls":11,"redis_duration_s":0.004498,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001287,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002548,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000663,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.183,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.183,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.113267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000601752,"duration_s":0.218938,"completed_at":"2026-08-11T11:39:25.683Z","load_balancing_strategy":"primary","db_duration_s":0.105936,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2053gitlab # [ 282.131134] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:25.686Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"f0b910fc00239fbf13035191","created_at":"2026-08-11T11:38:24.386Z","trace_propagation_headers":{"sentry-trace":"9d0ad392ca19405e846453b5766886b8-4a889c2ff1c54755","baggage":"sentry-trace_id=9d0ad392ca19405e846453b5766886b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9VM510WKX8BVQHWM7QBBG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:24.391Z","job_size_bytes":89,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-f0b910fc00239fbf13035191: start","job_status":"start","queue_duration_s":61.29462,"scheduling_latency_s":61.294644}2054gitlab # [ 282.241323] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:25.725Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"f0b910fc00239fbf13035191","created_at":"2026-08-11T11:38:24.386Z","trace_propagation_headers":{"sentry-trace":"9d0ad392ca19405e846453b5766886b8-4a889c2ff1c54755","baggage":"sentry-trace_id=9d0ad392ca19405e846453b5766886b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9VM510WKX8BVQHWM7QBBG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:24.391Z","job_size_bytes":89,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-f0b910fc00239fbf13035191: done: 0.039201 sec","job_status":"done","queue_duration_s":61.29462,"scheduling_latency_s":61.294644,"redis_calls":11,"redis_duration_s":0.005168,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001752,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002606,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00081,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021391,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000569905,"duration_s":0.039201,"completed_at":"2026-08-11T11:39:25.725Z","load_balancing_strategy":"primary","db_duration_s":0.007753,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2055gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.16 seconds)2056gitlab # [ 282.253923] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:25.727Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 4e3c03ae7d5f74718228646f4699aec07988098e refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"32c4d8a0958a3532186e498f","created_at":"2026-08-11T11:38:26.234Z","trace_propagation_headers":{"sentry-trace":"0ab5930d981b4a32a3ed5c6fd957da36-dc3eddab5b8d48e3","baggage":"sentry-trace_id=0ab5930d981b4a32a3ed5c6fd957da36,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9VQ8VQYVBZR9AXFHRZJGR","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:26.239Z","job_size_bytes":185,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-32c4d8a0958a3532186e498f: start","job_status":"start","queue_duration_s":59.488095,"scheduling_latency_s":59.488117}2057gitlab # [ 282.325421] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:25.745Z","message":"changes: \"0000000000000000000000000000000000000000 4e3c03ae7d5f74718228646f4699aec07988098e refs/heads/master\\n\""}2058gitlab # [ 282.326622] gitaly[927]: time="2026-08-11T11:39:25.791Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T11:39:35.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:25.777" grpc.time_ms=14.215 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2059gitlab # [ 282.328142] nixbot[2776]: INFO: ::ffff:127.0.0.1:37236 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK2060gitlab # [ 282.328922] gitaly[927]: time="2026-08-11T11:39:25.870Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=69 command.spawn_token_fork_ms=65 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T11:39:35.028" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:39:25.799" grpc.time_ms=71.502 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2061gitlab # [ 282.363571] gitaly[927]: time="2026-08-11T11:39:25.921Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-11T11:39:35.142" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:25.912" grpc.time_ms=8.713 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2062gitlab # [ 282.399572] gitaly[927]: time="2026-08-11T11:39:25.957Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3932 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:39:25.957" grpc.time_ms=0.372 pid=927 span.kind=server system=grpc2063gitlab # [ 282.426675] gitaly[927]: time="2026-08-11T11:39:25.984Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3934 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:39:25.984" grpc.time_ms=0.308 pid=927 span.kind=server system=grpc2064gitlab # [ 282.437295] gitaly[927]: time="2026-08-11T11:39:25.995Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR diskcache=28bf26a7-8864-4b32-b600-7a86aeba373d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T11:39:35.160" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:39:25.931" pid=927 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2065gitlab # [ 282.438948] gitaly[927]: time="2026-08-11T11:39:25.995Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=69 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4977 command.oublock=8 command.real_time_ms=57 command.spawn_token_fork_ms=0 command.system_time_ms=43 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T11:39:35.160" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:39:25.931" grpc.time_ms=64.69 pid=927 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2066gitlab # [ 282.455816] gitaly[927]: time="2026-08-11T11:39:26.014Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T11:39:36.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:39:26.013" grpc.time_ms=0.148 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2067gitlab # [ 282.473370] gitaly[927]: time="2026-08-11T11:39:26.031Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=942 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-11T11:39:36.010" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:26.021" grpc.time_ms=10.309 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2068gitlab # [ 282.542963] gitaly[927]: time="2026-08-11T11:39:26.101Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=338 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-11T11:39:56.095" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:26.095" grpc.time_ms=5.438 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2069gitlab # [ 282.567951] gitaly[927]: time="2026-08-11T11:39:26.126Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T11:39:36.115" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:39:26.125" grpc.time_ms=0.278 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2070gitlab # [ 282.589963] gitaly[927]: time="2026-08-11T11:39:26.148Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=342 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-11T11:39:36.132" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-11T11:39:26.143" grpc.time_ms=4.772 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2071gitlab # [ 282.619799] gitaly[927]: time="2026-08-11T11:39:26.178Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T11:39:36.160" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:26.170" grpc.time_ms=7.658 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2072gitlab # [ 282.653874] gitaly[927]: time="2026-08-11T11:39:26.212Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T11:39:36.195" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:26.205" grpc.time_ms=6.232 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2073gitlab # [ 282.682264] gitaly[927]: time="2026-08-11T11:39:26.240Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=967 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-11T11:39:56.226" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:26.227" grpc.time_ms=12.81 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2074gitlab # [ 283.128535] gitaly[927]: time="2026-08-11T11:39:26.686Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-11T11:39:36.003" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:26.684" grpc.time_ms=1.992 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2075gitlab # [ 283.197901] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:26.755Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 4e3c03ae7d5f74718228646f4699aec07988098e refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"32c4d8a0958a3532186e498f","created_at":"2026-08-11T11:38:26.234Z","trace_propagation_headers":{"sentry-trace":"0ab5930d981b4a32a3ed5c6fd957da36-dc3eddab5b8d48e3","baggage":"sentry-trace_id=0ab5930d981b4a32a3ed5c6fd957da36,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9VQ8VQYVBZR9AXFHRZJGR","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:26.239Z","job_size_bytes":185,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-32c4d8a0958a3532186e498f: done: 1.027434 sec","job_status":"done","queue_duration_s":59.488095,"scheduling_latency_s":59.488117,"gitaly_calls":13,"gitaly_duration_s":0.295223,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.068839,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.006214,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.011356,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002461,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.006887,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.021365,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.020556,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.055,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.224,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.243,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.055,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.590659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000748978,"exclusive_lock_hold_duration_s":0.037680766,"duration_s":1.027434,"completed_at":"2026-08-11T11:39:26.755Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.095692,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2076gitlab # [ 283.220771] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:26.759Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","4e3c03ae7d5f74718228646f4699aec07988098e 57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c005d769293e8eef2535167c","created_at":"2026-08-11T11:38:30.009Z","trace_propagation_headers":{"sentry-trace":"e2df42d0abe9481daa23b45607e273c0-a5a658dc2e4b49b0","baggage":"sentry-trace_id=e2df42d0abe9481daa23b45607e273c0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9VV8PEAXSH4B46318DFV0","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:30.011Z","job_size_bytes":185,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c005d769293e8eef2535167c: start","job_status":"start","queue_duration_s":56.748054,"scheduling_latency_s":56.748106}2077gitlab # [ 283.295808] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:26.788Z","message":"changes: \"4e3c03ae7d5f74718228646f4699aec07988098e 57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c refs/heads/master\\n\""}2078gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'2079gitlab # [ 283.297559] gitaly[927]: time="2026-08-11T11:39:26.835Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T11:39:36.051" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:26.821" grpc.time_ms=12.908 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2080gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)2081gitlab # [ 283.366256] gitaly[927]: time="2026-08-11T11:39:26.923Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T11:39:36.142" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:39:26.912" grpc.time_ms=10.162 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2082gitlab # [ 283.371887] nixbot[2776]: INFO: ::ffff:127.0.0.1:39610 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK2083gitlab # [ 283.399780] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:26.957Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"3018ac9fcade8ba4c54b2fe3","created_at":"2026-08-11T11:39:26.953Z","trace_propagation_headers":{"sentry-trace":"e2df42d0abe9481daa23b45607e273c0-99a13943689a4f14","baggage":"sentry-trace_id=e2df42d0abe9481daa23b45607e273c0,sentry-release=Unknown"},"correlation_id":"01KZR9VV8PEAXSH4B46318DFV0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"88fba61a67ca40cd2c7cb19c","job_size_bytes":46,"pid":2726,"job_status":"deduplicated","message":"ProjectCacheWorker JID-3018ac9fcade8ba4c54b2fe3: deduplicated: until executing","deduplication.type":"until executing"}2084gitlab # [ 283.435847] gitaly[927]: time="2026-08-11T11:39:26.993Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-11T11:39:36.211" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:26.981" grpc.time_ms=11.855 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2085gitlab # [ 283.483578] gitaly[927]: time="2026-08-11T11:39:27.041Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=654 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-11T11:39:57.024" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:27.025" grpc.time_ms=15.709 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2086gitlab # [ 283.515706] gitaly[927]: time="2026-08-11T11:39:27.073Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=345 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-11T11:39:37.052" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-11T11:39:27.063" grpc.time_ms=9.927 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2087gitlab # [ 283.545278] gitaly[927]: time="2026-08-11T11:39:27.103Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T11:39:37.080" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:27.091" grpc.time_ms=12.094 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2088gitlab # [ 283.690894] gitaly[927]: time="2026-08-11T11:39:27.248Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-11T11:39:37.236" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:27.246" grpc.time_ms=1.951 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2089gitlab # [ 283.736196] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:27.293Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","4e3c03ae7d5f74718228646f4699aec07988098e 57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c005d769293e8eef2535167c","created_at":"2026-08-11T11:38:30.009Z","trace_propagation_headers":{"sentry-trace":"e2df42d0abe9481daa23b45607e273c0-a5a658dc2e4b49b0","baggage":"sentry-trace_id=e2df42d0abe9481daa23b45607e273c0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9VV8PEAXSH4B46318DFV0","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T11:38:30.011Z","job_size_bytes":185,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c005d769293e8eef2535167c: done: 0.534078 sec","job_status":"done","queue_duration_s":56.748054,"scheduling_latency_s":56.748106,"gitaly_calls":7,"gitaly_duration_s":0.199208,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.049406,"redis_read_bytes":500,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.0054,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.002109,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.007501,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.017253,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.017143,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.038,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.038,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.239124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001203225,"exclusive_lock_hold_duration_s":0.100558032,"duration_s":0.534078,"completed_at":"2026-08-11T11:39:27.293Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041827,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2090gitlab # [ 283.748251] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:27.297Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"51189760905e2af78c22712d","created_at":"2026-08-11T11:38:31.776Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-e18cd2b82b474184","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:31.783Z","job_size_bytes":65,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-51189760905e2af78c22712d: start","job_status":"start","queue_duration_s":55.513396,"scheduling_latency_s":55.513457}2091gitlab # [ 283.903904] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:27.461Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"51189760905e2af78c22712d","created_at":"2026-08-11T11:38:31.776Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-e18cd2b82b474184","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:31.783Z","job_size_bytes":65,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-51189760905e2af78c22712d: done: 0.164469 sec","job_status":"done","queue_duration_s":55.513396,"scheduling_latency_s":55.513457,"redis_calls":16,"redis_duration_s":0.008157999999999999,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003944,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002995,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001219,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.117765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000587784,"duration_s":0.164469,"completed_at":"2026-08-11T11:39:27.461Z","load_balancing_strategy":"primary","db_duration_s":0.028125,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2092gitlab # [ 283.908926] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:27.464Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"c28981c95802da63ab25fec4","created_at":"2026-08-11T11:38:31.784Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-e18cd2b82b474184","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:31.834Z","job_size_bytes":65,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-c28981c95802da63ab25fec4: start","job_status":"start","queue_duration_s":55.629841,"scheduling_latency_s":55.629864}2093gitlab # [ 284.007485] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:27.564Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"c28981c95802da63ab25fec4","created_at":"2026-08-11T11:38:31.784Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-e18cd2b82b474184","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:31.834Z","job_size_bytes":65,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-c28981c95802da63ab25fec4: done: 0.100672 sec","job_status":"done","queue_duration_s":55.629841,"scheduling_latency_s":55.629864,"redis_calls":21,"redis_duration_s":0.00907,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003858,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002564,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002648,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000572699,"duration_s":0.100672,"completed_at":"2026-08-11T11:39:27.564Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.038011,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2094gitlab # [ 284.015521] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:27.567Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"1b518249552831379935c385","created_at":"2026-08-11T11:38:31.976Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-e18cd2b82b474184","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:31.983Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-1b518249552831379935c385: start","job_status":"start","queue_duration_s":55.583756,"scheduling_latency_s":55.583781}2095gitlab # [ 284.171759] gitaly[927]: time="2026-08-11T11:39:27.729Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9VWXPR895KAS8CNF3R3GR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:39:27.729" grpc.time_ms=0.508 pid=927 span.kind=server system=grpc2096gitlab # [ 284.229984] gitaly[927]: time="2026-08-11T11:39:27.788Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9VWXPR895KAS8CNF3R3GR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:39:27.787" grpc.time_ms=0.389 pid=927 span.kind=server system=grpc2097gitlab # [ 284.287598] gitaly[927]: time="2026-08-11T11:39:27.845Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9VWXPR895KAS8CNF3R3GR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:39:27.845" grpc.time_ms=0.46 pid=927 span.kind=server system=grpc2098gitlab # [ 284.313559] gitaly[927]: time="2026-08-11T11:39:27.871Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VWXPR895KAS8CNF3R3GR diskcache=5761d4f3-bef5-43fa-be5e-ef6d9eae4b99 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T11:39:57.697" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:27.698" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2099gitlab # [ 284.314959] gitaly[927]: time="2026-08-11T11:39:27.872Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=139 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7406 command.oublock=0 command.real_time_ms=164 command.spawn_token_fork_ms=1 command.system_time_ms=89 command.user_time_ms=50 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VWXPR895KAS8CNF3R3GR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T11:39:57.697" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:27.698" grpc.time_ms=173.476 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2100gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'2101gitlab # [ 284.405141] nixbot[2776]: INFO: ::ffff:127.0.0.1:39614 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK2102gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.03 seconds)2103gitlab # [ 284.469334] gitaly[927]: time="2026-08-11T11:39:28.027Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VWXPR895KAS8CNF3R3GR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T11:39:58.024" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:28.025" grpc.time_ms=1.792 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2104gitlab # [ 284.575888] gitaly[927]: time="2026-08-11T11:39:28.133Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VWXPR895KAS8CNF3R3GR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:39:58.130" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:28.131" grpc.time_ms=1.544 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2105gitlab # [ 284.632133] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:28.188Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"1b518249552831379935c385","created_at":"2026-08-11T11:38:31.976Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-e18cd2b82b474184","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:31.983Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2726,"job_status":"rescheduled","message":"PipelineProcessWorker JID-1b518249552831379935c385: rescheduled"}2106gitlab # [ 284.649930] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:28.207Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"1b518249552831379935c385","created_at":"2026-08-11T11:38:31.976Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-e18cd2b82b474184","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T11:38:31.983Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-1b518249552831379935c385: done: 0.640576 sec","job_status":"done","queue_duration_s":55.583756,"scheduling_latency_s":55.583781,"gitaly_calls":3,"gitaly_duration_s":0.228014,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.082139,"redis_read_bytes":462,"redis_write_bytes":29289,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001998,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.003084,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.050235,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.006853,"redis_queues_read_bytes":39,"redis_queues_write_bytes":15576,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.01115,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001345,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001519,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003957,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.079,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.021,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.025,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.038,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.250044,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.5301997890000001,"duration_s":0.640576,"completed_at":"2026-08-11T11:39:28.207Z","load_balancing_strategy":"primary","db_duration_s":0.094087,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2107gitlab # [ 284.681532] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:28.210Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"88fba61a67ca40cd2c7cb19c","created_at":"2026-08-11T11:39:25.874Z","trace_propagation_headers":{"sentry-trace":"0ab5930d981b4a32a3ed5c6fd957da36-d5a9c4b5fd764b92","baggage":"sentry-trace_id=0ab5930d981b4a32a3ed5c6fd957da36,sentry-release=Unknown"},"correlation_id":"01KZR9VQ8VQYVBZR9AXFHRZJGR","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:25.892Z","job_size_bytes":46,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-88fba61a67ca40cd2c7cb19c: start","job_status":"start","queue_duration_s":2.318169,"scheduling_latency_s":2.318224}2108gitlab # [ 284.764459] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:28.312Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"88fba61a67ca40cd2c7cb19c","created_at":"2026-08-11T11:39:25.874Z","trace_propagation_headers":{"sentry-trace":"0ab5930d981b4a32a3ed5c6fd957da36-d5a9c4b5fd764b92","baggage":"sentry-trace_id=0ab5930d981b4a32a3ed5c6fd957da36,sentry-release=Unknown"},"correlation_id":"01KZR9VQ8VQYVBZR9AXFHRZJGR","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:25.892Z","job_size_bytes":46,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-88fba61a67ca40cd2c7cb19c: done: 0.101538 sec","job_status":"done","queue_duration_s":2.318169,"scheduling_latency_s":2.318224,"gitaly_calls":2,"gitaly_duration_s":0.018045,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.012946000000000001,"redis_read_bytes":69,"redis_write_bytes":4881,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002911,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.001097,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003121,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.004536,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001281,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00055454,"duration_s":0.101538,"completed_at":"2026-08-11T11:39:28.312Z","load_balancing_strategy":"primary","db_duration_s":0.016264,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2109gitlab # [ 284.846286] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:28.314Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"58b4274637e82b81dfd160b2","created_at":"2026-08-11T11:39:25.904Z","trace_propagation_headers":{"sentry-trace":"0ab5930d981b4a32a3ed5c6fd957da36-d5a9c4b5fd764b92","baggage":"sentry-trace_id=0ab5930d981b4a32a3ed5c6fd957da36,sentry-release=Unknown"},"correlation_id":"01KZR9VQ8VQYVBZR9AXFHRZJGR","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:25.907Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-58b4274637e82b81dfd160b2: start","job_status":"start","queue_duration_s":2.406572,"scheduling_latency_s":2.406594}2110gitlab # [ 284.848136] gitaly[927]: time="2026-08-11T11:39:28.267Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-11T17:39:28.264" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:39:28.264" grpc.time_ms=2.721 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2111gitlab # [ 284.848991] gitaly[927]: time="2026-08-11T11:39:28.285Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-11T11:39:58.274" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:28.275" grpc.time_ms=9.759 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2112gitlab # [ 284.849752] gitaly[927]: time="2026-08-11T11:39:28.368Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR diskcache=07ac008e-3297-496c-88bf-81439c1aca0e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T17:39:28.339" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:28.340" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2113gitlab # [ 284.920375] gitaly[927]: time="2026-08-11T11:39:28.369Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1288 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T17:39:28.339" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:28.340" grpc.time_ms=28.437 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2114gitlab # [ 284.921892] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:28.411Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"58b4274637e82b81dfd160b2","created_at":"2026-08-11T11:39:25.904Z","trace_propagation_headers":{"sentry-trace":"0ab5930d981b4a32a3ed5c6fd957da36-d5a9c4b5fd764b92","baggage":"sentry-trace_id=0ab5930d981b4a32a3ed5c6fd957da36,sentry-release=Unknown"},"correlation_id":"01KZR9VQ8VQYVBZR9AXFHRZJGR","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:25.907Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-58b4274637e82b81dfd160b2: done: 0.096601 sec","job_status":"done","queue_duration_s":2.406572,"scheduling_latency_s":2.406594,"gitaly_calls":1,"gitaly_duration_s":0.031561,"redis_calls":15,"redis_duration_s":0.007222999999999999,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000976,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002789,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001201,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002257,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.01,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.02,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.069278358,"duration_s":0.096601,"completed_at":"2026-08-11T11:39:28.411Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020371,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2115gitlab # [ 284.993185] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:28.413Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"009970458b02377d06b5569a","created_at":"2026-08-11T11:39:26.008Z","trace_propagation_headers":{"sentry-trace":"0ab5930d981b4a32a3ed5c6fd957da36-d5a9c4b5fd764b92","baggage":"sentry-trace_id=0ab5930d981b4a32a3ed5c6fd957da36,sentry-release=Unknown"},"correlation_id":"01KZR9VQ8VQYVBZR9AXFHRZJGR","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:26.010Z","job_size_bytes":23,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-009970458b02377d06b5569a: start","job_status":"start","queue_duration_s":2.402412,"scheduling_latency_s":2.402437}2116gitlab # [ 284.994466] gitaly[927]: time="2026-08-11T11:39:28.458Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=653 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-11T11:39:58.444" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:28.445" grpc.time_ms=12.96 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2117gitlab # [ 284.999294] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:28.468Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"009970458b02377d06b5569a","created_at":"2026-08-11T11:39:26.008Z","trace_propagation_headers":{"sentry-trace":"0ab5930d981b4a32a3ed5c6fd957da36-d5a9c4b5fd764b92","baggage":"sentry-trace_id=0ab5930d981b4a32a3ed5c6fd957da36,sentry-release=Unknown"},"correlation_id":"01KZR9VQ8VQYVBZR9AXFHRZJGR","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:26.010Z","job_size_bytes":23,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-009970458b02377d06b5569a: done: 0.054909 sec","job_status":"done","queue_duration_s":2.402412,"scheduling_latency_s":2.402437,"gitaly_calls":1,"gitaly_duration_s":0.016101,"redis_calls":16,"redis_duration_s":0.007065,"redis_read_bytes":52,"redis_write_bytes":2048,"redis_queues_calls":1,"redis_queues_duration_s":0.000469,"redis_queues_read_bytes":1,"redis_queues_write_bytes":979,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002055,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.003107,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001434,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.054909,"completed_at":"2026-08-11T11:39:28.468Z","load_balancing_strategy":"primary","db_duration_s":0.004485,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2118gitlab # [ 285.068465] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:28.470Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"a5a24e0d33de722e02126e15","created_at":"2026-08-11T11:39:26.526Z","trace_propagation_headers":{"sentry-trace":"0ab5930d981b4a32a3ed5c6fd957da36-d5a9c4b5fd764b92","baggage":"sentry-trace_id=0ab5930d981b4a32a3ed5c6fd957da36,sentry-release=Unknown"},"correlation_id":"01KZR9VQ8VQYVBZR9AXFHRZJGR","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8f51665a025c1d6035f848ea7724bff303b988b47cd62d599799461bf4297fd5","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:26.536Z","job_size_bytes":467,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-a5a24e0d33de722e02126e15: start","job_status":"start","queue_duration_s":1.934088,"scheduling_latency_s":1.934115}2119gitlab # [ 285.161509] gitaly[927]: time="2026-08-11T11:39:28.498Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:39:58.497" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:28.497" grpc.time_ms=0.744 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2120gitlab # [ 285.162378] gitaly[927]: time="2026-08-11T11:39:28.513Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T11:39:38.010" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:28.500" grpc.time_ms=12.434 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2121gitlab # [ 285.163236] gitaly[927]: time="2026-08-11T11:39:28.606Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T11:39:58.604" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:28.605" grpc.time_ms=1.217 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2122gitlab # [ 285.164231] gitaly[927]: time="2026-08-11T11:39:28.612Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=116 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-11T11:39:58.609" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:28.609" grpc.time_ms=2.708 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2123gitlab # [ 285.233056] gitaly[927]: time="2026-08-11T11:39:28.699Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T11:39:38.197" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:28.688" grpc.time_ms=11.688 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2124gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'2125gitlab # [ 285.459991] nixbot[2776]: INFO: ::ffff:127.0.0.1:39626 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK2126gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.06 seconds)2127gitlab # [ 285.672665] gitaly[927]: time="2026-08-11T11:39:29.229Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=967 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=3 command.system_time_ms=12 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-11T11:39:59.206" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:29.206" grpc.time_ms=22.82 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2128gitlab # [ 285.695446] gitaly[927]: time="2026-08-11T11:39:29.253Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VQ8VQYVBZR9AXFHRZJGR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-11T11:39:59.235" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:29.235" grpc.time_ms=17.358 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2129gitlab # [ 285.739477] sidekiq-cluster[2726]: {"severity":"WARN","time":"2026-08-11T11:39:29.296Z","class":"CreatePipelineWorker","correlation_id":"01KZR9VQ8VQYVBZR9AXFHRZJGR","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"4e3c03ae7d5f74718228646f4699aec07988098e","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"4e3c03ae7d5f74718228646f4699aec07988098e","ref":"refs/heads/master"},"retry":0}2130gitlab # [ 285.749160] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:29.307Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"a5a24e0d33de722e02126e15","created_at":"2026-08-11T11:39:26.526Z","trace_propagation_headers":{"sentry-trace":"0ab5930d981b4a32a3ed5c6fd957da36-d5a9c4b5fd764b92","baggage":"sentry-trace_id=0ab5930d981b4a32a3ed5c6fd957da36,sentry-release=Unknown"},"correlation_id":"01KZR9VQ8VQYVBZR9AXFHRZJGR","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8f51665a025c1d6035f848ea7724bff303b988b47cd62d599799461bf4297fd5","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:26.536Z","job_size_bytes":467,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-a5a24e0d33de722e02126e15: done: 0.836443 sec","job_status":"done","queue_duration_s":1.934088,"scheduling_latency_s":1.934115,"gitaly_calls":7,"gitaly_duration_s":0.09008,"redis_calls":51,"redis_duration_s":0.017176,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001617,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.007736,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002177,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004165,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001481,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.654629,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000594489,"duration_s":0.836443,"completed_at":"2026-08-11T11:39:29.307Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.066212,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2131gitlab # [ 285.828686] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:29.309Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"54c8e678-f493-469f-8950-3bea7226484e\"}"],"class":"WebHookWorker","jid":"da745c67947f711854b0b9fc","created_at":"2026-08-11T11:39:26.652Z","trace_propagation_headers":{"sentry-trace":"0ab5930d981b4a32a3ed5c6fd957da36-d5a9c4b5fd764b92","baggage":"sentry-trace_id=0ab5930d981b4a32a3ed5c6fd957da36,sentry-release=Unknown"},"correlation_id":"01KZR9VQ8VQYVBZR9AXFHRZJGR","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:47fad661d1c2b79658c5e00e2928f3faa793bc3e25eb69e7ca9416e21d8bc7af","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:26.659Z","job_size_bytes":1751,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-da745c67947f711854b0b9fc: start","job_status":"start","queue_duration_s":2.650047,"scheduling_latency_s":2.650069}2132gitlab # [ 285.853869] nixbot[2776]: INFO: ::ffff:127.0.0.1:39636 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2133gitlab # [ 285.875209] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:29.433Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"54c8e678-f493-469f-8950-3bea7226484e\"}"],"class":"WebHookWorker","jid":"da745c67947f711854b0b9fc","created_at":"2026-08-11T11:39:26.652Z","trace_propagation_headers":{"sentry-trace":"0ab5930d981b4a32a3ed5c6fd957da36-d5a9c4b5fd764b92","baggage":"sentry-trace_id=0ab5930d981b4a32a3ed5c6fd957da36,sentry-release=Unknown"},"correlation_id":"01KZR9VQ8VQYVBZR9AXFHRZJGR","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:47fad661d1c2b79658c5e00e2928f3faa793bc3e25eb69e7ca9416e21d8bc7af","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:26.659Z","job_size_bytes":1751,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-da745c67947f711854b0b9fc: done: 0.123875 sec","job_status":"done","queue_duration_s":2.650047,"scheduling_latency_s":2.650069,"redis_calls":19,"redis_duration_s":0.007011,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001507,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000475,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002809,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00222,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.036914189000015085,"cpu_s":0.070466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000859886,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.123875,"completed_at":"2026-08-11T11:39:29.433Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003763,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2134gitlab # [ 285.946968] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:29.438Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"c6d1ea8caeb721c2323f574c","created_at":"2026-08-11T11:39:26.968Z","trace_propagation_headers":{"sentry-trace":"e2df42d0abe9481daa23b45607e273c0-99a13943689a4f14","baggage":"sentry-trace_id=e2df42d0abe9481daa23b45607e273c0,sentry-release=Unknown"},"correlation_id":"01KZR9VV8PEAXSH4B46318DFV0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"58b4274637e82b81dfd160b2","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:26.972Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-c6d1ea8caeb721c2323f574c: start","job_status":"start","queue_duration_s":2.466472,"scheduling_latency_s":2.466497}2135gitlab # [ 285.948389] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:29.487Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"c6d1ea8caeb721c2323f574c","created_at":"2026-08-11T11:39:26.968Z","trace_propagation_headers":{"sentry-trace":"e2df42d0abe9481daa23b45607e273c0-99a13943689a4f14","baggage":"sentry-trace_id=e2df42d0abe9481daa23b45607e273c0,sentry-release=Unknown"},"correlation_id":"01KZR9VV8PEAXSH4B46318DFV0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"58b4274637e82b81dfd160b2","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:26.972Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-c6d1ea8caeb721c2323f574c: done: 0.048674 sec","job_status":"done","queue_duration_s":2.466472,"scheduling_latency_s":2.466497,"gitaly_calls":1,"gitaly_duration_s":0.015497,"redis_calls":12,"redis_duration_s":0.004691,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001753,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000661,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002277,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.026870734,"duration_s":0.048674,"completed_at":"2026-08-11T11:39:29.487Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005724,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2136gitlab # [ 286.024131] gitaly[927]: time="2026-08-11T11:39:29.472Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 diskcache=3551ab49-95e0-4240-8406-c46cffc83486 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T17:39:29.458" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:29.459" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2137gitlab # [ 286.025227] gitaly[927]: time="2026-08-11T11:39:29.472Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=320 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T17:39:29.458" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:29.459" grpc.time_ms=12.582 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2138gitlab # [ 286.026145] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:29.489Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"6defa47e5bee17d8484102af","created_at":"2026-08-11T11:39:27.191Z","trace_propagation_headers":{"sentry-trace":"e2df42d0abe9481daa23b45607e273c0-99a13943689a4f14","baggage":"sentry-trace_id=e2df42d0abe9481daa23b45607e273c0,sentry-release=Unknown"},"correlation_id":"01KZR9VV8PEAXSH4B46318DFV0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ce3d8b45d2e1605219814b8e251d5b7e111afe7e761451ba3048a9a5e79fdc27","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.195Z","job_size_bytes":467,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-6defa47e5bee17d8484102af: start","job_status":"start","queue_duration_s":2.293484,"scheduling_latency_s":2.293507}2139gitlab # [ 286.100235] gitaly[927]: time="2026-08-11T11:39:29.530Z" level=info msg="finished unary call with code OK" catfile.duration_ms=18 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=18 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:39:59.510" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:29.511" grpc.time_ms=18.542 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2140gitlab # [ 286.101432] gitaly[927]: time="2026-08-11T11:39:29.538Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T11:39:39.042" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:29.532" grpc.time_ms=5.83 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2141gitlab # [ 286.102242] gitaly[927]: time="2026-08-11T11:39:29.565Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T11:39:59.564" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:29.565" grpc.time_ms=0.801 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2142gitlab # [ 286.103135] gitaly[927]: time="2026-08-11T11:39:29.570Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=84 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-11T11:39:59.568" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:29.568" grpc.time_ms=2.477 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2143gitlab # [ 286.174614] gitaly[927]: time="2026-08-11T11:39:29.596Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T11:39:39.098" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:29.589" grpc.time_ms=7.426 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2144gitlab # [ 286.221743] gitaly[927]: time="2026-08-11T11:39:29.779Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=249 command.spawn_token_fork_ms=244 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9XNSBWTPAWZYX6AVYCZ81 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:39:29.528" grpc.time_ms=251.764 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc2145gitlab # [ 286.244057] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:39:29 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 3502146gitlab # [ 286.365912] gitaly[927]: time="2026-08-11T11:39:29.924Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=969 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-11T11:39:59.004" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:29.905" grpc.time_ms=16.737 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2147gitlab # [ 286.379558] gitaly[927]: time="2026-08-11T11:39:29.937Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR9VV8PEAXSH4B46318DFV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-11T11:39:59.027" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:29.927" grpc.time_ms=9.988 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2148gitlab # [ 286.390314] sidekiq-cluster[2726]: {"severity":"WARN","time":"2026-08-11T11:39:29.948Z","class":"CreatePipelineWorker","correlation_id":"01KZR9VV8PEAXSH4B46318DFV0","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"4e3c03ae7d5f74718228646f4699aec07988098e","after":"57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c","ref":"refs/heads/master"},"retry":0}2149gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'2150gitlab # [ 286.395475] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:29.953Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"6defa47e5bee17d8484102af","created_at":"2026-08-11T11:39:27.191Z","trace_propagation_headers":{"sentry-trace":"e2df42d0abe9481daa23b45607e273c0-99a13943689a4f14","baggage":"sentry-trace_id=e2df42d0abe9481daa23b45607e273c0,sentry-release=Unknown"},"correlation_id":"01KZR9VV8PEAXSH4B46318DFV0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ce3d8b45d2e1605219814b8e251d5b7e111afe7e761451ba3048a9a5e79fdc27","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.195Z","job_size_bytes":467,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-6defa47e5bee17d8484102af: done: 0.464156 sec","job_status":"done","queue_duration_s":2.293484,"scheduling_latency_s":2.293507,"gitaly_calls":7,"gitaly_duration_s":0.079499,"redis_calls":33,"redis_duration_s":0.007724,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.00071,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00128,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004373,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001361,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.359867,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.464156,"completed_at":"2026-08-11T11:39:29.953Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016422,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2151gitlab # [ 286.497501] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:29.955Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"8806a9ae-a728-49d2-bc0a-fbfdea18e8cd\"}"],"class":"WebHookWorker","jid":"0b70e924cdb02907ea4e7e9d","created_at":"2026-08-11T11:39:27.223Z","trace_propagation_headers":{"sentry-trace":"e2df42d0abe9481daa23b45607e273c0-99a13943689a4f14","baggage":"sentry-trace_id=e2df42d0abe9481daa23b45607e273c0,sentry-release=Unknown"},"correlation_id":"01KZR9VV8PEAXSH4B46318DFV0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4a96cba4b8a1f17e9975af96ececb61446c39a21cc56fac0b12335dfad54dfd6","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.227Z","job_size_bytes":1749,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-0b70e924cdb02907ea4e7e9d: start","job_status":"start","queue_duration_s":2.727838,"scheduling_latency_s":2.727865}2152gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.07 seconds)2153gitlab # [ 286.527720] gitaly[927]: time="2026-08-11T11:39:30.085Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XP4FBAJRMWTZQCPFMZ54 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:39:29.921" pid=927 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2154gitlab # [ 286.529195] gitaly[927]: time="2026-08-11T11:39:30.086Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=160 command.spawn_token_fork_ms=155 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XP4FBAJRMWTZQCPFMZ54 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:39:29.921" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc2155gitlab # [ 286.530226] gitlab-workhorse[828]: time="2026-08-11T11:39:30Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672156gitlab # [ 286.531067] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:39:30 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 2792157gitlab # [ 286.531942] gitaly[927]: time="2026-08-11T11:39:30.086Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=160 command.spawn_token_fork_ms=155 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XP4FBAJRMWTZQCPFMZ54 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:39:29.921" grpc.time_ms=164.794 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc2158gitlab # [ 286.541603] nixbot[2776]: INFO: ::ffff:127.0.0.1:39664 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK2159gitlab # [ 286.607599] nixbot[2776]: INFO: ::ffff:127.0.0.1:39648 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2160gitlab # [ 286.623528] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.181Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"8806a9ae-a728-49d2-bc0a-fbfdea18e8cd\"}"],"class":"WebHookWorker","jid":"0b70e924cdb02907ea4e7e9d","created_at":"2026-08-11T11:39:27.223Z","trace_propagation_headers":{"sentry-trace":"e2df42d0abe9481daa23b45607e273c0-99a13943689a4f14","baggage":"sentry-trace_id=e2df42d0abe9481daa23b45607e273c0,sentry-release=Unknown"},"correlation_id":"01KZR9VV8PEAXSH4B46318DFV0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4a96cba4b8a1f17e9975af96ececb61446c39a21cc56fac0b12335dfad54dfd6","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.227Z","job_size_bytes":1749,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-0b70e924cdb02907ea4e7e9d: done: 0.226118 sec","job_status":"done","queue_duration_s":2.727838,"scheduling_latency_s":2.727865,"redis_calls":14,"redis_duration_s":0.0034539999999999996,"redis_read_bytes":26,"redis_write_bytes":4683,"redis_queues_calls":2,"redis_queues_duration_s":0.000437,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3727,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002041,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.19407075500004112,"cpu_s":0.024105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.226118,"completed_at":"2026-08-11T11:39:30.181Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001704,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2161gitlab # [ 286.695220] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.183Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"08847c98d5542afd58f07f0a","created_at":"2026-08-11T11:39:27.680Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.685Z","job_size_bytes":23,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-08847c98d5542afd58f07f0a: start","job_status":"start","queue_duration_s":2.497742,"scheduling_latency_s":2.497772}2162gitlab # [ 286.695879] nixbot[2776]: {"ts": "2026-08-11T11:39:30.184Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2163gitlab # [ 286.698671] gitaly[927]: time="2026-08-11T11:39:30.254Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9XPGCFT4R3397WX7XVJNZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:39:30.245" grpc.time_ms=8.41 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc2164gitlab # [ 286.699748] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:39:30 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 662165gitlab # [ 286.718772] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.276Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"08847c98d5542afd58f07f0a","created_at":"2026-08-11T11:39:27.680Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.685Z","job_size_bytes":23,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-08847c98d5542afd58f07f0a: done: 0.09303 sec","job_status":"done","queue_duration_s":2.497742,"scheduling_latency_s":2.497772,"redis_calls":10,"redis_duration_s":0.003938,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000552,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002761,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000625,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000426032,"duration_s":0.09303,"completed_at":"2026-08-11T11:39:30.276Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019114,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2166gitlab # [ 286.803916] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.278Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2442f0daf30db873821c6b8f","created_at":"2026-08-11T11:39:27.881Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.890Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2442f0daf30db873821c6b8f: start","job_status":"start","queue_duration_s":2.388105,"scheduling_latency_s":2.388128}2167gitlab # [ 286.805212] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.310Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2442f0daf30db873821c6b8f","created_at":"2026-08-11T11:39:27.881Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.890Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2442f0daf30db873821c6b8f: done: 0.032419 sec","job_status":"done","queue_duration_s":2.388105,"scheduling_latency_s":2.388128,"redis_calls":10,"redis_duration_s":0.002542,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000505,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001545,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000427708,"duration_s":0.032419,"completed_at":"2026-08-11T11:39:30.310Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004279,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2168gitlab # [ 286.875370] gitaly[927]: time="2026-08-11T11:39:30.281Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XPGMDZ1P7MPFMFGHB6EJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:40:00.076" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:30.276" grpc.time_ms=3.931 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2169gitlab # [ 286.877120] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.312Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9617989162c8a298c0d712c2","created_at":"2026-08-11T11:39:27.906Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.917Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-9617989162c8a298c0d712c2: start","job_status":"start","queue_duration_s":2.395048,"scheduling_latency_s":2.39507}2170gitlab # [ 286.888048] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.340Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9617989162c8a298c0d712c2","created_at":"2026-08-11T11:39:27.906Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.917Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-9617989162c8a298c0d712c2: done: 0.028405 sec","job_status":"done","queue_duration_s":2.395048,"scheduling_latency_s":2.39507,"redis_calls":10,"redis_duration_s":0.0022789999999999998,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000502,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001338,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000439,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000366527,"duration_s":0.028405,"completed_at":"2026-08-11T11:39:30.340Z","load_balancing_strategy":"primary","db_duration_s":0.004312,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2171gitlab # [ 286.956216] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.342Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"2a8befbd01b2ceb4502e0dbb","created_at":"2026-08-11T11:39:27.936Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.941Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-2a8befbd01b2ceb4502e0dbb: start","job_status":"start","queue_duration_s":2.401201,"scheduling_latency_s":2.401221}2172gitlab # [ 287.023282] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.373Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"2a8befbd01b2ceb4502e0dbb","created_at":"2026-08-11T11:39:27.936Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.941Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-2a8befbd01b2ceb4502e0dbb: done: 0.031378 sec","job_status":"done","queue_duration_s":2.401201,"scheduling_latency_s":2.401221,"redis_calls":13,"redis_duration_s":0.003519,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000731,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001397,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00091,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000481,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020156,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000376025,"duration_s":0.031378,"completed_at":"2026-08-11T11:39:30.373Z","load_balancing_strategy":"primary","db_duration_s":0.00442,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2173gitlab # [ 287.092301] gitlab-workhorse[828]: time="2026-08-11T11:39:30Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672174gitlab # [ 287.093698] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:39:30 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 662175gitlab # [ 287.095582] gitaly[927]: time="2026-08-11T11:39:30.466Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XPQ15402GBNSPAGMGP4D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:39:30.456" pid=927 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2176gitlab # [ 287.097057] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.446Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"ec7dc8e032287c57e5e476e0","created_at":"2026-08-11T11:39:27.941Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.945Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-ec7dc8e032287c57e5e476e0: start","job_status":"start","queue_duration_s":2.501535,"scheduling_latency_s":2.50157}2177gitlab # [ 287.097927] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.485Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"ec7dc8e032287c57e5e476e0","created_at":"2026-08-11T11:39:27.941Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.945Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-ec7dc8e032287c57e5e476e0: done: 0.038518 sec","job_status":"done","queue_duration_s":2.501535,"scheduling_latency_s":2.50157,"redis_calls":10,"redis_duration_s":0.0031379999999999997,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001166,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001483,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000489,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000380216,"duration_s":0.038518,"completed_at":"2026-08-11T11:39:30.485Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005674,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2178gitlab # [ 287.173263] gitaly[927]: time="2026-08-11T11:39:30.466Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XPQ15402GBNSPAGMGP4D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:39:30.456" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc2179gitlab # [ 287.246477] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.487Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"95ace4ac7976b38a329381a8","created_at":"2026-08-11T11:39:27.946Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.955Z","job_size_bytes":19,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-95ace4ac7976b38a329381a8: start","job_status":"start","queue_duration_s":2.532079,"scheduling_latency_s":2.532104}2180gitlab # [ 287.247900] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.513Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"95ace4ac7976b38a329381a8","created_at":"2026-08-11T11:39:27.946Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.955Z","job_size_bytes":19,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-95ace4ac7976b38a329381a8: done: 0.026457 sec","job_status":"done","queue_duration_s":2.532079,"scheduling_latency_s":2.532104,"redis_calls":11,"redis_duration_s":0.002497,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000424,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001611,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000462,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000382171,"duration_s":0.026457,"completed_at":"2026-08-11T11:39:30.513Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003083,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2181gitlab # [ 287.321393] gitaly[927]: time="2026-08-11T11:39:30.468Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XPQ15402GBNSPAGMGP4D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:39:30.456" grpc.time_ms=10.098 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc2182gitlab # [ 287.322935] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.516Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"228733b5d9973b3d4a25fe11","created_at":"2026-08-11T11:39:27.962Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.972Z","job_size_bytes":66,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-228733b5d9973b3d4a25fe11: start","job_status":"start","queue_duration_s":2.544098,"scheduling_latency_s":2.54412}2183gitlab # [ 287.326405] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.553Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"228733b5d9973b3d4a25fe11","created_at":"2026-08-11T11:39:27.962Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.972Z","job_size_bytes":66,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-228733b5d9973b3d4a25fe11: done: 0.036727 sec","job_status":"done","queue_duration_s":2.544098,"scheduling_latency_s":2.54412,"redis_calls":10,"redis_duration_s":0.002378,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000501,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001401,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000476,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000379098,"duration_s":0.036727,"completed_at":"2026-08-11T11:39:30.553Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011986,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2184gitlab # [ 287.403882] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.554Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"1b8393d6b3ee7ff13b32cea7","created_at":"2026-08-11T11:39:27.974Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.982Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-1b8393d6b3ee7ff13b32cea7: start","job_status":"start","queue_duration_s":2.572119,"scheduling_latency_s":2.572141}2185gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'2186gitlab # [ 287.473170] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.590Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"1b8393d6b3ee7ff13b32cea7","created_at":"2026-08-11T11:39:27.974Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.982Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-1b8393d6b3ee7ff13b32cea7: done: 0.035327 sec","job_status":"done","queue_duration_s":2.572119,"scheduling_latency_s":2.572141,"redis_calls":10,"redis_duration_s":0.002348,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00047,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001383,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000495,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000380495,"duration_s":0.035327,"completed_at":"2026-08-11T11:39:30.590Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006361,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2187gitlab # [ 287.547106] gitaly[927]: time="2026-08-11T11:39:30.901Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR9XPGMDZ1P7MPFMFGHB6EJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T11:39:40.014" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:30.894" grpc.time_ms=6.142 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2188gitlab # [ 287.548792] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:39:30 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4e3c03ae7d5f74718228646f4699aec07988098e HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 7652189gitlab # [ 287.549675] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:39:31 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4e3c03ae7d5f74718228646f4699aec07988098e HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1332190gitlab # [ 287.551453] nixbot[2776]: {"ts": "2026-08-11T11:39:30.963Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4e3c03ae7d5f74718228646f4699aec07988098e \"HTTP/1.1 201 Created\""}2191gitlab # [ 287.552329] nixbot[2776]: {"ts": "2026-08-11T11:39:31.102Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4e3c03ae7d5f74718228646f4699aec07988098e \"HTTP/1.1 201 Created\""}2192gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.06 seconds)2193gitlab # [ 287.553305] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.591Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"af742b3c9e1552f4e774b18a","created_at":"2026-08-11T11:39:27.989Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.992Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-af742b3c9e1552f4e774b18a: start","job_status":"start","queue_duration_s":2.599159,"scheduling_latency_s":2.599181}2194gitlab # [ 287.555826] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.627Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"af742b3c9e1552f4e774b18a","created_at":"2026-08-11T11:39:27.989Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.992Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-af742b3c9e1552f4e774b18a: done: 0.036281 sec","job_status":"done","queue_duration_s":2.599159,"scheduling_latency_s":2.599181,"redis_calls":10,"redis_duration_s":0.002478,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000505,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001475,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000498,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000367086,"duration_s":0.036281,"completed_at":"2026-08-11T11:39:30.627Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007728,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2195gitlab # [ 287.640078] gitaly[927]: time="2026-08-11T11:39:31.016Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XQ8QEJ3RDN2A67FM5TJ6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:40:01.014" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:31.015" grpc.time_ms=0.829 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2196gitlab # [ 287.641666] nixbot[2776]: INFO: ::ffff:127.0.0.1:39680 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK2197gitlab # [ 287.643840] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.629Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"d2ed3b3bb079068a22ffba2b","created_at":"2026-08-11T11:39:27.992Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.997Z","job_size_bytes":6,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-d2ed3b3bb079068a22ffba2b: start","job_status":"start","queue_duration_s":2.632357,"scheduling_latency_s":2.632383}2198gitlab # [ 287.713437] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.651Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"d2ed3b3bb079068a22ffba2b","created_at":"2026-08-11T11:39:27.992Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:27.997Z","job_size_bytes":6,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-d2ed3b3bb079068a22ffba2b: done: 0.021724 sec","job_status":"done","queue_duration_s":2.632357,"scheduling_latency_s":2.632383,"redis_calls":10,"redis_duration_s":0.002118,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000404,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001274,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00044,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000353676,"duration_s":0.021724,"completed_at":"2026-08-11T11:39:30.651Z","load_balancing_strategy":"primary","db_duration_s":0.001699,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2199gitlab # [ 287.783124] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:39:31 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 4442200gitlab # [ 287.784616] gitlab-workhorse[828]: time="2026-08-11T11:39:31Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162201gitlab # [ 287.785624] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:39:31 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 752202gitlab # [ 287.787054] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:39:31 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4e3c03ae7d5f74718228646f4699aec07988098e HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1482203gitlab # [ 287.789702] gitaly[927]: time="2026-08-11T11:39:31.052Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR9XQ8QEJ3RDN2A67FM5TJ6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T11:39:41.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:31.044" grpc.time_ms=7.676 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2204gitlab # [ 287.790952] gitaly[927]: time="2026-08-11T11:39:31.101Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9XPGMDZ1P7MPFMFGHB6EJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:39:31.100" grpc.time_ms=1.674 pid=927 span.kind=server system=grpc2205gitlab # [ 287.791813] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.655Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"add30e07ef40d532d1fa91d1","created_at":"2026-08-11T11:39:27.997Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:28.001Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-add30e07ef40d532d1fa91d1: start","job_status":"start","queue_duration_s":2.654089,"scheduling_latency_s":2.654113}2206gitlab # [ 287.862563] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.694Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"add30e07ef40d532d1fa91d1","created_at":"2026-08-11T11:39:27.997Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:28.001Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-add30e07ef40d532d1fa91d1: done: 0.039026 sec","job_status":"done","queue_duration_s":2.654089,"scheduling_latency_s":2.654113,"redis_calls":10,"redis_duration_s":0.003644,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000595,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002062,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000987,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000406197,"duration_s":0.039026,"completed_at":"2026-08-11T11:39:30.694Z","load_balancing_strategy":"primary","db_duration_s":0.006705,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2207gitlab # [ 287.932235] nixbot[2776]: {"ts": "2026-08-11T11:39:31.261Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4e3c03ae7d5f74718228646f4699aec07988098e \"HTTP/1.1 201 Created\""}2208gitlab # [ 287.934513] gitaly[927]: time="2026-08-11T11:39:31.132Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9XPGMDZ1P7MPFMFGHB6EJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:39:31.131" grpc.time_ms=0.322 pid=927 span.kind=server system=grpc2209gitlab # [ 287.935742] gitaly[927]: time="2026-08-11T11:39:31.143Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=394 command.spawn_token_fork_ms=386 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9XQ0BJXNX5AXJ5XJBK4HR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:39:30.746" grpc.time_ms=396.63 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc2210gitlab # [ 287.941050] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.696Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"1aab44e0ec25021b87ec9f5e","created_at":"2026-08-11T11:39:28.007Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:28.012Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-1aab44e0ec25021b87ec9f5e: start","job_status":"start","queue_duration_s":2.68346,"scheduling_latency_s":2.683483}2211gitlab # [ 287.942119] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.762Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"1aab44e0ec25021b87ec9f5e","created_at":"2026-08-11T11:39:28.007Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:28.012Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-1aab44e0ec25021b87ec9f5e: done: 0.065954 sec","job_status":"done","queue_duration_s":2.68346,"scheduling_latency_s":2.683483,"redis_calls":14,"redis_duration_s":0.0056110000000000005,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000561,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002343,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002707,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000514869,"duration_s":0.065954,"completed_at":"2026-08-11T11:39:30.762Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012413,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2212gitlab # [ 288.021267] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:39:31 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 612213gitlab # [ 288.023651] gitlab-workhorse[828]: time="2026-08-11T11:39:31Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672214gitlab # [ 288.024776] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:39:31 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 642215gitlab # [ 288.026054] gitaly[927]: time="2026-08-11T11:39:31.177Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XQD83YG3VQWD4AJW3D56 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:40:01.175" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:31.176" grpc.time_ms=0.632 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2216gitlab # [ 288.093502] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.763Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"f41178435a159b4fc375eb60","created_at":"2026-08-11T11:39:28.189Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:28.193Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f41178435a159b4fc375eb60: start","job_status":"start","queue_duration_s":2.570729,"scheduling_latency_s":2.570765}2217gitlab # [ 288.094673] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.791Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"f41178435a159b4fc375eb60","created_at":"2026-08-11T11:39:28.189Z","trace_propagation_headers":{"sentry-trace":"bfca57fd00084d82b06dd1183dc6159c-37b41534833f4c9c","baggage":"sentry-trace_id=bfca57fd00084d82b06dd1183dc6159c,sentry-release=Unknown"},"correlation_id":"01KZR9VWXPR895KAS8CNF3R3GR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:28.193Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f41178435a159b4fc375eb60: done: 0.02743 sec","job_status":"done","queue_duration_s":2.570729,"scheduling_latency_s":2.570765,"redis_calls":8,"redis_duration_s":0.002124,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001678,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000446,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018618,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02743,"completed_at":"2026-08-11T11:39:30.791Z","load_balancing_strategy":"primary","db_duration_s":0.004212,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2218gitlab # [ 288.163259] gitaly[927]: time="2026-08-11T11:39:31.213Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9XQD83YG3VQWD4AJW3D56 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T11:39:41.166" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:31.206" grpc.time_ms=6.694 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2219gitlab # [ 288.213230] nix-daemon[2988]: accepted connection from pid 3552, user nixbot2220gitlab # [ 288.214460] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.793Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"6549eb2f004cd28274b5e0e7","created_at":"2026-08-11T11:39:28.296Z","trace_propagation_headers":{"sentry-trace":"0ab5930d981b4a32a3ed5c6fd957da36-113162fe17ca4496","baggage":"sentry-trace_id=0ab5930d981b4a32a3ed5c6fd957da36,sentry-release=Unknown"},"correlation_id":"01KZR9VQ8VQYVBZR9AXFHRZJGR","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:28.301Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-6549eb2f004cd28274b5e0e7: start","job_status":"start","queue_duration_s":2.492186,"scheduling_latency_s":2.492215}2221gitlab # [ 288.217079] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.844Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"6549eb2f004cd28274b5e0e7","created_at":"2026-08-11T11:39:28.296Z","trace_propagation_headers":{"sentry-trace":"0ab5930d981b4a32a3ed5c6fd957da36-113162fe17ca4496","baggage":"sentry-trace_id=0ab5930d981b4a32a3ed5c6fd957da36,sentry-release=Unknown"},"correlation_id":"01KZR9VQ8VQYVBZR9AXFHRZJGR","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:28.301Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-6549eb2f004cd28274b5e0e7: done: 0.050875 sec","job_status":"done","queue_duration_s":2.492186,"scheduling_latency_s":2.492215,"redis_calls":19,"redis_duration_s":0.0059169999999999995,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002668,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000565,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001964,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00072,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033238,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.007957435,"duration_s":0.050875,"completed_at":"2026-08-11T11:39:30.844Z","load_balancing_strategy":"primary","db_duration_s":0.007803,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2222gitlab # [ 288.241851] gitaly[927]: time="2026-08-11T11:39:31.223Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XQEFA0BNX4884M77H5NJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:39:31.206" pid=927 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2223gitlab # [ 288.313674] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.845Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","da745c67947f711854b0b9fc"],"class":"WebHooks::LogExecutionWorker","jid":"1de5cdd19256d9baa582f3d2","created_at":"2026-08-11T11:39:29.415Z","trace_propagation_headers":{"sentry-trace":"0ab5930d981b4a32a3ed5c6fd957da36-63c8413581a74ac5","baggage":"sentry-trace_id=0ab5930d981b4a32a3ed5c6fd957da36,sentry-release=Unknown"},"correlation_id":"01KZR9VQ8VQYVBZR9AXFHRZJGR","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4706f1e3401b7c1d41edc446bf2b612d42605dc1c5044b26b49af97b2e485e94","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:29.422Z","job_size_bytes":2593,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-1de5cdd19256d9baa582f3d2: start","job_status":"start","queue_duration_s":1.423239,"scheduling_latency_s":1.423264}2224gitlab # [ 288.315242] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.889Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","da745c67947f711854b0b9fc"],"class":"WebHooks::LogExecutionWorker","jid":"1de5cdd19256d9baa582f3d2","created_at":"2026-08-11T11:39:29.415Z","trace_propagation_headers":{"sentry-trace":"0ab5930d981b4a32a3ed5c6fd957da36-63c8413581a74ac5","baggage":"sentry-trace_id=0ab5930d981b4a32a3ed5c6fd957da36,sentry-release=Unknown"},"correlation_id":"01KZR9VQ8VQYVBZR9AXFHRZJGR","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4706f1e3401b7c1d41edc446bf2b612d42605dc1c5044b26b49af97b2e485e94","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:29.422Z","job_size_bytes":2593,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-1de5cdd19256d9baa582f3d2: done: 0.043155 sec","job_status":"done","queue_duration_s":1.423239,"scheduling_latency_s":1.423264,"redis_calls":10,"redis_duration_s":0.005475,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00039,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004233,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000852,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000835022,"duration_s":0.043155,"completed_at":"2026-08-11T11:39:30.888Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005978,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2225gitlab # [ 288.415499] gitaly[927]: time="2026-08-11T11:39:31.223Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XQEFA0BNX4884M77H5NJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:39:31.206" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc2226gitlab # [ 288.416964] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.892Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","0b70e924cdb02907ea4e7e9d"],"class":"WebHooks::LogExecutionWorker","jid":"0ea3053f247e4ef83b658eb0","created_at":"2026-08-11T11:39:30.170Z","trace_propagation_headers":{"sentry-trace":"e2df42d0abe9481daa23b45607e273c0-ecb380cdf4e440e2","baggage":"sentry-trace_id=e2df42d0abe9481daa23b45607e273c0,sentry-release=Unknown"},"correlation_id":"01KZR9VV8PEAXSH4B46318DFV0","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:abc1a4ac314b7ffcc94f3ec6779c1ce844b28f6e3adf411fcb6ad0e531d3963a","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:30.173Z","job_size_bytes":2590,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-0ea3053f247e4ef83b658eb0: start","job_status":"start","queue_duration_s":0.718707,"scheduling_latency_s":0.718731}2227gitlab # [ 288.418076] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.920Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","0b70e924cdb02907ea4e7e9d"],"class":"WebHooks::LogExecutionWorker","jid":"0ea3053f247e4ef83b658eb0","created_at":"2026-08-11T11:39:30.170Z","trace_propagation_headers":{"sentry-trace":"e2df42d0abe9481daa23b45607e273c0-ecb380cdf4e440e2","baggage":"sentry-trace_id=e2df42d0abe9481daa23b45607e273c0,sentry-release=Unknown"},"correlation_id":"01KZR9VV8PEAXSH4B46318DFV0","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:abc1a4ac314b7ffcc94f3ec6779c1ce844b28f6e3adf411fcb6ad0e531d3963a","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:30.173Z","job_size_bytes":2590,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-0ea3053f247e4ef83b658eb0: done: 0.028245 sec","job_status":"done","queue_duration_s":0.718707,"scheduling_latency_s":0.718731,"redis_calls":7,"redis_duration_s":0.0018009999999999999,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001313,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000488,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01803,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028245,"completed_at":"2026-08-11T11:39:30.920Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004168,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2228gitlab # [ 288.485283] gitaly[927]: time="2026-08-11T11:39:31.223Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XQEFA0BNX4884M77H5NJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:39:31.206" grpc.time_ms=17.572 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc2229gitlab # [ 288.489175] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:30.921Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"d1f323dcbbfa06c407838c90","created_at":"2026-08-11T11:39:30.829Z","trace_propagation_headers":{"sentry-trace":"0ab5930d981b4a32a3ed5c6fd957da36-a27ea4b20b9f40b0","baggage":"sentry-trace_id=0ab5930d981b4a32a3ed5c6fd957da36,sentry-release=Unknown"},"correlation_id":"01KZR9VQ8VQYVBZR9AXFHRZJGR","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:30.835Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-d1f323dcbbfa06c407838c90: start","job_status":"start","queue_duration_s":0.086776,"scheduling_latency_s":0.086801}2230gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c'2231gitlab # [ 288.558140] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.001Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"d1f323dcbbfa06c407838c90","created_at":"2026-08-11T11:39:30.829Z","trace_propagation_headers":{"sentry-trace":"0ab5930d981b4a32a3ed5c6fd957da36-a27ea4b20b9f40b0","baggage":"sentry-trace_id=0ab5930d981b4a32a3ed5c6fd957da36,sentry-release=Unknown"},"correlation_id":"01KZR9VQ8VQYVBZR9AXFHRZJGR","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:30.835Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-d1f323dcbbfa06c407838c90: done: 0.080036 sec","job_status":"done","queue_duration_s":0.086776,"scheduling_latency_s":0.086801,"redis_calls":11,"redis_duration_s":0.0029620000000000002,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000467,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002037,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000458,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000572698,"duration_s":0.080036,"completed_at":"2026-08-11T11:39:31.001Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018106,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2232gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', in 0.05 seconds)2233(finished: subtest: push delivers the webhook, in 62.88 seconds)2234subtest: eval and build post commit statuses2235gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c/statuses2236gitlab # [ 288.630313] gitaly[927]: time="2026-08-11T11:39:31.297Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9XPGMDZ1P7MPFMFGHB6EJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:39:31.296" grpc.time_ms=0.457 pid=927 span.kind=server system=grpc2237gitlab # [ 288.634438] gitaly[927]: time="2026-08-11T11:39:31.306Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XPGMDZ1P7MPFMFGHB6EJ diskcache=088b5f88-df82-46ef-bcb9-3b2760ba034e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T11:40:01.074" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:31.074" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2238gitlab # [ 288.641189] nixbot[2776]: {"ts": "2026-08-11T11:39:32.133Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c \"HTTP/1.1 201 Created\""}2239gitlab # [ 288.641972] nixbot[2776]: {"ts": "2026-08-11T11:39:32.142Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-57f1ed8cbfeb-3"}2240gitlab # [ 288.646250] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.003Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"702163b7fade224bc26311f0","created_at":"2026-08-11T11:39:30.935Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-84e2965532d34451","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:30.942Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-702163b7fade224bc26311f0: start","job_status":"start","queue_duration_s":0.061288,"scheduling_latency_s":0.061314}2241gitlab # [ 288.647667] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.417Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"c08d1b54135dcdad1828d7b1","created_at":"2026-08-11T11:39:31.414Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"702163b7fade224bc26311f0","job_size_bytes":3,"pid":2726,"job_status":"deduplicated","message":"PipelineProcessWorker JID-c08d1b54135dcdad1828d7b1: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2242gitlab # [ 288.718499] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.419Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"702163b7fade224bc26311f0","created_at":"2026-08-11T11:39:30.935Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-84e2965532d34451","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:30.942Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2726,"job_status":"rescheduled","message":"PipelineProcessWorker JID-702163b7fade224bc26311f0: rescheduled"}2243gitlab # [ 288.723590] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:39:32 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 8662244gitlab # [ 288.724791] gitaly[927]: time="2026-08-11T11:39:31.307Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=106 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7266 command.oublock=0 command.real_time_ms=225 command.spawn_token_fork_ms=0 command.system_time_ms=77 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XPGMDZ1P7MPFMFGHB6EJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T11:40:01.074" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:31.074" grpc.time_ms=232.504 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2245gitlab # [ 288.726184] nixbot[2776]: INFO: ::ffff:127.0.0.1:39682 - "GET /api/repos/gitlab/root/test-flake/builds?commit=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 200 OK2246gitlab # [ 288.731136] nixbot[2776]: {"ts": "2026-08-11T11:39:32.270Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-57f1ed8cbfeb-3", "argv0": "bwrap"}2247gitlab # [ 288.732072] nix-daemon[2988]: accepted connection from pid 3612, user nixbot2248gitlab # [ 288.732830] nix-daemon[2988]: accepted connection from pid 3623, user nixbot2249gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c/statuses, in 0.15 seconds)2250gitlab # [ 288.734786] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.428Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"702163b7fade224bc26311f0","created_at":"2026-08-11T11:39:30.935Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-84e2965532d34451","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:30.942Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-702163b7fade224bc26311f0: done: 0.424453 sec","job_status":"done","queue_duration_s":0.061288,"scheduling_latency_s":0.061314,"gitaly_calls":3,"gitaly_duration_s":0.242665,"redis_calls":69,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.024922,"redis_read_bytes":226,"redis_write_bytes":18465,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000537,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001044,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.009009,"redis_queues_read_bytes":24,"redis_queues_write_bytes":12311,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.009976,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000258,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001182,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002379,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.009,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.022,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.124219,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.377940772,"duration_s":0.424453,"completed_at":"2026-08-11T11:39:31.428Z","load_balancing_strategy":"primary","db_duration_s":0.038807,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2251gitlab # [ 288.806423] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.430Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"03a9cfd311f74ee39a28c034","created_at":"2026-08-11T11:39:31.066Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.068Z","job_size_bytes":23,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-03a9cfd311f74ee39a28c034: start","job_status":"start","queue_duration_s":0.361278,"scheduling_latency_s":0.361309}2252gitlab # [ 288.885988] gitaly[927]: time="2026-08-11T11:39:31.322Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XQJ145C6WCGP96FGNDNG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:40:01.120" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:31.321" grpc.time_ms=0.607 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2253gitlab # [ 288.887185] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:39:32 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1262254gitlab # [ 288.888264] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.469Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"03a9cfd311f74ee39a28c034","created_at":"2026-08-11T11:39:31.066Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.068Z","job_size_bytes":23,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-03a9cfd311f74ee39a28c034: done: 0.039261 sec","job_status":"done","queue_duration_s":0.361278,"scheduling_latency_s":0.361309,"redis_calls":7,"redis_duration_s":0.002805,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002269,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000536,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039261,"completed_at":"2026-08-11T11:39:31.469Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006947,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2255gitlab # [ 288.955874] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.470Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"cac41ae8af294c56df977582","created_at":"2026-08-11T11:39:31.313Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.316Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-cac41ae8af294c56df977582: start","job_status":"start","queue_duration_s":0.154445,"scheduling_latency_s":0.154479}2256gitlab # [ 288.957490] gitaly[927]: time="2026-08-11T11:39:31.341Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9XQJ145C6WCGP96FGNDNG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-11T11:40:01.132" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:31.333" grpc.time_ms=7.928 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2257gitlab # [ 288.958337] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.498Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"cac41ae8af294c56df977582","created_at":"2026-08-11T11:39:31.313Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.316Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-cac41ae8af294c56df977582: done: 0.027877 sec","job_status":"done","queue_duration_s":0.154445,"scheduling_latency_s":0.154479,"redis_calls":7,"redis_duration_s":0.002037,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001502,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000535,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027877,"completed_at":"2026-08-11T11:39:31.498Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004421,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2258gitlab # [ 289.030815] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.500Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"5bbbc90016bfdb475016615d","created_at":"2026-08-11T11:39:31.325Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.328Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-5bbbc90016bfdb475016615d: start","job_status":"start","queue_duration_s":0.172434,"scheduling_latency_s":0.172461}2259gitlab # [ 289.098467] gitaly[927]: time="2026-08-11T11:39:31.373Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9XPGMDZ1P7MPFMFGHB6EJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T11:40:01.371" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:31.371" grpc.time_ms=0.815 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2260gitlab # [ 289.100046] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.533Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"5bbbc90016bfdb475016615d","created_at":"2026-08-11T11:39:31.325Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.328Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-5bbbc90016bfdb475016615d: done: 0.033086 sec","job_status":"done","queue_duration_s":0.172434,"scheduling_latency_s":0.172461,"redis_calls":7,"redis_duration_s":0.002642,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002068,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000574,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033086,"completed_at":"2026-08-11T11:39:31.533Z","load_balancing_strategy":"primary","db_duration_s":0.005673,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2261gitlab # [ 289.167425] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.535Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"f5a4e08bb9627181d8e930f9","created_at":"2026-08-11T11:39:31.336Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.339Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f5a4e08bb9627181d8e930f9: start","job_status":"start","queue_duration_s":0.195606,"scheduling_latency_s":0.195639}2262gitlab # [ 289.169081] gitaly[927]: time="2026-08-11T11:39:31.405Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XPGMDZ1P7MPFMFGHB6EJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:40:01.403" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:31.404" grpc.time_ms=1.159 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2263gitlab # [ 289.169772] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.568Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"f5a4e08bb9627181d8e930f9","created_at":"2026-08-11T11:39:31.336Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.339Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f5a4e08bb9627181d8e930f9: done: 0.032609 sec","job_status":"done","queue_duration_s":0.195606,"scheduling_latency_s":0.195639,"redis_calls":10,"redis_duration_s":0.003422,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002265,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000671,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000486,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032609,"completed_at":"2026-08-11T11:39:31.568Z","load_balancing_strategy":"primary","db_duration_s":0.004119,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2264gitlab # [ 289.240297] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.570Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f6c58fd120e8f74eddf02fd7","created_at":"2026-08-11T11:39:31.343Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.344Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f6c58fd120e8f74eddf02fd7: start","job_status":"start","queue_duration_s":0.225834,"scheduling_latency_s":0.22587}2265gitlab # [ 289.320462] gitaly[927]: time="2026-08-11T11:39:31.434Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9XQND16ZWCEQ7PEJ07HXC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:39:31.424" grpc.time_ms=9.391 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc2266gitlab # [ 289.321854] gitaly[927]: time="2026-08-11T11:39:31.500Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XQQD5EEKNWDQSSVFSQZA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:39:31.488" pid=927 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2267gitlab # [ 289.322733] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.601Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f6c58fd120e8f74eddf02fd7","created_at":"2026-08-11T11:39:31.343Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.344Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f6c58fd120e8f74eddf02fd7: done: 0.031595 sec","job_status":"done","queue_duration_s":0.225834,"scheduling_latency_s":0.22587,"redis_calls":7,"redis_duration_s":0.0026260000000000003,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002177,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000449,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031595,"completed_at":"2026-08-11T11:39:31.601Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005586,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2268gitlab # [ 289.409505] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.603Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"6a085684eb786a674524f61d","created_at":"2026-08-11T11:39:31.345Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.349Z","job_size_bytes":19,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-6a085684eb786a674524f61d: start","job_status":"start","queue_duration_s":0.253821,"scheduling_latency_s":0.253857}2269gitlab # [ 289.410937] gitaly[927]: time="2026-08-11T11:39:31.500Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XQQD5EEKNWDQSSVFSQZA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:39:31.488" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc2270gitlab # [ 289.412049] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.630Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"6a085684eb786a674524f61d","created_at":"2026-08-11T11:39:31.345Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.349Z","job_size_bytes":19,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-6a085684eb786a674524f61d: done: 0.026427 sec","job_status":"done","queue_duration_s":0.253821,"scheduling_latency_s":0.253857,"redis_calls":8,"redis_duration_s":0.002156,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001674,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000482,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026427,"completed_at":"2026-08-11T11:39:31.630Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003861,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2271gitlab # [ 289.494324] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.632Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"0bc70f1ce577dc75a3f19a24","created_at":"2026-08-11T11:39:31.351Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.353Z","job_size_bytes":66,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-0bc70f1ce577dc75a3f19a24: start","job_status":"start","queue_duration_s":0.279263,"scheduling_latency_s":0.279296}2272gitlab # [ 289.495939] gitaly[927]: time="2026-08-11T11:39:31.502Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XQQD5EEKNWDQSSVFSQZA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:39:31.488" grpc.time_ms=13.479 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc2273gitlab # [ 289.577229] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.659Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"0bc70f1ce577dc75a3f19a24","created_at":"2026-08-11T11:39:31.351Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.353Z","job_size_bytes":66,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-0bc70f1ce577dc75a3f19a24: done: 0.026811 sec","job_status":"done","queue_duration_s":0.279263,"scheduling_latency_s":0.279296,"redis_calls":7,"redis_duration_s":0.0026620000000000003,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002167,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000495,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026811,"completed_at":"2026-08-11T11:39:31.659Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002823,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2274gitlab # [ 289.647395] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.660Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"1e6f177f4757b0a3019215cb","created_at":"2026-08-11T11:39:31.353Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.355Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-1e6f177f4757b0a3019215cb: start","job_status":"start","queue_duration_s":0.305056,"scheduling_latency_s":0.305086}2275gitlab # [ 289.648985] gitaly[927]: time="2026-08-11T11:39:31.566Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=217 command.spawn_token_fork_ms=209 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR9XQJ145C6WCGP96FGNDNG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T11:39:41.286" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:31.346" grpc.time_ms=219.36 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2276gitlab # [ 289.650086] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.684Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"1e6f177f4757b0a3019215cb","created_at":"2026-08-11T11:39:31.353Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.355Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-1e6f177f4757b0a3019215cb: done: 0.023814 sec","job_status":"done","queue_duration_s":0.305056,"scheduling_latency_s":0.305086,"redis_calls":7,"redis_duration_s":0.0018410000000000002,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001396,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000445,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014256,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023814,"completed_at":"2026-08-11T11:39:31.684Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004686,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2277gitlab # [ 289.719142] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.686Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"4ddb43902c9100dfdd3ed18e","created_at":"2026-08-11T11:39:31.356Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.357Z","job_size_bytes":6,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-4ddb43902c9100dfdd3ed18e: start","job_status":"start","queue_duration_s":0.328623,"scheduling_latency_s":0.328645}2278gitlab # [ 289.720529] gitaly[927]: time="2026-08-11T11:39:31.597Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XQJ145C6WCGP96FGNDNG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T11:39:41.066" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:39:31.597" grpc.time_ms=0.241 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2279gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c/statuses2280gitlab # [ 289.798361] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.700Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"4ddb43902c9100dfdd3ed18e","created_at":"2026-08-11T11:39:31.356Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.357Z","job_size_bytes":6,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-4ddb43902c9100dfdd3ed18e: done: 0.014538 sec","job_status":"done","queue_duration_s":0.328623,"scheduling_latency_s":0.328645,"redis_calls":7,"redis_duration_s":0.002609,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001954,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000655,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014538,"completed_at":"2026-08-11T11:39:31.700Z","load_balancing_strategy":"primary","db_duration_s":0.000392,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2281gitlab # [ 289.799964] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.702Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"b7a1392dfe10ea6f0cfe8682","created_at":"2026-08-11T11:39:31.358Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.360Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-b7a1392dfe10ea6f0cfe8682: start","job_status":"start","queue_duration_s":0.341355,"scheduling_latency_s":0.341377}2282gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c/statuses, in 0.10 seconds)2283gitlab # [ 289.866372] gitaly[927]: time="2026-08-11T11:39:31.608Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XQJ145C6WCGP96FGNDNG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T11:39:41.070" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:31.601" grpc.time_ms=6.868 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2284gitlab # [ 289.867784] gitaly[927]: time="2026-08-11T11:39:31.690Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9XQJ145C6WCGP96FGNDNG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4149 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:39:31.689" grpc.time_ms=0.577 pid=927 span.kind=server system=grpc2285gitlab # [ 289.869269] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.723Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"b7a1392dfe10ea6f0cfe8682","created_at":"2026-08-11T11:39:31.358Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.360Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-b7a1392dfe10ea6f0cfe8682: done: 0.021169 sec","job_status":"done","queue_duration_s":0.341355,"scheduling_latency_s":0.341377,"redis_calls":7,"redis_duration_s":0.00279,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002202,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000588,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021169,"completed_at":"2026-08-11T11:39:31.723Z","load_balancing_strategy":"primary","db_duration_s":0.002823,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2286gitlab # [ 289.938425] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:31.725Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"ad70514fe80fc343011d01ac","created_at":"2026-08-11T11:39:31.419Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.420Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ad70514fe80fc343011d01ac: start","job_status":"start","queue_duration_s":0.3049,"scheduling_latency_s":0.304922}2287gitlab # [ 290.005634] gitaly[927]: time="2026-08-11T11:39:31.775Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9XQJ145C6WCGP96FGNDNG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4151 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:39:31.774" grpc.time_ms=0.419 pid=927 span.kind=server system=grpc2288gitlab # [ 290.006999] gitaly[927]: time="2026-08-11T11:39:31.820Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9XPGMDZ1P7MPFMFGHB6EJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:39:31.820" grpc.time_ms=0.451 pid=927 span.kind=server system=grpc2289gitlab # [ 290.008207] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:39:33 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 602290gitlab # [ 290.008991] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.109Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"ad70514fe80fc343011d01ac","created_at":"2026-08-11T11:39:31.419Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-7dfbede7cee54e73","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.420Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ad70514fe80fc343011d01ac: done: 0.384053 sec","job_status":"done","queue_duration_s":0.3049,"scheduling_latency_s":0.304922,"gitaly_calls":3,"gitaly_duration_s":0.094703,"redis_calls":63,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.020634,"redis_read_bytes":141,"redis_write_bytes":16718,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000657,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001013,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":20,"redis_queues_duration_s":0.007931,"redis_queues_read_bytes":21,"redis_queues_write_bytes":11224,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.004907,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000277,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001527,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.003665,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.15,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.135,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.117016,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.351345772,"duration_s":0.384053,"completed_at":"2026-08-11T11:39:32.109Z","load_balancing_strategy":"primary","db_duration_s":0.151448,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2291gitlab # [ 290.080259] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.111Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"7b7639e95e92b311edff4d99","created_at":"2026-08-11T11:39:31.783Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-cfcae3ddd8884f78","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.786Z","job_size_bytes":23,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-7b7639e95e92b311edff4d99: start","job_status":"start","queue_duration_s":0.325672,"scheduling_latency_s":0.325697}2292gitlab # [ 290.147489] gitaly[927]: time="2026-08-11T11:39:31.842Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9XPGMDZ1P7MPFMFGHB6EJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:39:31.841" grpc.time_ms=0.798 pid=927 span.kind=server system=grpc2293gitlab # [ 290.148838] gitaly[927]: time="2026-08-11T11:39:31.866Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9XPGMDZ1P7MPFMFGHB6EJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:39:31.866" grpc.time_ms=0.476 pid=927 span.kind=server system=grpc2294gitlab # [ 290.149719] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.161Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"7b7639e95e92b311edff4d99","created_at":"2026-08-11T11:39:31.783Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-cfcae3ddd8884f78","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.786Z","job_size_bytes":23,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-7b7639e95e92b311edff4d99: done: 0.049497 sec","job_status":"done","queue_duration_s":0.325672,"scheduling_latency_s":0.325697,"redis_calls":7,"redis_duration_s":0.001999,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001427,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000572,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.049497,"completed_at":"2026-08-11T11:39:32.161Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007597,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2295gitlab # [ 290.218928] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.162Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"02d3423626f3d1a8191ddca0","created_at":"2026-08-11T11:39:31.882Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-cfcae3ddd8884f78","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.888Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-02d3423626f3d1a8191ddca0: start","job_status":"start","queue_duration_s":0.274561,"scheduling_latency_s":0.274588}2296gitlab # [ 290.220346] gitaly[927]: time="2026-08-11T11:39:31.874Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XPGMDZ1P7MPFMFGHB6EJ diskcache=c6ac9891-8383-4a3d-b4d5-5a711376c1cc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T11:40:01.790" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:31.791" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2297gitlab # [ 290.221341] gitaly[927]: time="2026-08-11T11:39:31.875Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=84 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7333 command.oublock=0 command.real_time_ms=77 command.spawn_token_fork_ms=1 command.system_time_ms=49 command.user_time_ms=35 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XPGMDZ1P7MPFMFGHB6EJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T11:40:01.790" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:31.791" grpc.time_ms=83.841 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2298gitlab # [ 290.290910] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.199Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"02d3423626f3d1a8191ddca0","created_at":"2026-08-11T11:39:31.882Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-cfcae3ddd8884f78","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.888Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-02d3423626f3d1a8191ddca0: done: 0.03634 sec","job_status":"done","queue_duration_s":0.274561,"scheduling_latency_s":0.274588,"redis_calls":7,"redis_duration_s":0.007599,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003506,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004093,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03634,"completed_at":"2026-08-11T11:39:32.199Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004081,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2299gitlab # [ 290.358151] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.203Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"3b3e9363f74e8adfb6bb80c2","created_at":"2026-08-11T11:39:31.902Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-cfcae3ddd8884f78","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.904Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-3b3e9363f74e8adfb6bb80c2: start","job_status":"start","queue_duration_s":0.299794,"scheduling_latency_s":0.299822}2300gitlab # [ 290.359493] gitaly[927]: time="2026-08-11T11:39:31.919Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XQJ145C6WCGP96FGNDNG forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T11:39:41.079" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:39:31.610" operations="[repack_refs]" pid=927 ref=refs/keep-around/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c remote_ip="2001:db8:1::1" revision=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c span.kind=server system=grpc username=root2301gitlab # [ 290.360293] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.244Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"3b3e9363f74e8adfb6bb80c2","created_at":"2026-08-11T11:39:31.902Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-cfcae3ddd8884f78","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.904Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-3b3e9363f74e8adfb6bb80c2: done: 0.040891 sec","job_status":"done","queue_duration_s":0.299794,"scheduling_latency_s":0.299822,"redis_calls":7,"redis_duration_s":0.004166,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003661,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000505,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040891,"completed_at":"2026-08-11T11:39:32.244Z","load_balancing_strategy":"primary","db_duration_s":0.004718,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2302gitlab # [ 290.427980] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.247Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b4eaa9eab1d53baa15ef7d7b","created_at":"2026-08-11T11:39:31.913Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-cfcae3ddd8884f78","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.915Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b4eaa9eab1d53baa15ef7d7b: start","job_status":"start","queue_duration_s":0.332028,"scheduling_latency_s":0.332054}2303gitlab # [ 290.497501] gitaly[927]: time="2026-08-11T11:39:31.921Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XQJ145C6WCGP96FGNDNG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T11:39:41.079" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:39:31.610" pid=927 ref=refs/keep-around/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c remote_ip="2001:db8:1::1" repository_info="{false {6 704 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-11 11:38:23.49859421 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" revision=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c span.kind=server system=grpc username=root2304gitlab # [ 290.498909] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.355Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b4eaa9eab1d53baa15ef7d7b","created_at":"2026-08-11T11:39:31.913Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-cfcae3ddd8884f78","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.915Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b4eaa9eab1d53baa15ef7d7b: done: 0.108563 sec","job_status":"done","queue_duration_s":0.332028,"scheduling_latency_s":0.332054,"redis_calls":10,"redis_duration_s":0.005719,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003913,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000923,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.063,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.062,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029401,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.108563,"completed_at":"2026-08-11T11:39:32.355Z","load_balancing_strategy":"primary","db_duration_s":0.063385,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2305gitlab # [ 290.567411] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.358Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a42e3094f644e9bcb056cb0d","created_at":"2026-08-11T11:39:31.915Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-cfcae3ddd8884f78","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.917Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a42e3094f644e9bcb056cb0d: start","job_status":"start","queue_duration_s":0.440248,"scheduling_latency_s":0.440277}2306gitlab # [ 290.568986] gitaly[927]: time="2026-08-11T11:39:31.927Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XQJ145C6WCGP96FGNDNG diskcache=51047ec1-272c-4bcc-85e9-52800fe67145 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T11:39:41.079" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:39:31.610" pid=927 ref=refs/keep-around/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c remote_ip="2001:db8:1::1" revision=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c span.kind=server system=grpc username=root2307gitlab # [ 290.569861] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.391Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a42e3094f644e9bcb056cb0d","created_at":"2026-08-11T11:39:31.915Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-cfcae3ddd8884f78","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.917Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a42e3094f644e9bcb056cb0d: done: 0.033512 sec","job_status":"done","queue_duration_s":0.440248,"scheduling_latency_s":0.440277,"redis_calls":7,"redis_duration_s":0.001845,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001314,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000531,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033512,"completed_at":"2026-08-11T11:39:32.391Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003597,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2308gitlab # [ 290.637349] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.393Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d8e668df9cd44182a0c9a7ed","created_at":"2026-08-11T11:39:31.918Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-cfcae3ddd8884f78","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.920Z","job_size_bytes":19,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d8e668df9cd44182a0c9a7ed: start","job_status":"start","queue_duration_s":0.473086,"scheduling_latency_s":0.473117}2309gitlab # [ 290.705290] gitaly[927]: time="2026-08-11T11:39:31.927Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=200 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=856064 command.minflt=5580 command.oublock=8 command.real_time_ms=310 command.spawn_token_fork_ms=2 command.system_time_ms=182 command.user_time_ms=18 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XQJ145C6WCGP96FGNDNG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T11:39:41.079" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:39:31.610" grpc.time_ms=317.344 pid=927 ref=refs/keep-around/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c remote_ip="2001:db8:1::1" revision=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c span.kind=server system=grpc username=root2310gitlab # [ 290.706458] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.420Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d8e668df9cd44182a0c9a7ed","created_at":"2026-08-11T11:39:31.918Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-cfcae3ddd8884f78","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.920Z","job_size_bytes":19,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d8e668df9cd44182a0c9a7ed: done: 0.026949 sec","job_status":"done","queue_duration_s":0.473086,"scheduling_latency_s":0.473117,"redis_calls":8,"redis_duration_s":0.002242,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001692,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00055,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026949,"completed_at":"2026-08-11T11:39:32.420Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002825,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2311gitlab # [ 290.776794] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.422Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"51d079a7f98319a47e4e4e98","created_at":"2026-08-11T11:39:31.921Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-cfcae3ddd8884f78","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.923Z","job_size_bytes":66,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-51d079a7f98319a47e4e4e98: start","job_status":"start","queue_duration_s":0.498853,"scheduling_latency_s":0.498882}2312gitlab # [ 290.778272] gitaly[927]: time="2026-08-11T11:39:31.932Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XQJ145C6WCGP96FGNDNG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:40:01.731" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:31.931" grpc.time_ms=0.363 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2313gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c/statuses2314gitlab # [ 290.849618] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.446Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"51d079a7f98319a47e4e4e98","created_at":"2026-08-11T11:39:31.921Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-cfcae3ddd8884f78","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.923Z","job_size_bytes":66,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-51d079a7f98319a47e4e4e98: done: 0.02433 sec","job_status":"done","queue_duration_s":0.498853,"scheduling_latency_s":0.498882,"redis_calls":7,"redis_duration_s":0.001618,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001193,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000425,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014939,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02433,"completed_at":"2026-08-11T11:39:32.446Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004592,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2315gitlab # [ 290.855071] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.447Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"8ff75210372dd668ecf56338","created_at":"2026-08-11T11:39:31.923Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-cfcae3ddd8884f78","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.925Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-8ff75210372dd668ecf56338: start","job_status":"start","queue_duration_s":0.522631,"scheduling_latency_s":0.522653}2316gitlab # [ 290.939938] gitaly[927]: time="2026-08-11T11:39:31.950Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XQJ145C6WCGP96FGNDNG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T11:39:41.079" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:39:31.610" pid=927 ref=refs/keep-around/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c remote_ip="2001:db8:1::1" revision=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2317gitlab # [ 290.941234] gitaly[927]: time="2026-08-11T11:39:32.056Z" level=info msg="optimized repository" clean_stale_data_time=134.178506ms clean_work_trees_time="175.721µs" commit_graph_time="8.66µs" correlation_id=01KZR9XQJ145C6WCGP96FGNDNG gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="8.381µs" pid=927 prune_time="7.822µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="9.777µs" storage_name=default system=housekeeping total_time=134.699801ms2318gitlab # [ 290.942394] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.470Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"8ff75210372dd668ecf56338","created_at":"2026-08-11T11:39:31.923Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-cfcae3ddd8884f78","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.925Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-8ff75210372dd668ecf56338: done: 0.023007 sec","job_status":"done","queue_duration_s":0.522631,"scheduling_latency_s":0.522653,"redis_calls":7,"redis_duration_s":0.001794,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001143,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000651,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023007,"completed_at":"2026-08-11T11:39:32.470Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004419,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2319gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c/statuses, in 0.16 seconds)2320gitlab # [ 291.019158] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.472Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"5f4517757902cb4fa1a5d5ec","created_at":"2026-08-11T11:39:31.926Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-cfcae3ddd8884f78","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.929Z","job_size_bytes":6,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-5f4517757902cb4fa1a5d5ec: start","job_status":"start","queue_duration_s":0.542491,"scheduling_latency_s":0.542514}2321gitlab # [ 291.020790] gitaly[927]: time="2026-08-11T11:39:32.056Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XQJ145C6WCGP96FGNDNG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T11:39:41.079" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T11:39:31.610" pid=927 ref=refs/keep-around/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c remote_ip="2001:db8:1::1" revision=57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c span.kind=server system=grpc username=root2322gitlab # [ 291.021857] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.486Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"5f4517757902cb4fa1a5d5ec","created_at":"2026-08-11T11:39:31.926Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-cfcae3ddd8884f78","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.929Z","job_size_bytes":6,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-5f4517757902cb4fa1a5d5ec: done: 0.013703 sec","job_status":"done","queue_duration_s":0.542491,"scheduling_latency_s":0.542514,"redis_calls":7,"redis_duration_s":0.001551,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00111,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000441,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008896,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013703,"completed_at":"2026-08-11T11:39:32.486Z","load_balancing_strategy":"primary","db_duration_s":0.000367,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2323gitlab # [ 291.093801] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.487Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"31a91ce4b35f1b53ce0d4cf3","created_at":"2026-08-11T11:39:31.931Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-cfcae3ddd8884f78","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.932Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-31a91ce4b35f1b53ce0d4cf3: start","job_status":"start","queue_duration_s":0.554818,"scheduling_latency_s":0.554839}2324gitlab # [ 291.169960] gitaly[927]: time="2026-08-11T11:39:32.063Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9XPGMDZ1P7MPFMFGHB6EJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T11:40:02.062" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:32.062" grpc.time_ms=0.87 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2325gitlab # [ 291.171254] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:39:34 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1242326gitlab # [ 291.172265] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.507Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"31a91ce4b35f1b53ce0d4cf3","created_at":"2026-08-11T11:39:31.931Z","trace_propagation_headers":{"sentry-trace":"39bc507b6a034675831793575ade61a7-cfcae3ddd8884f78","baggage":"sentry-trace_id=39bc507b6a034675831793575ade61a7,sentry-release=Unknown"},"correlation_id":"01KZR9XPGMDZ1P7MPFMFGHB6EJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:31.932Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-31a91ce4b35f1b53ce0d4cf3: done: 0.020548 sec","job_status":"done","queue_duration_s":0.554818,"scheduling_latency_s":0.554839,"redis_calls":7,"redis_duration_s":0.001694,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001248,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000446,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013702,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020548,"completed_at":"2026-08-11T11:39:32.507Z","load_balancing_strategy":"primary","db_duration_s":0.002975,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2327gitlab # [ 291.246361] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.509Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"3d5d3581a6a4adb98c7c2c73","created_at":"2026-08-11T11:39:32.062Z","trace_propagation_headers":{"sentry-trace":"507bda344e2243d680410df47b9ad6c7-42806ed8042b43f0","baggage":"sentry-trace_id=507bda344e2243d680410df47b9ad6c7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9XQJ145C6WCGP96FGNDNG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:32.067Z","job_size_bytes":65,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-3d5d3581a6a4adb98c7c2c73: start","job_status":"start","queue_duration_s":0.442069,"scheduling_latency_s":0.442091}2328gitlab # [ 291.247941] gitaly[927]: time="2026-08-11T11:39:32.096Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XPGMDZ1P7MPFMFGHB6EJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:40:02.095" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:32.095" grpc.time_ms=0.723 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2329gitlab # [ 291.249073] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.618Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"3d5d3581a6a4adb98c7c2c73","created_at":"2026-08-11T11:39:32.062Z","trace_propagation_headers":{"sentry-trace":"507bda344e2243d680410df47b9ad6c7-42806ed8042b43f0","baggage":"sentry-trace_id=507bda344e2243d680410df47b9ad6c7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9XQJ145C6WCGP96FGNDNG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:32.067Z","job_size_bytes":65,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-3d5d3581a6a4adb98c7c2c73: done: 0.109185 sec","job_status":"done","queue_duration_s":0.442069,"scheduling_latency_s":0.442091,"redis_calls":7,"redis_duration_s":0.0017180000000000001,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00127,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000448,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.097763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.109185,"completed_at":"2026-08-11T11:39:32.618Z","load_balancing_strategy":"primary","db_duration_s":0.004755,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2330gitlab # [ 291.337159] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.620Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"ec753e40a7af65269cc69502","created_at":"2026-08-11T11:39:32.069Z","trace_propagation_headers":{"sentry-trace":"507bda344e2243d680410df47b9ad6c7-42806ed8042b43f0","baggage":"sentry-trace_id=507bda344e2243d680410df47b9ad6c7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9XQJ145C6WCGP96FGNDNG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:32.071Z","job_size_bytes":65,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-ec753e40a7af65269cc69502: start","job_status":"start","queue_duration_s":0.548532,"scheduling_latency_s":0.548561}2331gitlab # [ 291.338395] gitaly[927]: time="2026-08-11T11:39:32.312Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XRG9TBSAEE9N0Q2P0A5S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:40:02.110" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:32.311" grpc.time_ms=0.667 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2332gitlab # [ 291.406172] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.665Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"ec753e40a7af65269cc69502","created_at":"2026-08-11T11:39:32.069Z","trace_propagation_headers":{"sentry-trace":"507bda344e2243d680410df47b9ad6c7-42806ed8042b43f0","baggage":"sentry-trace_id=507bda344e2243d680410df47b9ad6c7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9XQJ145C6WCGP96FGNDNG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:32.071Z","job_size_bytes":65,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-ec753e40a7af65269cc69502: done: 0.045291 sec","job_status":"done","queue_duration_s":0.548532,"scheduling_latency_s":0.548561,"redis_calls":10,"redis_duration_s":0.002902,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00173,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001172,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045291,"completed_at":"2026-08-11T11:39:32.665Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009927,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2333gitlab # [ 291.476138] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.666Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"7d1f0ce82539806b14438c1b","created_at":"2026-08-11T11:39:32.115Z","trace_propagation_headers":{"sentry-trace":"507bda344e2243d680410df47b9ad6c7-42806ed8042b43f0","baggage":"sentry-trace_id=507bda344e2243d680410df47b9ad6c7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9XQJ145C6WCGP96FGNDNG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:32.118Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7d1f0ce82539806b14438c1b: start","job_status":"start","queue_duration_s":0.548079,"scheduling_latency_s":0.548102}2334gitlab # [ 291.477505] gitaly[927]: time="2026-08-11T11:39:32.740Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=15 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=15 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9XQJ145C6WCGP96FGNDNG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T11:40:02.723" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:32.723" grpc.time_ms=16.103 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2335gitlab # [ 291.478804] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.890Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"7d1f0ce82539806b14438c1b","created_at":"2026-08-11T11:39:32.115Z","trace_propagation_headers":{"sentry-trace":"507bda344e2243d680410df47b9ad6c7-42806ed8042b43f0","baggage":"sentry-trace_id=507bda344e2243d680410df47b9ad6c7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9XQJ145C6WCGP96FGNDNG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:32.118Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7d1f0ce82539806b14438c1b: done: 0.223972 sec","job_status":"done","queue_duration_s":0.548079,"scheduling_latency_s":0.548102,"gitaly_calls":2,"gitaly_duration_s":0.126462,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.007082,"redis_read_bytes":79,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000932,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001177,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000325,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001621,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000232,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.00091,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.075172,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.19555586,"duration_s":0.223972,"completed_at":"2026-08-11T11:39:32.890Z","load_balancing_strategy":"primary","db_duration_s":0.020992,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2336gitlab # [ 291.576004] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.892Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"b307187cf6329edd8eb6e39f","created_at":"2026-08-11T11:39:32.711Z","trace_propagation_headers":{"sentry-trace":"507bda344e2243d680410df47b9ad6c7-f487a833970a4a09","baggage":"sentry-trace_id=507bda344e2243d680410df47b9ad6c7,sentry-release=Unknown"},"correlation_id":"01KZR9XQJ145C6WCGP96FGNDNG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:32.713Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b307187cf6329edd8eb6e39f: start","job_status":"start","queue_duration_s":0.179232,"scheduling_latency_s":0.179255}2337gitlab # [ 291.577413] gitaly[927]: time="2026-08-11T11:39:32.877Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XQJ145C6WCGP96FGNDNG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:40:02.772" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:32.876" grpc.time_ms=0.949 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2338gitlab # [ 291.647192] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:32.921Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"b307187cf6329edd8eb6e39f","created_at":"2026-08-11T11:39:32.711Z","trace_propagation_headers":{"sentry-trace":"507bda344e2243d680410df47b9ad6c7-f487a833970a4a09","baggage":"sentry-trace_id=507bda344e2243d680410df47b9ad6c7,sentry-release=Unknown"},"correlation_id":"01KZR9XQJ145C6WCGP96FGNDNG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:32.713Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b307187cf6329edd8eb6e39f: done: 0.029253 sec","job_status":"done","queue_duration_s":0.179232,"scheduling_latency_s":0.179255,"redis_calls":7,"redis_duration_s":0.001646,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001232,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000414,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020322,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029253,"completed_at":"2026-08-11T11:39:32.921Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004584,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2339gitlab # [ 291.651811] gitaly[927]: time="2026-08-11T11:39:33.441Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XSMPDXA46402V7R7PCXZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:40:03.240" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:33.440" grpc.time_ms=0.648 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2340gitlab # [ 291.723370] gitaly[927]: time="2026-08-11T11:39:34.592Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XTQ0DTMH82YNR2T382RC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:40:04.490" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:34.591" grpc.time_ms=1.025 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2341gitlab # [ 291.849274] nix-daemon[2988]: accepted connection from pid 3655, user nixbot2342gitlab # [ 291.888489] nix-daemon[2988]: accepted connection from pid 3665, user nixbot2343gitlab # [ 291.900165] nix-daemon[2988]: accepted connection from pid 3655, user nixbot2344gitlab # [ 291.977691] gitaly[927]: time="2026-08-11T11:39:35.535Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XVP2T7RMCRTF5E2T6PNJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:40:05.434" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:35.534" grpc.time_ms=0.652 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2345gitlab # [ 292.031775] gitaly[927]: time="2026-08-11T11:39:35.589Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR9XVP2T7RMCRTF5E2T6PNJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T11:39:45.021" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:35.581" grpc.time_ms=7.962 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2346gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c/statuses2347gitlab # [ 292.063408] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:35.620Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"01a5e19fca2a9d8b875b71fc","created_at":"2026-08-11T11:39:35.614Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-d5d7f1446e19430f","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.618Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-01a5e19fca2a9d8b875b71fc: start","job_status":"start","queue_duration_s":0.002065,"scheduling_latency_s":0.002113}2348gitlab # [ 292.100695] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:39:35 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1672349gitlab # [ 292.102281] nixbot[2776]: {"ts": "2026-08-11T11:39:35.660Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c \"HTTP/1.1 201 Created\""}2350gitlab # [ 292.149832] gitaly[927]: time="2026-08-11T11:39:35.708Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XVV35H68CPR5T7N13TDQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:40:05.506" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:35.706" grpc.time_ms=0.897 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2351gitlab # [ 292.169899] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:39:35 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c/statuses HTTP/1.1" 200 659 "" "curl/8.21.0" 762352gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c/statuses, in 0.11 seconds)2353gitlab # [ 292.177212] gitaly[927]: time="2026-08-11T11:39:35.735Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XVVFC8461GMVE8BWT0H1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:40:05.634" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:35.734" grpc.time_ms=0.526 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2354gitlab # [ 292.219304] gitaly[927]: time="2026-08-11T11:39:35.777Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9XVP2T7RMCRTF5E2T6PNJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:39:35.777" grpc.time_ms=0.353 pid=927 span.kind=server system=grpc2355gitlab # [ 292.234521] gitaly[927]: time="2026-08-11T11:39:35.792Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9XVVFC8461GMVE8BWT0H1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T11:39:45.210" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:35.770" grpc.time_ms=22.079 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2356gitlab # [ 292.258414] gitaly[927]: time="2026-08-11T11:39:35.816Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9XVP2T7RMCRTF5E2T6PNJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:39:35.816" grpc.time_ms=0.431 pid=927 span.kind=server system=grpc2357gitlab # [ 292.298576] gitaly[927]: time="2026-08-11T11:39:35.856Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9XVP2T7RMCRTF5E2T6PNJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:39:35.856" grpc.time_ms=0.482 pid=927 span.kind=server system=grpc2358gitlab # [ 292.301161] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:39:35 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1932359gitlab # [ 292.302263] nixbot[2776]: {"ts": "2026-08-11T11:39:35.858Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c \"HTTP/1.1 201 Created\""}2360gitlab # [ 292.328438] gitaly[927]: time="2026-08-11T11:39:35.886Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XVP2T7RMCRTF5E2T6PNJ diskcache=4d21bc67-bed1-4412-b62e-4d499e463492 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T11:40:05.748" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:35.748" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2361gitlab # [ 292.329841] gitaly[927]: time="2026-08-11T11:39:35.886Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=113 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7157 command.oublock=0 command.real_time_ms=131 command.spawn_token_fork_ms=2 command.system_time_ms=77 command.user_time_ms=36 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XVP2T7RMCRTF5E2T6PNJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T11:40:05.748" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:35.748" grpc.time_ms=138.189 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2362gitlab # [ 292.367655] gitaly[927]: time="2026-08-11T11:39:35.925Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XW1Z3HSEATGT2WH2YV7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:40:05.824" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:35.924" grpc.time_ms=0.713 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2363gitlab # [ 292.388142] gitaly[927]: time="2026-08-11T11:39:35.946Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9XVP2T7RMCRTF5E2T6PNJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T11:40:05.045" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:35.945" grpc.time_ms=0.919 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2364gitlab # [ 292.427365] gitaly[927]: time="2026-08-11T11:39:35.985Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9XW1Z3HSEATGT2WH2YV7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T11:39:45.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:35.976" grpc.time_ms=6.89 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2365gitlab # [ 292.434892] gitaly[927]: time="2026-08-11T11:39:35.993Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XVP2T7RMCRTF5E2T6PNJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:40:05.091" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:35.992" grpc.time_ms=0.662 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2366gitlab # [ 292.442875] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.000Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"ccaf60f2553d89261c19fcbc","created_at":"2026-08-11T11:39:35.999Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"01a5e19fca2a9d8b875b71fc","job_size_bytes":3,"pid":2726,"job_status":"deduplicated","message":"PipelineProcessWorker JID-ccaf60f2553d89261c19fcbc: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2367gitlab # [ 292.444565] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.002Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"01a5e19fca2a9d8b875b71fc","created_at":"2026-08-11T11:39:35.614Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-d5d7f1446e19430f","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.618Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2726,"job_status":"rescheduled","message":"PipelineProcessWorker JID-01a5e19fca2a9d8b875b71fc: rescheduled"}2368gitlab # [ 292.450386] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.008Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"01a5e19fca2a9d8b875b71fc","created_at":"2026-08-11T11:39:35.614Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-d5d7f1446e19430f","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.618Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-01a5e19fca2a9d8b875b71fc: done: 0.387688 sec","job_status":"done","queue_duration_s":0.002065,"scheduling_latency_s":0.002113,"gitaly_calls":3,"gitaly_duration_s":0.168507,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.021658999999999998,"redis_read_bytes":239,"redis_write_bytes":21782,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001276,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001434,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.004251,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14467,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.009012,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000318,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001597,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002495,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.01,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.023,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.125276,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.310033538,"duration_s":0.387688,"completed_at":"2026-08-11T11:39:36.008Z","load_balancing_strategy":"primary","db_duration_s":0.05128,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2369gitlab # [ 292.521502] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.009Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"1f01b24cffe0c8d818c994c5","created_at":"2026-08-11T11:39:35.736Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.741Z","job_size_bytes":23,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-1f01b24cffe0c8d818c994c5: start","job_status":"start","queue_duration_s":0.26884,"scheduling_latency_s":0.268864}2370gitlab # [ 292.609428] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.043Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"1f01b24cffe0c8d818c994c5","created_at":"2026-08-11T11:39:35.736Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.741Z","job_size_bytes":23,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-1f01b24cffe0c8d818c994c5: done: 0.034058 sec","job_status":"done","queue_duration_s":0.26884,"scheduling_latency_s":0.268864,"redis_calls":7,"redis_duration_s":0.0017040000000000002,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001231,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000473,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034058,"completed_at":"2026-08-11T11:39:36.043Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00616,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2371gitlab # [ 292.611244] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.045Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"db16b076ca6e496e10a09bd6","created_at":"2026-08-11T11:39:35.898Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.902Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-db16b076ca6e496e10a09bd6: start","job_status":"start","queue_duration_s":0.143297,"scheduling_latency_s":0.143355}2372gitlab # [ 292.682175] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.067Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"db16b076ca6e496e10a09bd6","created_at":"2026-08-11T11:39:35.898Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.902Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-db16b076ca6e496e10a09bd6: done: 0.022481 sec","job_status":"done","queue_duration_s":0.143297,"scheduling_latency_s":0.143355,"redis_calls":7,"redis_duration_s":0.001764,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001287,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000477,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015032,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022481,"completed_at":"2026-08-11T11:39:36.067Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003244,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2373gitlab # [ 292.699875] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.069Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d8c58ff55477116fff103051","created_at":"2026-08-11T11:39:35.910Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.912Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d8c58ff55477116fff103051: start","job_status":"start","queue_duration_s":0.156973,"scheduling_latency_s":0.156995}2374gitlab # [ 292.779299] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.091Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d8c58ff55477116fff103051","created_at":"2026-08-11T11:39:35.910Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.912Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d8c58ff55477116fff103051: done: 0.022523 sec","job_status":"done","queue_duration_s":0.156973,"scheduling_latency_s":0.156995,"redis_calls":7,"redis_duration_s":0.0016430000000000001,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001185,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000458,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022523,"completed_at":"2026-08-11T11:39:36.091Z","load_balancing_strategy":"primary","db_duration_s":0.003684,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2375gitlab # [ 292.787270] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.093Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"41b1cba68bc752866f884105","created_at":"2026-08-11T11:39:35.920Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.921Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-41b1cba68bc752866f884105: start","job_status":"start","queue_duration_s":0.171725,"scheduling_latency_s":0.171781}2376gitlab # [ 292.868265] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.118Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"41b1cba68bc752866f884105","created_at":"2026-08-11T11:39:35.920Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.921Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-41b1cba68bc752866f884105: done: 0.025351 sec","job_status":"done","queue_duration_s":0.171725,"scheduling_latency_s":0.171781,"redis_calls":10,"redis_duration_s":0.002306,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001168,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000704,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000434,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025351,"completed_at":"2026-08-11T11:39:36.118Z","load_balancing_strategy":"primary","db_duration_s":0.003728,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2377gitlab # [ 292.936894] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.120Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"6cea11300d255b1b153dd2e7","created_at":"2026-08-11T11:39:35.922Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.923Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-6cea11300d255b1b153dd2e7: start","job_status":"start","queue_duration_s":0.196745,"scheduling_latency_s":0.196768}2378gitlab # [ 292.938045] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.146Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"6cea11300d255b1b153dd2e7","created_at":"2026-08-11T11:39:35.922Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.923Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-6cea11300d255b1b153dd2e7: done: 0.026101 sec","job_status":"done","queue_duration_s":0.196745,"scheduling_latency_s":0.196768,"redis_calls":7,"redis_duration_s":0.00177,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001306,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000464,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026101,"completed_at":"2026-08-11T11:39:36.146Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003838,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2379gitlab # [ 292.964127] gitaly[927]: time="2026-08-11T11:39:36.345Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9XVP2T7RMCRTF5E2T6PNJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T11:40:06.344" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:36.344" grpc.time_ms=0.867 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2380gitlab # [ 293.029129] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.148Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"00aebe52487e72c36ad6cd72","created_at":"2026-08-11T11:39:35.923Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.925Z","job_size_bytes":19,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-00aebe52487e72c36ad6cd72: start","job_status":"start","queue_duration_s":0.22206,"scheduling_latency_s":0.222092}2381gitlab # [ 293.030233] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.170Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"00aebe52487e72c36ad6cd72","created_at":"2026-08-11T11:39:35.923Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.925Z","job_size_bytes":19,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-00aebe52487e72c36ad6cd72: done: 0.022491 sec","job_status":"done","queue_duration_s":0.22206,"scheduling_latency_s":0.222092,"redis_calls":8,"redis_duration_s":0.0019249999999999998,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001504,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000421,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022491,"completed_at":"2026-08-11T11:39:36.170Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002937,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2382gitlab # [ 293.098545] gitaly[927]: time="2026-08-11T11:39:36.376Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XVP2T7RMCRTF5E2T6PNJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:40:06.374" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:36.375" grpc.time_ms=0.683 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2383gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c/statuses2384gitlab # [ 293.099589] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.171Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f7bfc28e6faa5d9fb3b60541","created_at":"2026-08-11T11:39:35.926Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.928Z","job_size_bytes":66,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f7bfc28e6faa5d9fb3b60541: start","job_status":"start","queue_duration_s":0.243839,"scheduling_latency_s":0.243861}2385gitlab # [ 293.173214] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.191Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f7bfc28e6faa5d9fb3b60541","created_at":"2026-08-11T11:39:35.926Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.928Z","job_size_bytes":66,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f7bfc28e6faa5d9fb3b60541: done: 0.019882 sec","job_status":"done","queue_duration_s":0.243839,"scheduling_latency_s":0.243861,"redis_calls":7,"redis_duration_s":0.001568,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001148,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00042,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019882,"completed_at":"2026-08-11T11:39:36.191Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00225,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2386gitlab # [ 293.179405] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.193Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"d94a2d5ecd6c812df3c14b6c","created_at":"2026-08-11T11:39:35.928Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.930Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-d94a2d5ecd6c812df3c14b6c: start","job_status":"start","queue_duration_s":0.263142,"scheduling_latency_s":0.263165}2387gitlab # [ 293.248264] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.220Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"d94a2d5ecd6c812df3c14b6c","created_at":"2026-08-11T11:39:35.928Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.930Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-d94a2d5ecd6c812df3c14b6c: done: 0.027697 sec","job_status":"done","queue_duration_s":0.263142,"scheduling_latency_s":0.263165,"redis_calls":7,"redis_duration_s":0.001624,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001172,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000452,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019922,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027697,"completed_at":"2026-08-11T11:39:36.220Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003874,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2388gitlab # [ 293.267148] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.222Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"ee05464b8ff1a1c8241e9843","created_at":"2026-08-11T11:39:35.933Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.934Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-ee05464b8ff1a1c8241e9843: start","job_status":"start","queue_duration_s":0.288262,"scheduling_latency_s":0.288285}2389gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c/statuses, in 0.19 seconds)2390gitlab # [ 293.334240] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.244Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"ee05464b8ff1a1c8241e9843","created_at":"2026-08-11T11:39:35.933Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.934Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-ee05464b8ff1a1c8241e9843: done: 0.021894 sec","job_status":"done","queue_duration_s":0.288262,"scheduling_latency_s":0.288285,"redis_calls":7,"redis_duration_s":0.001707,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001264,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000443,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021894,"completed_at":"2026-08-11T11:39:36.244Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004008,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2391gitlab # [ 293.355553] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.245Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"f17df96961f44a756405e278","created_at":"2026-08-11T11:39:35.934Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.935Z","job_size_bytes":6,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-f17df96961f44a756405e278: start","job_status":"start","queue_duration_s":0.309921,"scheduling_latency_s":0.309943}2392gitlab # [ 293.380263] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.259Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"f17df96961f44a756405e278","created_at":"2026-08-11T11:39:35.934Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.935Z","job_size_bytes":6,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-f17df96961f44a756405e278: done: 0.013552 sec","job_status":"done","queue_duration_s":0.309921,"scheduling_latency_s":0.309943,"redis_calls":7,"redis_duration_s":0.001549,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00113,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000419,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013552,"completed_at":"2026-08-11T11:39:36.259Z","load_balancing_strategy":"primary","db_duration_s":0.000403,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2393gitlab # [ 293.468123] gitaly[927]: time="2026-08-11T11:39:36.877Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XX02PG571PF5QHBRYX75 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:40:06.675" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:36.876" grpc.time_ms=0.99 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2394gitlab # [ 293.469677] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:39:36 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c/statuses HTTP/1.1" 200 1295 "" "curl/8.21.0" 812395gitlab # [ 293.470881] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.260Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"ab51c1acccff97021df23691","created_at":"2026-08-11T11:39:35.936Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.937Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-ab51c1acccff97021df23691: start","job_status":"start","queue_duration_s":0.323217,"scheduling_latency_s":0.323239}2396gitlab # [ 293.547188] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.280Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"ab51c1acccff97021df23691","created_at":"2026-08-11T11:39:35.936Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:35.937Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-ab51c1acccff97021df23691: done: 0.020005 sec","job_status":"done","queue_duration_s":0.323217,"scheduling_latency_s":0.323239,"redis_calls":7,"redis_duration_s":0.0015810000000000002,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001154,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000427,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020005,"completed_at":"2026-08-11T11:39:36.280Z","load_balancing_strategy":"primary","db_duration_s":0.002924,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2397gitlab # [ 293.554147] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.282Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"6955a747fe6c12a12061785c","created_at":"2026-08-11T11:39:36.002Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:36.004Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6955a747fe6c12a12061785c: start","job_status":"start","queue_duration_s":0.27821,"scheduling_latency_s":0.278232}2398gitlab # [ 293.627372] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.388Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"6955a747fe6c12a12061785c","created_at":"2026-08-11T11:39:36.002Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-b6ca0b4aed4c4a12","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:36.004Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6955a747fe6c12a12061785c: done: 0.105893 sec","job_status":"done","queue_duration_s":0.27821,"scheduling_latency_s":0.278232,"gitaly_calls":2,"gitaly_duration_s":0.007294,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.006726,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000987,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001076,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.0003,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001656,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000235,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000485,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":29,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":14,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074412,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.077550638,"duration_s":0.105893,"completed_at":"2026-08-11T11:39:36.388Z","load_balancing_strategy":"primary","db_duration_s":0.023719,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2399gitlab # [ 293.701135] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.389Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"78455e5019d3d4d2131054e7","created_at":"2026-08-11T11:39:36.331Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-1b04c2dc983e4e28","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:36.333Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-78455e5019d3d4d2131054e7: start","job_status":"start","queue_duration_s":0.056426,"scheduling_latency_s":0.05646}2400gitlab # [ 293.702278] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:36.419Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"78455e5019d3d4d2131054e7","created_at":"2026-08-11T11:39:36.331Z","trace_propagation_headers":{"sentry-trace":"23c5af41ad874bd1919260bdb6245273-1b04c2dc983e4e28","baggage":"sentry-trace_id=23c5af41ad874bd1919260bdb6245273,sentry-release=Unknown"},"correlation_id":"01KZR9XVP2T7RMCRTF5E2T6PNJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:36.333Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-78455e5019d3d4d2131054e7: done: 0.029641 sec","job_status":"done","queue_duration_s":0.056426,"scheduling_latency_s":0.05646,"redis_calls":7,"redis_duration_s":0.001971,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001502,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000469,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029641,"completed_at":"2026-08-11T11:39:36.419Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003898,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2401gitlab # [ 293.850334] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:37.408Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"65631bd7275bbfc945d14b82","created_at":"2026-08-11T11:39:37.402Z","trace_propagation_headers":{"sentry-trace":"02bf9575ba4d431abd6ab4e6de6230dc-7428c4319f034da4","baggage":"sentry-trace_id=02bf9575ba4d431abd6ab4e6de6230dc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9XW1Z3HSEATGT2WH2YV7H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:37.405Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-65631bd7275bbfc945d14b82: start","job_status":"start","queue_duration_s":0.002385,"scheduling_latency_s":0.002432}2402gitlab # [ 293.865382] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:39:37 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 15512403gitlab # [ 293.867690] nixbot[2776]: {"ts": "2026-08-11T11:39:37.424Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c \"HTTP/1.1 201 Created\""}2404gitlab # [ 293.960922] nix-daemon[2988]: accepted connection from pid 3725, user nixbot2405gitlab # [ 293.984889] gitaly[927]: time="2026-08-11T11:39:37.543Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9XW1Z3HSEATGT2WH2YV7H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:39:37.542" grpc.time_ms=0.61 pid=927 span.kind=server system=grpc2406gitlab # [ 294.031418] gitaly[927]: time="2026-08-11T11:39:37.589Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9XW1Z3HSEATGT2WH2YV7H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:39:37.589" grpc.time_ms=0.369 pid=927 span.kind=server system=grpc2407gitlab # [ 294.075662] gitaly[927]: time="2026-08-11T11:39:37.633Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR9XW1Z3HSEATGT2WH2YV7H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T11:39:37.631" grpc.time_ms=1.759 pid=927 span.kind=server system=grpc2408gitlab # [ 294.076816] gitaly[927]: time="2026-08-11T11:39:37.634Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR9XXQDAKS86J4ZZQ5GFRGX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:39:37.627" grpc.time_ms=6.731 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc2409gitlab # [ 294.079699] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:39:37 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 552410gitlab # [ 294.126532] gitaly[927]: time="2026-08-11T11:39:37.684Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XW1Z3HSEATGT2WH2YV7H diskcache=8269dadc-a80f-4ed0-bf42-0591ed1ea7f1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T11:40:07.509" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:37.509" pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2411gitlab # [ 294.127929] gitaly[927]: time="2026-08-11T11:39:37.684Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=171 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7397 command.oublock=0 command.real_time_ms=167 command.spawn_token_fork_ms=0 command.system_time_ms=119 command.user_time_ms=52 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XW1Z3HSEATGT2WH2YV7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T11:40:07.509" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T11:39:37.509" grpc.time_ms=174.826 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2412gitlab # [ 294.139065] gitaly[927]: time="2026-08-11T11:39:37.697Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XXS71KEB068E0YBRG0XW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:39:37.690" pid=927 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2413gitlab # [ 294.140317] gitaly[927]: time="2026-08-11T11:39:37.697Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XXS71KEB068E0YBRG0XW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:39:37.690" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc2414gitlab # [ 294.141864] gitaly[927]: time="2026-08-11T11:39:37.697Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XXS71KEB068E0YBRG0XW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T11:39:37.690" grpc.time_ms=7.571 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc2415gitlab # [ 294.220724] gitlab-workhorse[828]: time="2026-08-11T11:39:37Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672416gitlab # [ 294.221882] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/08/11:11:39:37 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1392417gitlab # [ 294.283724] gitaly[927]: time="2026-08-11T11:39:37.841Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR9XW1Z3HSEATGT2WH2YV7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T11:40:07.840" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:37.840" grpc.time_ms=1.121 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2418gitlab # [ 294.297044] nix-daemon[2988]: accepted connection from pid 3776, user nixbot2419gitlab # [ 294.338423] gitaly[927]: time="2026-08-11T11:39:37.896Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR9XW1Z3HSEATGT2WH2YV7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T11:40:07.895" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T11:39:37.895" grpc.time_ms=0.757 pid=927 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2420gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c/statuses2421gitlab # [ 294.352136] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:37.909Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"65631bd7275bbfc945d14b82","created_at":"2026-08-11T11:39:37.402Z","trace_propagation_headers":{"sentry-trace":"02bf9575ba4d431abd6ab4e6de6230dc-7428c4319f034da4","baggage":"sentry-trace_id=02bf9575ba4d431abd6ab4e6de6230dc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR9XW1Z3HSEATGT2WH2YV7H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:37.405Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-65631bd7275bbfc945d14b82: done: 0.501561 sec","job_status":"done","queue_duration_s":0.002385,"scheduling_latency_s":0.002432,"gitaly_calls":3,"gitaly_duration_s":0.300525,"redis_calls":73,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.023355,"redis_read_bytes":154,"redis_write_bytes":20031,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001014,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001629,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":23,"redis_queues_duration_s":0.004653,"redis_queues_read_bytes":25,"redis_queues_write_bytes":13376,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.011409,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3094,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000269,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000902,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002465,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.009,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.012,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.02,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.136947,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.443777072,"duration_s":0.501561,"completed_at":"2026-08-11T11:39:37.909Z","load_balancing_strategy":"primary","db_duration_s":0.043831,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2422gitlab # [ 294.368277] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:37.911Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8a55aebf336f6bd8054e30f4","created_at":"2026-08-11T11:39:37.501Z","trace_propagation_headers":{"sentry-trace":"02bf9575ba4d431abd6ab4e6de6230dc-fb0a22c8e8644247","baggage":"sentry-trace_id=02bf9575ba4d431abd6ab4e6de6230dc,sentry-release=Unknown"},"correlation_id":"01KZR9XW1Z3HSEATGT2WH2YV7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:37.503Z","job_size_bytes":23,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8a55aebf336f6bd8054e30f4: start","job_status":"start","queue_duration_s":0.408154,"scheduling_latency_s":0.408178}2423gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c/statuses, in 0.15 seconds)2424(finished: subtest: eval and build post commit statuses, in 5.86 seconds)2425(finished: run the VM test script, in 335.01 seconds)2426gitlab # [ 294.443473] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:37.950Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8a55aebf336f6bd8054e30f4","created_at":"2026-08-11T11:39:37.501Z","trace_propagation_headers":{"sentry-trace":"02bf9575ba4d431abd6ab4e6de6230dc-fb0a22c8e8644247","baggage":"sentry-trace_id=02bf9575ba4d431abd6ab4e6de6230dc,sentry-release=Unknown"},"correlation_id":"01KZR9XW1Z3HSEATGT2WH2YV7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:37.503Z","job_size_bytes":23,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8a55aebf336f6bd8054e30f4: done: 0.039294 sec","job_status":"done","queue_duration_s":0.408154,"scheduling_latency_s":0.408178,"redis_calls":7,"redis_duration_s":0.0018,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00134,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00046,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039294,"completed_at":"2026-08-11T11:39:37.950Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009696,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2427gitlab # [ 294.524512] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:37.952Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2c6ee62cc299b6e111dd39ff","created_at":"2026-08-11T11:39:37.785Z","trace_propagation_headers":{"sentry-trace":"02bf9575ba4d431abd6ab4e6de6230dc-fb0a22c8e8644247","baggage":"sentry-trace_id=02bf9575ba4d431abd6ab4e6de6230dc,sentry-release=Unknown"},"correlation_id":"01KZR9XW1Z3HSEATGT2WH2YV7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:37.790Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2c6ee62cc299b6e111dd39ff: start","job_status":"start","queue_duration_s":0.161468,"scheduling_latency_s":0.161492}2428gitlab # [ 294.525256] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:37.976Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2c6ee62cc299b6e111dd39ff","created_at":"2026-08-11T11:39:37.785Z","trace_propagation_headers":{"sentry-trace":"02bf9575ba4d431abd6ab4e6de6230dc-fb0a22c8e8644247","baggage":"sentry-trace_id=02bf9575ba4d431abd6ab4e6de6230dc,sentry-release=Unknown"},"correlation_id":"01KZR9XW1Z3HSEATGT2WH2YV7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:37.790Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2c6ee62cc299b6e111dd39ff: done: 0.02459 sec","job_status":"done","queue_duration_s":0.161468,"scheduling_latency_s":0.161492,"redis_calls":7,"redis_duration_s":0.001673,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001227,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000446,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02459,"completed_at":"2026-08-11T11:39:37.976Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003391,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2429test script finished in 335.13s2430cleanup2431kill QemuMachine (pid 46)2432gitlab # [ 294.620311] sidekiq-cluster[2726]: {"severity":"INFO","time":"2026-08-11T11:39:37.978Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"7609f0c11afc7f3698a2f416","created_at":"2026-08-11T11:39:37.800Z","trace_propagation_headers":{"sentry-trace":"02bf9575ba4d431abd6ab4e6de6230dc-fb0a22c8e8644247","baggage":"sentry-trace_id=02bf9575ba4d431abd6ab4e6de6230dc,sentry-release=Unknown"},"correlation_id":"01KZR9XW1Z3HSEATGT2WH2YV7H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-11T11:39:37.803Z","job_size_bytes":3,"pid":2726,"sidekiq_tid":"m86q","sidekiq_thread_name":"sidekiq.defqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2433gitlab # a2434(finished: cleanup, in 1.46 seconds)2435additionally exposed symbols:2436 gitlab,2437 vlan1,2438 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2439[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-11T11:38:28.948Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2440[]2441[]2442[]2443[]2444[]2445[]2446[]2447[]2448[]2449[]2450[]2451[]2452[]2453[]2454[]2455[]2456[]2457[]2458[]2459[]2460[]2461[]2462[]2463[]2464[]2465[]2466[]2467[]2468[]2469[]2470[]2471[]2472[]2473[]2474[]2475[]2476[]2477[]2478[]2479[]2480[]2481[]2482[]2483[]2484[]2485[]2486[]2487[]2488[]2489[]2490[]2491[]2492[]2493[]2494[]2495[]2496[]2497[]2498[]2499[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-11T11:39:31.252834Z', 'started_at': '2026-08-11T11:39:32.135852Z', 'finished_at': None}]2500[{'id': 5, 'sha': '57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-11T11:39:32.110Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2501[{'id': 5, 'sha': '57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-11T11:39:32.110Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2502[{'id': 5, 'sha': '57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-11T11:39:32.110Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2503[{'id': 5, 'sha': '57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-11T11:39:32.110Z', 'started_at': None, 'finished_at': '2026-08-11T11:39:35.606Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2504[{'id': 5, 'sha': '57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-11T11:39:32.110Z', 'started_at': None, 'finished_at': '2026-08-11T11:39:35.606Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-08-11T11:39:35.835Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2505[{'id': 5, 'sha': '57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-11T11:39:32.110Z', 'started_at': None, 'finished_at': '2026-08-11T11:39:35.606Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '57f1ed8cbfeb20ebcd115d2c2bdc855dc470e61c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-08-11T11:39:35.835Z', 'started_at': None, 'finished_at': '2026-08-11T11:39:37.395Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]