vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #343
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.G0X2fbaiux', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13(finished: start all VMs, in 40.10 seconds)14gitlab # Discarding device blocks: 0/262144 done15gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes16gitlab # Filesystem UUID: 5cb7f69b-1007-469b-99de-2fba1a36ea9117gitlab # Superblock backups stored on blocks:18gitlab # 32768, 98304, 163840, 22937619gitlab # 20gitlab # Allocating group tables: 0/8 done21gitlab # Writing inode tables: 0/8 done22gitlab # Creating journal (8192 blocks): done23gitlab # Writing superblocks and filesystem accounting information: 0/8 done24gitlab # 25gitlab # Virtualisation disk image created.26gitlab # Creating Nix store image...27gitlab # Created Nix store image.28gitlab: waiting for unit setup-gitlab.service29gitlab: waiting for the VM to finish booting30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... ok45gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202646gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/chdhdrxd8m9y4d0fp06v0z6pm49jb6hp-nixos-system-gitlab-test/init regInfo=/nix/store/dr9w0w2z227ip9i7wd0p5k3rmg7cj0am-closure-info/registration console=ttyS0,115200n8 console=tty047gitlab # [ 0.000000] BIOS-provided physical RAM map:48gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable49gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved51gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved55gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable56gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved57gitlab # [ 0.000000] NX (Execute Disable) protection: active58gitlab # [ 0.000000] APIC: Static calls initialized59gitlab # [ 0.000000] SMBIOS 2.8 present.60gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201461gitlab # [ 0.000000] DMI: Memory slots populated: 1/162gitlab # [ 0.000000] Hypervisor detected: KVM63gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000064gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0065gitlab # [ 0.000000] kvm-clock: using sched offset of 512356350 cycles66gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns67gitlab # [ 0.000005] tsc: Detected 2400.012 MHz processor68gitlab # [ 0.000812] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000069gitlab # [ 0.000848] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs70gitlab # [ 0.000851] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT71gitlab # [ 0.000903] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000072gitlab # [ 0.002756] found SMP MP-table at [mem 0x000f5470-0x000f547f]73gitlab # [ 0.002768] Using GB pages for direct mapping74gitlab # [ 0.002834] RAMDISK: [mem 0xbe31c000-0xbffcffff]75gitlab # [ 0.002842] ACPI: Early table checksum verification disabled76gitlab # [ 0.002844] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )77gitlab # [ 0.002848] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002852] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002859] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)80gitlab # [ 0.002861] ACPI: FACS 0x00000000BFFE0000 00004081gitlab # [ 0.002863] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002865] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002866] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)84gitlab # [ 0.002868] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]85gitlab # [ 0.002869] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]86gitlab # [ 0.002869] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]87gitlab # [ 0.002870] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]88gitlab # [ 0.002870] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]89gitlab # [ 0.002871] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]90gitlab # [ 0.003364] No NUMA configuration found91gitlab # [ 0.003365] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]92gitlab # [ 0.003368] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]93gitlab # [ 0.005774] Zone ranges:94gitlab # [ 0.005775] DMA [mem 0x0000000000001000-0x0000000000ffffff]95gitlab # [ 0.005777] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]96gitlab # [ 0.005778] Normal [mem 0x0000000100000000-0x00000001bfffffff]97gitlab # [ 0.005779] Device empty98gitlab # [ 0.005780] Movable zone start for each node99gitlab # [ 0.005781] Early memory node ranges100gitlab # [ 0.005781] node 0: [mem 0x0000000000001000-0x000000000009efff]101gitlab # [ 0.005782] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]102gitlab # [ 0.005783] node 0: [mem 0x0000000100000000-0x00000001bfffffff]103gitlab # [ 0.005784] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]104gitlab # [ 0.005804] On node 0, zone DMA: 1 pages in unavailable ranges105gitlab # [ 0.006085] On node 0, zone DMA: 97 pages in unavailable ranges106gitlab # [ 0.118179] On node 0, zone Normal: 40 pages in unavailable ranges107gitlab # [ 0.119212] ACPI: PM-Timer IO Port: 0x608108gitlab # [ 0.119230] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])109gitlab # [ 0.119270] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23110gitlab # [ 0.119273] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)111gitlab # [ 0.119275] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)112gitlab # [ 0.119276] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)113gitlab # [ 0.119277] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)114gitlab # [ 0.119278] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)115gitlab # [ 0.119280] ACPI: Using ACPI (MADT) for SMP configuration information116gitlab # [ 0.119281] ACPI: HPET id: 0x8086a201 base: 0xfed00000117gitlab # [ 0.119288] TSC deadline timer available118gitlab # [ 0.119292] CPU topo: Max. logical packages: 1119gitlab # [ 0.119293] CPU topo: Max. logical dies: 1120gitlab # [ 0.119293] CPU topo: Max. dies per package: 1121gitlab # [ 0.119297] CPU topo: Max. threads per core: 1122gitlab # [ 0.119298] CPU topo: Num. cores per package: 4123gitlab # [ 0.119298] CPU topo: Num. threads per package: 4124gitlab # [ 0.119298] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs125gitlab # [ 0.119323] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()126gitlab # [ 0.119341] kvm-guest: KVM setup pv remote TLB flush127gitlab # [ 0.119345] kvm-guest: setup PV sched yield128gitlab # [ 0.119365] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]129gitlab # [ 0.119367] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]130gitlab # [ 0.119368] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]131gitlab # [ 0.119369] [mem 0xc0000000-0xfeffbfff] available for PCI devices132gitlab # [ 0.119371] Booting paravirtualized kernel on KVM133gitlab # [ 0.119374] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns134gitlab # [ 0.123859] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1135gitlab # [ 0.126123] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288136gitlab # [ 0.126175] kvm-guest: PV spinlocks enabled137gitlab # [ 0.126176] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)138gitlab # [ 0.126179] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/chdhdrxd8m9y4d0fp06v0z6pm49jb6hp-nixos-system-gitlab-test/init regInfo=/nix/store/dr9w0w2z227ip9i7wd0p5k3rmg7cj0am-closure-info/registration console=ttyS0,115200n8 console=tty0139gitlab # [ 0.126275] Unknown kernel command line parameters "regInfo=/nix/store/dr9w0w2z227ip9i7wd0p5k3rmg7cj0am-closure-info/registration", will be passed to user space.140gitlab # [ 0.126288] random: crng init done141gitlab # [ 0.126289] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes142gitlab # [ 0.135218] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)143gitlab # [ 0.139776] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)144gitlab # [ 0.139851] software IO TLB: area num 4.145gitlab # [ 0.214544] Fallback order for Node 0: 0146gitlab # [ 0.214551] Built 1 zonelists, mobility grouping on. Total pages: 1572726147gitlab # [ 0.214553] Policy zone: Normal148gitlab # [ 0.217123] mem auto-init: stack:all(zero), heap alloc:on, heap free:off149gitlab # [ 0.226525] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1150gitlab # [ 0.240338] allocated 12582912 bytes of page_ext151gitlab # [ 0.250313] ftrace: allocating 48717 entries in 192 pages152gitlab # [ 0.250315] ftrace: allocated 192 pages with 2 groups153gitlab # [ 0.251173] Dynamic Preempt: lazy154gitlab # [ 0.251353] rcu: Preemptible hierarchical RCU implementation.155gitlab # [ 0.251354] rcu: RCU event tracing is enabled.156gitlab # [ 0.251355] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.157gitlab # [ 0.251356] Trampoline variant of Tasks RCU enabled.158gitlab # [ 0.251357] Rude variant of Tasks RCU enabled.159gitlab # [ 0.251357] Tracing variant of Tasks RCU enabled.160gitlab # [ 0.251358] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.161gitlab # [ 0.251358] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4162gitlab # [ 0.251379] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.251381] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.251382] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.165gitlab # [ 0.255997] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16166gitlab # [ 0.256296] rcu: srcu_init: Setting srcu_struct sizes based on contention.167gitlab # [ 0.256306] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns168gitlab # [ 0.256416] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)169gitlab # [ 0.263783] Console: colour VGA+ 80x25170gitlab # [ 0.263787] printk: legacy console [tty0] enabled171gitlab # [ 0.308582] printk: legacy console [ttyS0] enabled172gitlab # [ 0.512215] ACPI: Core revision 20250807173gitlab # [ 0.515213] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns174gitlab # [ 0.518124] APIC: Switch to symmetric I/O mode setup175gitlab # [ 0.519889] x2apic enabled176gitlab # [ 0.521146] APIC: Switched APIC routing to: physical x2apic177gitlab # [ 0.522865] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()178gitlab # [ 0.525097] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()179gitlab # [ 0.527881] kvm-guest: setup PV IPIs180gitlab # [ 0.530229] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1181gitlab # [ 0.532078] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns182gitlab # [ 0.535270] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)183gitlab # [ 0.536388] x86/cpu: User Mode Instruction Prevention (UMIP) activated184gitlab # [ 0.538439] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127185gitlab # [ 0.540269] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0186gitlab # [ 0.541274] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto187gitlab # [ 0.542269] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl188gitlab # [ 0.543269] Transient Scheduler Attacks: Mitigation: Clear CPU buffers189gitlab # [ 0.545269] Spectre V2 : Mitigation: Enhanced / Automatic IBRS190gitlab # [ 0.547269] Speculative Return Stack Overflow: Mitigation: Safe RET191gitlab # [ 0.548269] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization192gitlab # [ 0.550278] Spectre V2 : Enabling IBPB for BPF193gitlab # [ 0.551271] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier194gitlab # [ 0.553270] active return thunk: srso_alias_return_thunk195gitlab # [ 0.554298] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'196gitlab # [ 0.556269] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'197gitlab # [ 0.557269] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'198gitlab # [ 0.558269] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'199gitlab # [ 0.560269] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'200gitlab # [ 0.562269] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'201gitlab # [ 0.564269] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'202gitlab # [ 0.566269] x86/fpu: Supporting XSAVE feature 0x800: 'Control-flow User registers'203gitlab # [ 0.567269] x86/fpu: Supporting XSAVE feature 0x1000: 'Control-flow Kernel registers (KVM only)'204gitlab # [ 0.568270] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256205gitlab # [ 0.569269] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64206gitlab # [ 0.571269] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512207gitlab # [ 0.573269] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024208gitlab # [ 0.574269] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8209gitlab # [ 0.575269] x86/fpu: xstate_offset[11]: 2440, xstate_sizes[11]: 16210gitlab # [ 0.576269] x86/fpu: xstate_offset[12]: 2456, xstate_sizes[12]: 24211gitlab # [ 0.577269] x86/fpu: Enabled xstate features 0x1ae7, context size is 2480 bytes, using 'compacted' format.212gitlab # [ 0.607616] Freeing SMP alternatives memory: 44K213gitlab # [ 0.608272] pid_max: default: 32768 minimum: 301214gitlab # [ 0.610395] LSM: initializing lsm=capability,landlock,yama,bpf,ima215gitlab # [ 0.611380] landlock: Up and running.216gitlab # [ 0.612269] Yama: becoming mindful.217gitlab # [ 0.613479] LSM support for eBPF active218gitlab # [ 0.615511] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)219gitlab # [ 0.616420] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)220gitlab # [ 0.619740] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)221gitlab # [ 0.620902] Performance Events: Fam17h+ core perfctr, AMD PMU driver.222gitlab # [ 0.621280] ... version: 2223gitlab # [ 0.622271] ... bit width: 48224gitlab # [ 0.623271] ... generic counters: 6225gitlab # [ 0.624271] ... generic bitmap: 000000000000003f226gitlab # [ 0.625271] ... fixed-purpose counters: 0227gitlab # [ 0.626270] ... fixed-purpose bitmap: 0000000000000000228gitlab # [ 0.627271] ... value mask: 0000ffffffffffff229gitlab # [ 0.628271] ... max period: 00007fffffffffff230gitlab # [ 0.629271] ... global_ctrl mask: 000000000000003f231gitlab # [ 0.630396] signal: max sigframe size: 3376232gitlab # [ 0.631352] rcu: Hierarchical SRCU implementation.233gitlab # [ 0.632275] rcu: Max phase no-delay instances is 400.234gitlab # [ 0.633480] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level235gitlab # [ 0.638893] smp: Bringing up secondary CPUs ...236gitlab # [ 0.639671] smpboot: x86: Booting SMP configuration:237gitlab # [ 0.640281] .... node #0, CPUs: #1 #2 #3238gitlab # [ 0.644416] smp: Brought up 1 node, 4 CPUs239gitlab # [ 0.646271] smpboot: Total of 4 processors activated (19200.09 BogoMIPS)240gitlab # [ 0.647894] Memory: 6011656K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved)241gitlab # [ 0.650271] devtmpfs: initialized242gitlab # [ 0.651532] x86/mm: Memory block size: 128MB243gitlab # [ 0.655335] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)244gitlab # [ 0.656355] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).245gitlab # [ 0.657388] pinctrl core: initialized pinctrl subsystem246gitlab # [ 0.658659] PM: RTC time: 06:45:57, date: 2026-09-06247gitlab # [ 0.662400] NET: Registered PF_NETLINK/PF_ROUTE protocol family248gitlab # [ 0.664701] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations249gitlab # [ 0.665330] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations250gitlab # [ 0.667421] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations251gitlab # [ 0.668284] audit: initializing netlink subsys (disabled)252gitlab # [ 0.669495] audit: type=2000 audit(1788677157.423:1): state=initialized audit_enabled=0 res=1253gitlab # [ 0.669545] thermal_sys: Registered thermal governor 'fair_share'254gitlab # [ 0.671272] thermal_sys: Registered thermal governor 'bang_bang'255gitlab # [ 0.672271] thermal_sys: Registered thermal governor 'step_wise'256gitlab # [ 0.673271] thermal_sys: Registered thermal governor 'user_space'257gitlab # [ 0.674271] thermal_sys: Registered thermal governor 'power_allocator'258gitlab # [ 0.675314] cpuidle: using governor menu259gitlab # [ 0.678505] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5260gitlab # [ 0.679627] PCI: Using configuration type 1 for base access261gitlab # [ 0.680271] PCI: Using configuration type 1 for extended access262gitlab # [ 0.681427] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.263gitlab # [ 0.684273] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages264gitlab # [ 0.685273] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page265gitlab # [ 0.686272] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages266gitlab # [ 0.687271] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page267gitlab # [ 0.692358] ACPI: Added _OSI(Module Device)268gitlab # [ 0.696280] ACPI: Added _OSI(Processor Device)269gitlab # [ 0.699279] ACPI: Added _OSI(Processor Aggregator Device)270gitlab # [ 0.708416] ACPI: 1 ACPI AML tables successfully acquired and loaded271gitlab # [ 0.717903] ACPI: Interpreter enabled272gitlab # [ 0.721646] ACPI: PM: (supports S0 S3 S4 S5)273gitlab # [ 0.724283] ACPI: Using IOAPIC for interrupt routing274gitlab # [ 0.728815] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug275gitlab # [ 0.735280] PCI: Using E820 reservations for host bridge windows276gitlab # [ 0.741127] ACPI: Enabled 2 GPEs in block 00 to 0F277gitlab # [ 0.757135] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])278gitlab # [ 0.761287] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]279gitlab # [ 0.767487] acpiphp: Slot [3] registered280gitlab # [ 0.769358] acpiphp: Slot [4] registered281gitlab # [ 0.772358] acpiphp: Slot [5] registered282gitlab # [ 0.774386] acpiphp: Slot [6] registered283gitlab # [ 0.777316] acpiphp: Slot [7] registered284gitlab # [ 0.778313] acpiphp: Slot [8] registered285gitlab # [ 0.779311] acpiphp: Slot [9] registered286gitlab # [ 0.781327] acpiphp: Slot [10] registered287gitlab # [ 0.782317] acpiphp: Slot [11] registered288gitlab # [ 0.783315] acpiphp: Slot [12] registered289gitlab # [ 0.785584] acpiphp: Slot [13] registered290gitlab # [ 0.786311] acpiphp: Slot [14] registered291gitlab # [ 0.788305] acpiphp: Slot [15] registered292gitlab # [ 0.789319] acpiphp: Slot [16] registered293gitlab # [ 0.790306] acpiphp: Slot [17] registered294gitlab # [ 0.792365] acpiphp: Slot [18] registered295gitlab # [ 0.795361] acpiphp: Slot [19] registered296gitlab # [ 0.798415] acpiphp: Slot [20] registered297gitlab # [ 0.801363] acpiphp: Slot [21] registered298gitlab # [ 0.805369] acpiphp: Slot [22] registered299gitlab # [ 0.808360] acpiphp: Slot [23] registered300gitlab # [ 0.811404] acpiphp: Slot [24] registered301gitlab # [ 0.814363] acpiphp: Slot [25] registered302gitlab # [ 0.818362] acpiphp: Slot [26] registered303gitlab # [ 0.820343] acpiphp: Slot [27] registered304gitlab # [ 0.823392] acpiphp: Slot [28] registered305gitlab # [ 0.825346] acpiphp: Slot [29] registered306gitlab # [ 0.828398] acpiphp: Slot [30] registered307gitlab # [ 0.831377] acpiphp: Slot [31] registered308gitlab # [ 0.833383] PCI host bridge to bus 0000:00309gitlab # [ 0.836316] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]310gitlab # [ 0.838272] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]311gitlab # [ 0.840273] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]312gitlab # [ 0.842272] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]313gitlab # [ 0.844273] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]314gitlab # [ 0.847290] pci_bus 0000:00: root bus resource [bus 00-ff]315gitlab # [ 0.848813] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint316gitlab # [ 0.854095] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint317gitlab # [ 0.862550] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint318gitlab # [ 0.873444] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]319gitlab # [ 0.877443] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk320gitlab # [ 0.882283] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk321gitlab # [ 0.887280] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk322gitlab # [ 0.892280] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk323gitlab # [ 0.897049] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint324gitlab # [ 0.906406] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]325gitlab # [ 0.911866] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint326gitlab # [ 0.917544] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI327gitlab # [ 0.921319] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB328gitlab # [ 0.924609] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint329gitlab # [ 0.948454] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]330gitlab # [ 0.953356] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]331gitlab # [ 0.958414] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]332gitlab # [ 0.964237] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]333gitlab # [ 0.995283] pci 0000:00:02.0: pci_fixup_video+0x0/0x100 took 30273 usecs334gitlab # [ 1.000000] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint335gitlab # [ 1.014332] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]336gitlab # [ 1.018316] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]337gitlab # [ 1.023414] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]338gitlab # [ 1.028316] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]339gitlab # [ 1.038978] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint340gitlab # [ 1.050310] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]341gitlab # [ 1.053306] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]342gitlab # [ 1.057382] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]343gitlab # [ 1.062366] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint344gitlab # [ 1.069338] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]345gitlab # [ 1.070291] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]346gitlab # [ 1.072328] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]347gitlab # [ 1.077351] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint348gitlab # [ 1.084309] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]349gitlab # [ 1.085286] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]350gitlab # [ 1.088326] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]351gitlab # [ 1.092376] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint352gitlab # [ 1.098520] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]353gitlab # [ 1.100287] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]354gitlab # [ 1.102419] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]355gitlab # [ 1.106399] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint356gitlab # [ 1.112599] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]357gitlab # [ 1.114286] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]358gitlab # [ 1.116326] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]359gitlab # [ 1.120324] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint360gitlab # [ 1.125307] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]361gitlab # [ 1.127287] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]362gitlab # [ 1.128349] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]363gitlab # [ 1.131293] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]364gitlab # [ 1.138150] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint365gitlab # [ 1.151347] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]366gitlab # [ 1.155431] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]367gitlab # [ 1.167442] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint368gitlab # [ 1.181350] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]369gitlab # [ 1.186321] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]370gitlab # [ 1.190383] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]371gitlab # [ 1.198880] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint372gitlab # [ 1.210310] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]373gitlab # [ 1.213306] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]374gitlab # [ 1.217414] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]375gitlab # [ 1.241525] ACPI: PCI: Interrupt link LNKA configured for IRQ 10376gitlab # [ 1.246896] ACPI: PCI: Interrupt link LNKB configured for IRQ 10377gitlab # [ 1.251673] ACPI: PCI: Interrupt link LNKC configured for IRQ 11378gitlab # [ 1.255657] ACPI: PCI: Interrupt link LNKD configured for IRQ 11379gitlab # [ 1.258509] ACPI: PCI: Interrupt link LNKS configured for IRQ 9380gitlab # [ 1.265626] iommu: Default domain type: Translated381gitlab # [ 1.268271] iommu: DMA domain TLB invalidation policy: lazy mode382gitlab # [ 1.270949] ACPI: bus type USB registered383gitlab # [ 1.273581] usbcore: registered new interface driver usbfs384gitlab # [ 1.278388] usbcore: registered new interface driver hub385gitlab # [ 1.282368] usbcore: registered new device driver usb386gitlab # [ 1.289653] NetLabel: Initializing387gitlab # [ 1.292279] NetLabel: domain hash size = 128388gitlab # [ 1.296280] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO389gitlab # [ 1.300519] NetLabel: unlabeled traffic allowed by default390gitlab # [ 1.304315] PCI: Using ACPI for IRQ routing391gitlab # [ 1.309803] pci 0000:00:02.0: vgaarb: setting as boot VGA device392gitlab # [ 1.310266] pci 0000:00:02.0: vgaarb: bridge control possible393gitlab # [ 1.310266] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none394gitlab # [ 1.321289] vgaarb: loaded395gitlab # [ 1.323774] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0396gitlab # [ 1.327275] hpet0: 3 comparators, 64-bit 100.000000 MHz counter397gitlab # [ 1.333431] clocksource: Switched to clocksource kvm-clock398gitlab # [ 1.338795] VFS: Disk quotas dquot_6.6.0399gitlab # [ 1.342122] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)400gitlab # [ 1.348157] pnp: PnP ACPI init401gitlab # [ 1.352471] pnp: PnP ACPI: found 6 devices402gitlab # [ 1.368990] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns403gitlab # [ 1.375715] clocksource: Switched to clocksource acpi_pm404gitlab # [ 1.380427] NET: Registered PF_INET protocol family405gitlab # [ 1.387718] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)406gitlab # [ 1.421415] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)407gitlab # [ 1.424067] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)408gitlab # [ 1.427432] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)409gitlab # [ 1.432875] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)410gitlab # [ 1.435269] TCP: Hash tables configured (established 65536 bind 65536)411gitlab # [ 1.437373] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)412gitlab # [ 1.439692] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)413gitlab # [ 1.442114] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)414gitlab # [ 1.444430] NET: Registered PF_UNIX/PF_LOCAL protocol family415gitlab # [ 1.446296] NET: Registered PF_XDP protocol family416gitlab # [ 1.447838] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]417gitlab # [ 1.449744] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]418gitlab # [ 1.451681] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]419gitlab # [ 1.453754] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]420gitlab # [ 1.455878] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]421gitlab # [ 1.458330] pci 0000:00:01.0: PIIX3: Enabling Passive Release422gitlab # [ 1.460141] pci 0000:00:00.0: Limiting direct PCI/PCI transfers423gitlab # [ 1.463537] ACPI: \_SB_.LNKD: Enabled at IRQ 11424gitlab # [ 1.467030] PCI: CLS 0 bytes, default 64425gitlab # [ 1.468438] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)426gitlab # [ 1.468850] Trying to unpack rootfs image as initramfs...427gitlab # [ 1.470395] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)428gitlab # [ 1.470526] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns429gitlab # [ 1.526070] Initialise system trusted keyrings430gitlab # [ 1.529514] workingset: timestamp_bits=40 max_order=21 bucket_order=0431gitlab # [ 1.553724] Key type asymmetric registered432gitlab # [ 1.555107] Asymmetric key parser 'x509' registered433gitlab # [ 1.556703] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)434gitlab # [ 1.559457] io scheduler mq-deadline registered435gitlab # [ 1.560941] io scheduler kyber registered436gitlab # [ 1.565290] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled437gitlab # [ 1.567645] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A438gitlab # [ 1.572105] Linux agpgart interface v0.103439gitlab # [ 1.573530] ACPI: bus type drm_connector registered440gitlab # [ 1.578366] usbcore: registered new interface driver usbserial_generic441gitlab # [ 1.580400] usbserial: USB Serial support registered for generic442gitlab # [ 1.582270] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.443gitlab # [ 1.582270] Please enable it if your BIOS has the CPPC option.444gitlab # [ 1.586379] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled445gitlab # [ 1.588848] drop_monitor: Initializing network drop monitor service446gitlab # [ 1.591018] NET: Registered PF_INET6 protocol family447gitlab # [ 1.594108] Segment Routing with IPv6448gitlab # [ 1.595506] In-situ OAM (IOAM) with IPv6449gitlab # [ 1.602067] IPI shorthand broadcast: enabled450gitlab # [ 1.615755] sched_clock: Marking stable (1348074800, 266960856)->(1695347283, -80311627)451gitlab # [ 1.623627] registered taskstats version 1452gitlab # [ 1.627856] Loading compiled-in X.509 certificates453gitlab # [ 1.643996] Demotion targets for Node 0: null454gitlab # [ 1.645840] Key type .fscrypt registered455gitlab # [ 1.647157] Key type fscrypt-provisioning registered456gitlab # [ 1.648860] ima: No TPM chip found, activating TPM-bypass!457gitlab # [ 1.650577] ima: Allocated hash algorithm: sha1458gitlab # [ 1.652114] ima: No architecture policies found459gitlab # [ 1.653924] PM: Magic number: 10:339:771460gitlab # [ 1.656395] RAS: Correctable Errors collector initialized.461gitlab # [ 1.661916] clk: Disabling unused clocks462gitlab # [ 1.663253] PM: genpd: Disabling unused power domains463gitlab # [ 1.774894] Freeing initrd memory: 29392K464gitlab # [ 1.783287] Freeing unused decrypted memory: 2028K465gitlab # [ 1.791839] Freeing unused kernel image (initmem) memory: 3640K466gitlab # [ 1.796728] Write protecting the kernel read-only data: 32768k467gitlab # [ 1.804100] Freeing unused kernel image (text/rodata gap) memory: 1220K468gitlab # [ 1.810453] Freeing unused kernel image (rodata/data gap) memory: 760K469gitlab # [ 1.875539] x86/mm: Checked W+X mappings: passed, no W+X pages found.470gitlab # [ 1.877620] Run /init as init process471gitlab # [ 1.892573] systemd[1]: Inserted module 'autofs4'472gitlab # [ 1.921784] fuse: init (API version 7.45)473gitlab # [ 1.933043] ACPI: \_SB_.LNKC: Enabled at IRQ 10474gitlab # [ 1.943668] ACPI: \_SB_.LNKA: Enabled at IRQ 10475gitlab # [ 1.960544] ACPI: \_SB_.LNKB: Enabled at IRQ 11476gitlab # [ 2.012057] systemd[1]: Successfully made /usr/ read-only.477gitlab # [ 2.351569] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)478gitlab # [ 2.373347] systemd[1]: Detected virtualization kvm.479gitlab # [ 2.377370] systemd[1]: Detected architecture x86-64.480gitlab # [ 2.381395] systemd[1]: Running in initrd.481gitlab # [ 2.385589] systemd[1]: Initializing machine ID from random generator.482gitlab # [ 2.390862] systemd[1]: Hostname set to <gitlab>.483gitlab # [ 2.510809] systemd[1]: bpf-restrict-fs: LSM BPF program attached484gitlab # [ 2.579598] systemd[1]: Queued start job for default target Initrd Default Target.485gitlab # [ 2.590321] systemd[1]: Created slice Slice /system/modprobe.486gitlab # [ 2.592430] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.487gitlab # [ 2.594948] systemd[1]: Expecting device /dev/disk/by-label/nix-store...488gitlab # [ 2.597127] systemd[1]: Expecting device /dev/disk/by-label/nixos...489gitlab # [ 2.599197] systemd[1]: Reached target Path Units.490gitlab # [ 2.600805] systemd[1]: Reached target Slice Units.491gitlab # [ 2.602474] systemd[1]: Reached target Swaps.492gitlab # [ 2.604043] systemd[1]: Reached target Timer Units.493gitlab # [ 2.605802] systemd[1]: Listening on D-Bus System Message Bus Socket.494gitlab # [ 2.608058] systemd[1]: Listening on Journal Socket (/dev/log).495gitlab # [ 2.610181] systemd[1]: Listening on Journal Sockets.496gitlab # [ 2.612023] systemd[1]: Listening on udev Control Socket.497gitlab # [ 2.613887] systemd[1]: Listening on udev Kernel Socket.498gitlab # [ 2.615681] systemd[1]: Reached target Socket Units.499gitlab # [ 2.618697] systemd[1]: Starting Create List of Static Device Nodes...500gitlab # [ 2.622024] systemd[1]: Starting Load Kernel Module 9pnet_virtio...501gitlab # [ 2.626081] systemd[1]: Starting Load Kernel Module configfs...502gitlab # [ 2.640612] systemd[1]: Starting Journal Service...503gitlab # [ 2.646123] systemd[1]: Starting Load Kernel Modules...504gitlab # [ 2.647851] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os505gitlab # [ 2.652782] systemd[1]: Starting Coldplug All udev Devices...506gitlab # [ 2.669134] systemd[1]: Finished Create List of Static Device Nodes.507gitlab # [ 2.683317] systemd[1]: modprobe@configfs.service: Deactivated successfully.508gitlab # [ 2.692388] systemd[1]: Finished Load Kernel Module configfs.509gitlab # [ 2.698232] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config510gitlab # [ 2.706114] netfs: FS-Cache loaded511gitlab # [ 2.708686] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.512gitlab # [ 2.708850] systemd-journald[93]: Collecting audit messages is disabled.513gitlab # [ 2.709433] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev514gitlab # [ 2.712222] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...515gitlab # [ 2.731449] systemd[1]: Finished Load Kernel Modules.516gitlab # [ 2.733599] 9pnet: Installing 9P2000 support517gitlab # [ 2.735214] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.518gitlab # [ 2.741109] systemd[1]: Starting Apply Kernel Variables...519gitlab # [ 2.744375] systemd[1]: Starting Create Static Device Nodes in /dev...520gitlab # [ 2.746870] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.521gitlab # [ 2.753851] systemd[1]: Finished Load Kernel Module 9pnet_virtio.522gitlab # [ 2.760110] systemd[1]: Finished Apply Kernel Variables.523gitlab # [ 2.764812] systemd[1]: Finished Create Static Device Nodes in /dev.524gitlab # [ 2.767151] systemd[1]: Reached target Preparation for Local File Systems.525gitlab # [ 2.769325] systemd[1]: Reached target Local File Systems.526gitlab # [ 2.772257] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 2.784329] systemd[1]: Started Journal Service.528gitlab # [ 2.517558] systemd-modules-load[94]: Using 4 probe threads529gitlab # [ 2.521102] systemd-modules-load[94]: Inserted module 'dm_mod'530gitlab # [ 2.522828] systemd-modules-load[94]: Inserted module 'virtio_balloon'531gitlab # [ 2.525851] systemd-modules-load[94]: Inserted module 'virtio_gpu'532gitlab # [ 2.527569] systemd[1]: Starting Create System Files and Directories...533gitlab # [ 2.533548] systemd-udevd[105]: Using default interface naming scheme 'v261'.534gitlab # [ 2.542586] systemd[1]: Finished Create System Files and Directories.535gitlab # [ 2.553360] systemd[1]: Started Rule-based Manager for Device Events and Files.536gitlab # [ 2.571235] systemd[1]: Finished Coldplug All udev Devices.537gitlab # [ 2.572611] systemd[1]: Reached target System Initialization.538gitlab # [ 2.573988] systemd[1]: Reached target Basic System.539gitlab # [ 2.979830] SCSI subsystem initialized540gitlab # [ 3.012764] uhci_hcd 0000:00:01.2: UHCI Host Controller541gitlab # [ 3.015809] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1542gitlab # [ 3.017816] uhci_hcd 0000:00:01.2: detected 2 ports543gitlab # [ 3.019257] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140544gitlab # [ 3.020881] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18545gitlab # [ 3.023082] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1546gitlab # [ 3.024867] usb usb1: Product: UHCI Host Controller547gitlab # [ 3.026134] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd548gitlab # [ 3.027470] usb usb1: SerialNumber: 0000:00:01.2549gitlab # [ 3.027687] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12550gitlab # [ 3.028668] hub 1-0:1.0: USB hub found551gitlab # [ 3.031747] serio: i8042 KBD port at 0x60,0x64 irq 1552gitlab # [ 3.033042] hub 1-0:1.0: 2 ports detected553gitlab # [ 3.033539] serio: i8042 AUX port at 0x60,0x64 irq 12554gitlab # [ 3.047579] scsi host0: ata_piix555gitlab # [ 3.050105] virtio_blk virtio4: 4/0/0 default/read/poll queues556gitlab # [ 3.053797] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)557gitlab # [ 3.058210] scsi host1: ata_piix558gitlab # [ 3.075231] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0559gitlab # [ 3.077417] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0560gitlab # [ 2.822235] (udev-worker)[118]: Network interface NamePolicy= disabled on kernel command line.561gitlab # [ 2.825081] systemd[1]: Starting Virtual Console Setup...562gitlab # [ 3.093258] virtio_blk virtio5: 4/0/0 default/read/poll queues563gitlab # [ 2.826678] (udev-worker)[141]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.564gitlab # [ 2.831309] (udev-worker)[141]: Network interface NamePolicy= disabled on kernel command line.565gitlab # [ 3.101878] virtio_blk virtio5: [vdb] 11843200 512-byte logical blocks (6.06 GB/5.65 GiB)566gitlab # [ 2.848062] systemd-vconsole-setup[152]: Configuration of first virtual console was skipped, ignoring remaining ones.567gitlab # [ 2.850975] systemd[1]: Finished Virtual Console Setup.568gitlab # [ 3.235683] ata2: found unknown device (class 0)569gitlab # [ 3.241311] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100570gitlab # [ 3.248131] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5571gitlab # [ 3.259111] usb 1-1: new full-speed USB device number 2 using uhci_hcd572gitlab # [ 3.286595] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0573gitlab # [ 3.047538] systemd[1]: Found device /dev/disk/by-label/nixos.574gitlab # [ 3.318111] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray575gitlab # [ 3.056118] systemd[1]: Found device /dev/disk/by-label/nix-store.576gitlab # [ 3.058542] systemd[1]: Reached target Initrd Root Device.577gitlab # [ 3.061835] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...578gitlab # [ 3.362435] cdrom: Uniform CD-ROM driver Revision: 3.20579gitlab # [ 3.114393] systemd-fsck[159]: nixos: clean, 12/65536 files, 13019/262144 blocks580gitlab # [ 3.126776] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.581gitlab # [ 3.436641] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00582gitlab # [ 3.441832] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10583gitlab # [ 3.446709] usb 1-1: Product: QEMU USB Tablet584gitlab # [ 3.449848] usb 1-1: Manufacturer: QEMU585gitlab # [ 3.452918] usb 1-1: SerialNumber: 28754-0000:00:01.2-1586gitlab # [ 3.485928] hid: raw HID events driver (C) Jiri Kosina587gitlab # [ 3.495163] usbcore: registered new interface driver usbhid588gitlab # [ 3.496560] usbhid: USB HID core driver589gitlab # [ 3.503477] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2590gitlab # [ 3.506152] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0591gitlab # [ 3.400524] systemd[1]: Mounting /sysroot...592gitlab # [ 3.843598] EXT4-fs (vda): mounted filesystem 5cb7f69b-1007-469b-99de-2fba1a36ea91 r/w with ordered data mode. Quota mode: none.593gitlab # [ 3.581827] systemd[1]: Mounted /sysroot.594gitlab # [ 3.583813] systemd[1]: Reached target Initrd Root File System.595gitlab # [ 3.587059] systemd[1]: Mounting /sysroot/nix/.ro-store...596gitlab # [ 3.589185] systemd[1]: Mounting /sysroot/nix/.rw-store...597gitlab # [ 3.591341] systemd[1]: Mounting /sysroot/run...598gitlab # [ 3.600727] systemd[1]: Mounting /sysroot/tmp/shared...599gitlab # [ 3.606428] systemd[1]: Mounting /sysroot/tmp/xchg...600gitlab # [ 3.610759] systemd[1]: Starting Mountpoints Configured in the Real Root...601gitlab # [ 3.616584] systemd[1]: Mounted /sysroot/nix/.rw-store.602gitlab # [ 3.618171] systemd[1]: Mounted /sysroot/run.603gitlab # [ 3.887450] erofs (device vdb): mounted with root inode @ nid 128.604gitlab # [ 3.890285] 9p: Installing v9fs 9p2000 file system support605gitlab # [ 3.629460] systemd[1]: Starting rw-sysroot-nix-store.service...606gitlab # [ 3.631095] systemd[1]: Mounted /sysroot/nix/.ro-store.607gitlab # [ 3.632490] systemd[1]: Mounted /sysroot/tmp/shared.608gitlab # [ 3.633895] systemd[1]: Mounted /sysroot/tmp/xchg.609gitlab # [ 3.635678] systemd-sysroot-fstab-check[180]: /sysroot should be mounted in the initrd, will request daemon-reload.610gitlab # [ 3.638140] systemd[1]: Reload requested from client PID 180 ('systemd-sysroot') (unit initrd-parse-etc.service)...611gitlab # [ 3.640686] systemd[1]: Reloading...612gitlab # [ 3.700101] systemd[1]: Reloading finished in 63 ms.613gitlab # [ 3.728485] systemd-sysroot-fstab-check[180]: Requesting initrd-fs.target/start/replace...614gitlab # [ 3.733819] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.615gitlab # [ 3.738718] systemd[1]: Finished rw-sysroot-nix-store.service.616gitlab # [ 3.742649] systemd-sysroot-fstab-check[180]: Requesting swap.target/start/replace...617gitlab # [ 3.747583] systemd[1]: Starting rw-sysroot-nix-store.service...618gitlab # [ 3.751725] systemd[1]: initrd-parse-etc.service: Deactivated successfully.619gitlab # [ 3.756445] systemd[1]: Finished Mountpoints Configured in the Real Root.620gitlab # [ 3.760394] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.621gitlab # [ 3.764310] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.622gitlab # [ 3.767996] systemd[1]: Finished rw-sysroot-nix-store.service.623gitlab # [ 3.771206] systemd[1]: Mounting /sysroot/nix/store...624gitlab # [ 3.798422] systemd[1]: Mounted /sysroot/nix/store.625gitlab # [ 3.801826] systemd[1]: Reached target Initrd File Systems.626gitlab # [ 3.804445] systemd[1]: Starting Find NixOS closure...627gitlab # [ 3.806856] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...628gitlab # [ 3.833661] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.629gitlab # [ 3.850873] systemd[1]: Finished Find NixOS closure.630gitlab # [ 3.853979] systemd[1]: Reached target Initrd Default Target.631gitlab # [ 3.857666] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...632gitlab # [ 3.886814] systemd[1]: Stopped target Initrd Default Target.633gitlab # [ 3.891307] systemd[1]: Stopped target Basic System.634gitlab # [ 3.894273] systemd[1]: Stopped target Initrd Root Device.635gitlab # [ 3.897448] systemd[1]: Stopped target Path Units.636gitlab # [ 3.900189] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.637gitlab # [ 3.904431] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.638gitlab # [ 3.909460] systemd[1]: Stopped target Slice Units.639gitlab # [ 3.913479] systemd[1]: Stopped target Socket Units.640gitlab # [ 3.916478] systemd[1]: Stopped target System Initialization.641gitlab # [ 3.919995] systemd[1]: Stopped target Swaps.642gitlab # [ 3.922575] systemd[1]: Stopped target Timer Units.643gitlab # [ 3.924780] systemd[1]: dbus.socket: Deactivated successfully.644gitlab # [ 3.927178] systemd[1]: Closed D-Bus System Message Bus Socket.645gitlab # [ 3.929554] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.646gitlab # [ 3.932642] systemd[1]: Stopped Find NixOS closure.647gitlab # [ 3.934647] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio648gitlab # [ 3.938849] systemd[1]: Starting rw-sysroot-nix-store.service...649gitlab # [ 3.940289] systemd[1]: systemd-sysctl.service: Deactivated successfully.650gitlab # [ 3.941891] systemd[1]: Stopped Apply Kernel Variables.651gitlab # [ 3.943207] systemd[1]: systemd-modules-load.service: Deactivated successfully.652gitlab # [ 3.944898] systemd[1]: Stopped Load Kernel Modules.653gitlab # [ 3.946209] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.654gitlab # [ 3.948172] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.655gitlab # [ 3.950213] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.656gitlab # [ 3.951932] systemd[1]: Stopped Create System Files and Directories.657gitlab # [ 3.953439] systemd[1]: Stopped target Local File Systems.658gitlab # [ 3.954793] systemd[1]: Stopped target Preparation for Local File Systems.659gitlab # [ 3.956454] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.660gitlab # [ 3.958227] systemd[1]: Stopped Coldplug All udev Devices.661gitlab # [ 3.959604] systemd[1]: Stopping Rule-based Manager for Device Events and Files...662gitlab # [ 3.961410] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.663gitlab # [ 3.963185] systemd[1]: Stopped Virtual Console Setup.664gitlab # [ 3.964456] systemd[1]: initrd-cleanup.service: Deactivated successfully.665gitlab # [ 3.966092] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.666gitlab # [ 3.967678] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.667gitlab # [ 3.969454] systemd[1]: Finished rw-sysroot-nix-store.service.668gitlab # [ 3.970864] systemd[1]: systemd-udevd.service: Deactivated successfully.669gitlab # [ 3.972420] systemd[1]: Stopped Rule-based Manager for Device Events and Files.670gitlab # [ 3.974251] systemd[1]: systemd-udevd.service: Consumed 1.026s CPU time over 1.425s wall clock time, 26.2M memory peak.671gitlab # [ 3.976904] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.672gitlab # [ 3.978697] systemd[1]: Closed udev Control Socket.673gitlab # [ 3.979964] systemd[1]: Starting Cleanup udev Database...674gitlab # [ 3.981401] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.675gitlab # [ 3.983349] systemd[1]: Stopped Create Static Device Nodes in /dev.676gitlab # [ 3.984925] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.677gitlab # [ 3.986919] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.678gitlab # [ 3.988642] systemd[1]: kmod-static-nodes.service: Deactivated successfully.679gitlab # [ 3.990353] systemd[1]: Stopped Create List of Static Device Nodes.680gitlab # [ 3.991908] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.681gitlab # [ 3.993731] systemd[1]: Finished Cleanup udev Database.682gitlab # [ 3.995213] systemd[1]: Reached target Switch Root.683gitlab # [ 3.996549] systemd[1]: Starting NixOS Activation...684gitlab # [ 4.051163] initrd-nixos-activation-start[231]: booting system configuration /nix/store/chdhdrxd8m9y4d0fp06v0z6pm49jb6hp-nixos-system-gitlab-test685gitlab # [ 4.076249] initrd-nixos-activation-start[231]: running activation script...686gitlab # [ 4.296607] initrd-nixos-activation-start[254]: setting up /etc...687gitlab # [ 4.414699] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.688gitlab # [ 4.417467] systemd[1]: Finished NixOS Activation.689gitlab # [ 4.419792] systemd[1]: Starting Switch Root...690gitlab # [ 4.446873] systemd[1]: Switching root.691gitlab # [ 4.778700] systemd-journald[93]: Received SIGTERM from PID 1 (systemd).692gitlab # [ 4.910924] NET: Registered PF_VSOCK protocol family693gitlab # [ 5.286897] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)694gitlab # [ 5.303669] systemd[1]: Detected virtualization kvm.695gitlab # [ 5.306944] systemd[1]: Detected architecture x86-64.696gitlab # [ 5.310333] systemd[1]: Detected first boot.697gitlab # [ 5.314179] systemd[1]: Initializing machine ID from random generator.698gitlab # [ 5.454204] systemd[1]: bpf-restrict-fs: LSM BPF program attached699gitlab # [ 5.555455] systemd[1]: Applying preset policy.700gitlab # [ 5.715979] systemd[1]: Populated /etc with preset unit settings.701gitlab # [ 5.846910] systemd[1]: initrd-switch-root.service: Deactivated successfully.702gitlab # [ 5.849310] systemd[1]: Stopped initrd-switch-root.service.703gitlab # [ 5.852782] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.704gitlab # [ 5.856045] systemd[1]: Created slice Slice /system/getty.705gitlab # [ 5.858559] systemd[1]: Created slice GitLab DevOps Platform Slice.706gitlab # [ 5.860791] systemd[1]: Created slice User and Session Slice.707gitlab # [ 5.862481] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.708gitlab # [ 5.864516] systemd[1]: Started Forward Password Requests to Wall Directory Watch.709gitlab # [ 5.866458] systemd[1]: Expecting device /dev/hvc0...710gitlab # [ 5.867754] systemd[1]: Expecting device /dev/ttyS0...711gitlab # [ 5.869231] systemd[1]: Reached target Local Encrypted Volumes.712gitlab # [ 5.870709] systemd[1]: Stopped target initrd-fs.target.713gitlab # [ 5.872099] systemd[1]: Stopped target initrd-root-fs.target.714gitlab # [ 5.873553] systemd[1]: Stopped target initrd-switch-root.target.715gitlab # [ 5.875109] systemd[1]: Reached target Virtual Machines and Containers.716gitlab # [ 5.876772] systemd[1]: Reached target Path Units.717gitlab # [ 5.878146] systemd[1]: Reached target Remote File Systems.718gitlab # [ 5.879610] systemd[1]: Reached target Slice Units.719gitlab # [ 5.880985] systemd[1]: Reached target Swaps.720gitlab # [ 5.883112] systemd[1]: Listening on Query the User Interactively for a Password.721gitlab # [ 5.885936] systemd[1]: Listening on Process Core Dump Socket.722gitlab # [ 5.888082] systemd[1]: Listening on Credential Encryption/Decryption.723gitlab # [ 5.890488] systemd[1]: Listening on Factory Reset Management.724gitlab # [ 5.892137] systemd[1]: Listening on Hostname Service Socket.725gitlab # [ 5.895436] systemd[1]: Starting Journal Log Access Socket...726gitlab # [ 5.897748] systemd[1]: Listening on Journal Audit Socket.727gitlab # [ 5.900397] systemd[1]: Listening on Console Output Muting Service Socket.728gitlab # [ 5.902395] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.729gitlab # [ 5.904340] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os730gitlab # [ 5.906641] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki731gitlab # [ 5.910681] systemd[1]: Listening on Disk Repartitioning Service Socket.732gitlab # [ 5.912506] systemd[1]: Listening on udev Control Socket.733gitlab # [ 5.914119] systemd[1]: Listening on udev Varlink Socket.734gitlab # [ 5.917825] systemd[1]: Mounting Huge Pages File System...735gitlab # [ 5.933576] systemd[1]: Mounting POSIX Message Queue File System...736gitlab # [ 5.936661] systemd[1]: Mounting Kernel Debug File System...737gitlab # [ 5.939640] systemd[1]: Mounting Kernel Trace File System...738gitlab # [ 5.947537] systemd[1]: Starting Create List of Static Device Nodes...739gitlab # [ 5.951717] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio740gitlab # [ 5.962277] systemd[1]: Starting Load Kernel Module configfs...741gitlab # [ 5.966190] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm742gitlab # [ 5.972210] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore743gitlab # [ 5.978768] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse744gitlab # [ 5.988190] systemd[1]: Mounting FUSE Control File System...745gitlab # [ 5.991205] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67746gitlab # [ 6.007042] systemd[1]: Starting Journal Service...747gitlab # [ 6.018419] systemd[1]: Starting Load Kernel Modules...748gitlab # [ 6.024824] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...749gitlab # [ 6.030780] systemd-journald[327]: Collecting audit messages is enabled.750gitlab # [ 6.039260] systemd[1]: Starting Remount Root and Kernel File Systems...751gitlab # [ 6.045345] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os752gitlab # [ 5.780955] systemd[1]: Queued start job for default target Multi-User System.753gitlab # [ 5.785497] systemd[1]: Unnecessary job was removed for /dev/vdb.754gitlab # [ 5.787675] systemd[1]: systemd-journald.service: Deactivated successfully.755gitlab # [ 5.790146] systemd-modules-load[329]: Using 3 probe threads756gitlab # [ 6.059243] systemd[1]: Starting Coldplug All udev Devices...757gitlab # [ 5.795848] systemd-modules-load[329]: Insert[ 6.063134] loop: module loaded758gitlab # ed module 'tls'759gitlab # [ 5.798498] systemd-modules-load[329]: Inserted module 'loop'760gitlab # [ 6.066829] systemd[1]: Started Journal Service.761gitlab # [ 5.802728] systemd[1]: Listening on Journal Log Access Socket.762gitlab # [ 5.804427] systemd[1]: Mounted Huge Pages File System.763gitlab # [ 5.806145] systemd[1]: Mounted POSIX Message Queue File System.764gitlab # [ 5.807916] systemd[1]: Mounted Kernel Debug File System.765gitlab # [ 5.809411] systemd[1]: Mount[ 6.076143] EXT4-fs (vda): re-mounted 5cb7f69b-1007-469b-99de-2fba1a36ea91.766gitlab # ed Kernel Trace File System.767gitlab # [ 5.813759] systemd[1]: Finished Create List of Static Device Nodes.768gitlab # [ 5.815583] systemd[1]: modprobe@configfs.service: Deactivated successfully.769gitlab # [ 5.817390] systemd[1]: Finished Load Kernel Module configfs.770gitlab # [ 5.818912] systemd[1]: Mounted FUSE Control File System.771gitlab # [ 5.820414] systemd[1]: Finished Load Kernel Modules.772gitlab # [ 5.821806] systemd[1]: Mounting Kernel Configuration File System...773gitlab # [ 5.823648] systemd[1]: Starting Firewall...774gitlab # [ 5.828702] systemd[1]: Starting Apply Kernel Variables...775gitlab # [ 5.832678] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...776gitlab # [ 5.835968] systemd-oomd[330]: No swap; memory pressure usage will be degraded777gitlab # [ 5.838799] systemd[1]: Finished Remount Root and Kernel File Systems.778gitlab # [ 5.840564] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.779gitlab # [ 5.842728] systemd[1]: Mounted Kernel Configuration File System.780gitlab # [ 5.845294] systemd[1]: Listening on Disk Image Download Service Socket.781gitlab # [ 5.847823] systemd[1]: Starting Flush Journal to Persistent Storage...782gitlab # [ 5.850806] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore783gitlab # [ 5.854067] systemd[1]: Starting Load/Save OS Random Seed...784gitlab # [ 5.855728] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os785gitlab # [ 6.130294] systemd-journald[327]: Received client request to flush runtime journal.786gitlab # [ 5.925400] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.787gitlab # [ 5.927657] systemd[1]: Finished Apply Kernel Variables.788gitlab # [ 5.929265] systemd[1]: Starting Create Static Device Nodes in /dev...789gitlab # [ 5.930873] systemd[1]: Finished Load/Save OS Random Seed.790gitlab # [ 5.932458] systemd[1]: Reached target First Boot Complete.791gitlab # [ 5.934081] systemd[1]: Finished Create Static Device Nodes in /dev.792gitlab # [ 5.935900] systemd[1]: Reached target Preparation for Local File Systems.793gitlab # [ 5.937770] systemd[1]: Starting Rule-based Manager for Device Events and Files...794gitlab # [ 5.940068] systemd-udevd[364]: Using default interface naming scheme 'v261'.795gitlab # [ 5.941918] systemd[1]: Finished Flush Journal to Persistent Storage.796gitlab # [ 5.966051] systemd[1]: Started Rule-based Manager for Device Events and Files.797gitlab # [ 5.981399] systemd[1]: Finished Coldplug All udev Devices.798gitlab # [ 6.080365] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse799gitlab # [ 6.122624] systemd[1]: Finished Firewall.800gitlab # [ 6.131892] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.801gitlab # [ 6.135709] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.802gitlab # [ 6.141288] (udev-worker)[436]: Network interface NamePolicy= disabled on kernel command line.803gitlab # [ 6.147430] (udev-worker)[447]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.804gitlab # [ 6.151357] (udev-worker)[447]: Network interface NamePolicy= disabled on kernel command line.805gitlab # [ 6.186142] systemd[1]: Condition check resulted in Virtio network device being skipped.806gitlab # [ 6.189487] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore807gitlab # [ 6.192114] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67808gitlab # [ 6.196054] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore809gitlab # [ 6.198934] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os810gitlab # [ 6.201334] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os811gitlab # [ 6.472195] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3812gitlab # [ 6.480868] ACPI: button: Power Button [PWRF]813gitlab # [ 6.488905] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console814gitlab # [ 6.496308] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0815gitlab # [ 6.496401] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD816gitlab # [ 6.506019] Console: switching to colour dummy device 80x25817gitlab # [ 6.510490] [drm] Found bochs VGA, ID 0xb0c5.818gitlab # [ 6.510492] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.819gitlab # [ 6.513084] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic820gitlab # [ 6.516385] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0821gitlab # [ 6.531354] Console: switching to colour frame buffer device 160x50822gitlab # [ 6.533902] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device823gitlab # [ 6.536370] rtc_cmos 00:05: RTC can wake from S4824gitlab # [ 6.558153] parport_pc 00:03: reported by Plug and Play ACPI825gitlab # [ 6.561802] rtc_cmos 00:05: registered as rtc0826gitlab # [ 6.562921] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]827gitlab # [ 6.563143] rtc_cmos 00:05: setting system clock to 2026-09-06T06:46:03 UTC (1788677163)828gitlab # [ 6.566338] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs829gitlab # [ 6.573572] Floppy drive(s): fd0 is 2.88M AMI BIOS830gitlab # [ 6.580935] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4831gitlab # [ 6.586740] FDC 0 is a S82078B832gitlab # [ 6.600058] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6833gitlab # [ 6.603495] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5834gitlab # [ 6.615626] mousedev: PS/2 mouse device common for all mice835gitlab # [ 6.403688] systemd[1]: Starting Virtual Console Setup...836gitlab # [ 6.417188] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.837gitlab # [ 6.422187] systemd[1]: Stopped Virtual Console Setup.838gitlab # [ 6.423656] systemd[1]: Starting Virtual Console Setup...839gitlab # [ 6.696098] ppdev: user-space parallel port driver840gitlab # [ 6.434137] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.841gitlab # [ 6.436211] systemd[1]: Stopped Virtual Console Setup.842gitlab # [ 6.437704] systemd[1]: Starting Virtual Console Setup...843gitlab # [ 6.729695] kvm_amd: TSC scaling supported844gitlab # [ 6.730655] kvm_amd: Nested Virtualization enabled845gitlab # [ 6.732095] kvm_amd: Nested Paging enabled846gitlab # [ 6.733175] kvm_amd: LBR virtualization supported847gitlab # [ 6.734318] kvm_amd: Virtual VMLOAD VMSAVE supported848gitlab # [ 6.735686] kvm_amd: Virtual GIF supported849gitlab # [ 6.736811] kvm_amd: Virtual NMI enabled850gitlab # [ 6.785204] EDAC MC: Ver: 3.0.0851gitlab # [ 6.532518] systemd-vconsole-setup[498]: Configuration of first virtual console was skipped, ignoring remaining ones.852gitlab # [ 6.535824] systemd[1]: Finished Virtual Console Setup.853gitlab # [ 6.582047] systemd[1]: Mounting /run/wrappers...854gitlab # [ 6.600463] systemd[1]: Mounted /run/wrappers.855gitlab # [ 6.602191] systemd[1]: Reached target Local File Systems.856gitlab # [ 6.604161] systemd[1]: Listening on Boot Loader Control Service Socket.857gitlab # [ 6.606384] systemd[1]: Starting register-nix-paths.service...858gitlab # [ 6.608479] systemd[1]: Starting Create SUID/SGID Wrappers...859gitlab # [ 6.610442] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.860gitlab # [ 6.612928] systemd[1]: Starting Save Transient machine-id to Disk...861gitlab # [ 6.614613] systemd[1]: Starting Create System Files and Directories...862gitlab # [ 6.644351] systemd[1]: Finished Create System Files and Directories.863gitlab # [ 6.646923] systemd[1]: Starting Rebuild Journal Catalog...864gitlab # [ 6.649760] systemd[1]: Starting Record System Boot/Shutdown in UTMP...865gitlab # [ 6.654800] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.866gitlab # [ 6.658854] systemd[1]: Finished Save Transient machine-id to Disk.867gitlab # [ 6.671860] systemd[1]: Finished Record System Boot/Shutdown in UTMP.868gitlab # [ 6.682441] systemd[1]: Finished Rebuild Journal Catalog.869gitlab # [ 6.684102] systemd[1]: Starting Update is Completed...870gitlab # [ 6.698656] systemd[1]: Finished Update is Completed.871gitlab # [ 6.736787] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.872gitlab # [ 6.738673] systemd[1]: Finished Create SUID/SGID Wrappers.873gitlab # [ 6.999518] systemd[1]: Finished register-nix-paths.service.874gitlab # [ 7.003594] systemd[1]: Reached target System Initialization.875gitlab # [ 7.007654] systemd[1]: Started Discard unused filesystem blocks once a week.876gitlab # [ 7.012329] systemd[1]: Started logrotate.timer.877gitlab # [ 7.015730] systemd[1]: Started Daily Cleanup of Temporary Directories.878gitlab # [ 7.020142] systemd[1]: Reached target Timer Units.879gitlab # [ 7.023770] systemd[1]: Listening on D-Bus System Message Bus Socket.880gitlab # [ 7.028453] systemd[1]: Listening on Nix Daemon Socket.881gitlab # [ 7.032252] systemd[1]: Starting nixbot CI service socket...882gitlab # [ 7.036285] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.883gitlab # [ 7.041713] systemd[1]: Starting D-Bus System Message Bus...884gitlab # [ 7.045699] systemd[1]: Listening on nixbot CI service socket.885gitlab # [ 7.049765] systemd[1]: Reached target Socket Units.886gitlab # [ 7.079521] dbus-broker-launch[580]: Looking up NSS user entry for 'systemd-timesync'...887gitlab # [ 7.085712] dbus-broker-launch[580]: NSS returned no entry for 'systemd-timesync'888gitlab # [ 7.090205] dbus-broker-launch[580]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"889gitlab # [ 7.099742] systemd[1]: Started D-Bus System Message Bus.890gitlab # [ 7.104316] dbus-broker-launch[580]: Ready891gitlab # [ 7.110511] systemd[1]: Reached target Basic System.892gitlab # [ 7.114457] systemd[1]: Started backdoor.service.893gitlab # [ 7.117912] systemd[1]: Starting gitlab-config.service...894gitlab # [ 7.135261] systemd[1]: Starting Import lastlog data into lastlog2 database...895gitlab # [ 7.141548] systemd[1]: Starting Logrotate configuration check...896gitlab # connecting to host...897gitlab # [ 7.149580] systemd[1]: Starting Name Service Cache Daemon (nsncd)...898gitlab # [ 7.160555] systemd[1]: Starting Post-Boot Actions...899gitlab: Guest shell says: b'Spawning backdoor root shell...\n'900gitlab # [ 7.170281] systemd[1]: Started Reset console on configuration changes.901gitlab: connected to guest root shell902gitlab # [ 7.173611] systemd[1]: Starting resolvconf update...903gitlab: (connecting took 8.03 seconds)904gitlab: (finished: waiting for the VM to finish booting, in 8.03 seconds)905gitlab # [ 7.176333] logrotate[587]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.906gitlab # [ 7.180070] logrotate[587]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf907gitlab # [ 7.181191] logrotate[587]: note: 'monthly' overrides previously specified 'weekly'908gitlab # [ 7.185619] logrotate[587]: Reading state from file: /var/lib/logrotate.status909gitlab # [ 7.186883] logrotate[587]: state file /var/lib/logrotate.status does not exist910gitlab # [ 7.187922] logrotate[587]: Allocating hash table for state file, size 64 entries911gitlab # [ 7.192148] logrotate[587]: Handling 4 logs912gitlab # [ 7.192723] logrotate[587]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed913gitlab # [ 7.193914] logrotate[587]: considering log /var/log/btmp914gitlab # [ 7.194989] logrotate[587]: Creating new state915gitlab # [ 7.195847] logrotate[587]: Now: 2026-09-06 06:46916gitlab # [ 7.196992] logrotate[587]: Last rotated at 2026-09-06 06:00917gitlab # [ 7.197837] logrotate[587]: log does not need rotating (log has already been rotated)918gitlab # [ 7.199051] logrotate[587]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed919gitlab # [ 7.199922] logrotate[587]: considering log /var/log/wtmp920gitlab # [ 7.201044] logrotate[587]: Creating new state921gitlab # [ 7.201863] logrotate[587]: Now: 2026-09-06 06:46922gitlab # [ 7.202991] logrotate[587]: Last rotated at 2026-09-06 06:00923gitlab # [ 7.203847] logrotate[587]: log does not need rotating (log has already been rotated)924gitlab # [ 7.205039] logrotate[587]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed925gitlab # [ 7.205870] logrotate[587]: switching euid from 0 to 165 and egid from 0 to 165 (pid 587)926gitlab # [ 7.207054] logrotate[587]: considering log /var/gitlab/state/log/*.log927gitlab # [ 7.207841] logrotate[587]: log /var/gitlab/state/log/*.log does not exist -- skipping928gitlab # [ 7.209047] logrotate[587]: Creating new state929gitlab # [ 7.209835] logrotate[587]: switching euid from 165 to 0 and egid from 165 to 0 (pid 587)930gitlab # [ 7.211040] logrotate[587]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed931gitlab # [ 7.211833] logrotate[587]: switching euid from 0 to 60 and egid from 0 to 60 (pid 587)932gitlab # [ 7.213038] logrotate[587]: considering log /var/log/nginx/*.log933gitlab # [ 7.213844] logrotate[587]: log /var/log/nginx/*.log does not exist -- skipping934gitlab # [ 7.215040] logrotate[587]: Creating new state935gitlab # [ 7.215840] logrotate[587]: not running postrotate script, since no logs were rotated936gitlab # [ 7.217045] logrotate[587]: switching euid from 60 to 0 and egid from 60 to 0 (pid 587)937gitlab # [ 7.218083] systemd[1]: Finished Logrotate configuration check.938gitlab # [ 7.219370] systemd[1]: Finished Post-Boot Actions.939gitlab # [ 7.220435] systemd[1]: Started Name Service Cache Daemon (nsncd).940gitlab # [ 7.237354] nsncd[588]: Sep 06 06:46:04.394 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"941gitlab # [ 7.241183] systemd[1]: Finished Import lastlog data into lastlog2 database.942gitlab # [ 7.250814] systemd[1]: Reached target Host and Network Name Lookups.943gitlab # [ 7.252156] systemd[1]: Reached target User and Group Name Lookups.944gitlab # [ 7.253963] systemd[1]: Starting User Login Management...945gitlab # [ 7.287553] systemd[1]: Stopped target Host and Network Name Lookups.946gitlab # [ 7.290457] systemd[1]: Stopping Host and Network Name Lookups...947gitlab # [ 7.291816] systemd[1]: Stopped target User and Group Name Lookups.948gitlab # [ 7.292895] systemd[1]: Stopping User and Group Name Lookups...949gitlab # [ 7.294259] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...950gitlab # [ 7.297752] systemd-logind[637]: New seat seat0.951gitlab # [ 7.301437] systemd[1]: nscd.service: Deactivated successfully.952gitlab # [ 7.302766] systemd[1]: Stopped Name Service Cache Daemon (nsncd).953gitlab # [ 7.304728] systemd[1]: nscd.service: Consumed 31ms CPU time over 148ms wall clock time, 7.2M memory peak, 5.5M read from disk.954gitlab # [ 7.307783] systemd-logind[637]: Watching system buttons on /dev/input/event2 (Power Button)955gitlab # [ 7.310052] systemd-logind[637]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)956gitlab # [ 7.312394] systemd-logind[637]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)957gitlab # [ 7.314744] systemd[1]: Started User Login Management.958gitlab # [ 7.316257] systemd[1]: Starting linger-users.service...959gitlab # [ 7.317758] systemd[1]: Starting Name Service Cache Daemon (nsncd)...960gitlab # [ 7.332462] systemd[1]: linger-users.service: Deactivated successfully.961gitlab # [ 7.334361] systemd[1]: Finished linger-users.service.962gitlab # [ 7.336043] nsncd[680]: Sep 06 06:46:04.536 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"963gitlab # [ 7.339634] systemd[1]: Started Name Service Cache Daemon (nsncd).964gitlab # [ 7.341331] systemd[1]: Finished resolvconf update.965gitlab # [ 7.342700] systemd[1]: Reached target Preparation for Network.966gitlab # [ 7.344331] systemd[1]: Reached target Host and Network Name Lookups.967gitlab # [ 7.345914] systemd[1]: Reached target User and Group Name Lookups.968gitlab # [ 7.347559] systemd[1]: Starting DHCP Client...969gitlab # [ 7.348862] systemd[1]: Starting Address configuration of eth1...970gitlab # [ 7.350511] systemd[1]: Starting Extra networking commands....971gitlab # [ 7.377489] network-addresses-eth1-start[703]: adding address 192.168.1.1/24... done972gitlab # [ 7.381722] network-addresses-eth1-start[703]: adding address 2001:db8:1::1/64... done973gitlab # [ 7.386831] systemd[1]: Finished Address configuration of eth1.974gitlab # [ 7.421295] dhcpcd[712]: dhcpcd-10.3.2 starting975gitlab # [ 7.422671] systemd[1]: Finished Extra networking commands..976gitlab # [ 7.423732] systemd[1]: Reached target Network.977gitlab # [ 7.425745] systemd[1]: Starting gitlab-workhorse.service...978gitlab # [ 7.427161] systemd[1]: Starting Nginx Web Server...979gitlab # [ 7.428580] dhcpcd[769]: dev: loaded udev980gitlab # [ 7.430348] systemd[1]: Starting PostgreSQL Server...981gitlab # [ 7.701797] 8021q: 802.1Q VLAN Support v1.8982gitlab # [ 7.435590] systemd[1]: Start[ 7.702848] 8021q: adding VLAN 0 to HW filter on device eth1983gitlab # ing Redis Server - redis-gitlab...984gitlab # [ 7.439438] systemd[1]: Starting Permit User Sessions...985gitlab # [ 7.453851] systemd[1]: Finished Permit User Sessions.986gitlab # [ 7.459581] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.987gitlab # [ 7.467844] systemd[1]: Started Getty on tty1.988gitlab # [ 7.468906] systemd[1]: Reached target Login Prompts.989gitlab # [ 7.792350] cfg80211: Loading compiled-in X.509 certificates for regulatory database990gitlab # [ 7.798439] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'991gitlab # [ 7.800309] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'992gitlab # [ 7.803035] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2993gitlab # [ 7.805288] cfg80211: failed to load regulatory.db994gitlab # [ 7.579614] nginx-pre-start[7[ 7.846296] 8021q: adding VLAN 0 to HW filter on device eth0995gitlab # 93]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok996gitlab # [ 7.584194] nginx-pre-start[793]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful997gitlab # [ 7.587524] dhcpcd[769]: eth0: waiting for carrier998gitlab # [ 7.589079] systemd[1]: Started Nginx Web Server.999gitlab # [ 7.590417] dhcpcd[769]: eth0: carrier acquired1000gitlab # [ 7.591971] dhcpcd[769]: DUID 00:01:00:01:32:2f:c8:ac:52:54:00:12:34:561001gitlab # [ 7.593679] dhcpcd[769]: eth0: IAID 00:12:34:561002gitlab # [ 7.595362] dhcpcd[769]: eth0: adding address fe80::5054:ff:fe12:34561003gitlab # [ 7.609804] postgresql-pre-start[800]: The files belonging to this database system will be owned by user "postgres".1004gitlab # [ 7.612843] postgresql-pre-start[800]: This user must also own the server process.1005gitlab # [ 7.615200] postgresql-pre-start[800]: The database cluster will be initialized with locale "en_US.UTF-8".1006gitlab # [ 7.617448] postgresql-pre-start[800]: The default database encoding has accordingly been set to "UTF8".1007gitlab # [ 7.619819] postgresql-pre-start[800]: The default text search configuration will be set to "english".1008gitlab # [ 7.622309] postgresql-pre-start[800]: Data page checksums are enabled.1009gitlab # [ 7.623577] postgresql-pre-start[800]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1010gitlab # [ 7.624423] systemd[1]: Started Redis Server - redis-gitlab.1011gitlab # [ 7.625606] redis-server[792]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.1012gitlab # [ 7.626897] postgresql-pre-start[800]: creating subdirectories ... ok1013gitlab # [ 7.627765] postgresql-pre-start[800]: selecting dynamic shared memory implementation ... posix1014gitlab # [ 7.628759] redis-server[792]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1015gitlab # [ 7.630062] redis-server[792]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=792, just started1016gitlab # [ 7.631235] redis-server[792]: Configuration loaded1017gitlab # [ 7.632133] redis[792]: monotonic clock: POSIX clock_gettime1018gitlab # [ 7.633161] redis[792]: Running mode=standalone, port=0.1019gitlab # [ 7.634187] redis[792]: Server initialized1020gitlab # [ 7.635294] redis[792]: Ready to accept connections unix1021gitlab # [ 7.636203] redis[792]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1022gitlab # [ 7.689347] postgresql-pre-start[800]: selecting default "max_connections" ... 1001023gitlab # [ 7.734782] postgresql-pre-start[800]: selecting default "shared_buffers" ... 128MB1024gitlab # [ 7.970526] systemd[1]: Started gitlab-workhorse.service.1025gitlab # [ 8.142616] gitlab-workhorse[828]: time="2026-09-06T06:46:05Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41026gitlab # [ 8.145984] gitlab-workhorse[828]: time="2026-09-06T06:46:05Z" level=info msg="Using redis/go-redis"1027gitlab # [ 8.148446] gitlab-workhorse[828]: time="2026-09-06T06:46:05Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1028gitlab # [ 8.166385] postgresql-pre-start[800]: selecting default time zone ... UTC1029gitlab # [ 8.168086] postgresql-pre-start[800]: creating configuration files ... ok1030gitlab # [ 8.345656] postgresql-pre-start[800]: running bootstrap script ... ok1031gitlab # [ 8.631379] dhcpcd[769]: eth0: soliciting a DHCP lease1032gitlab # [ 8.904445] NET: Registered PF_PACKET protocol family1033gitlab # [ 8.642386] dhcpcd[769]: eth0: offered 10.0.2.15 from 10.0.2.21034gitlab # [ 8.647468] dhcpcd[769]: eth0: probing address 10.0.2.15/241035gitlab # [ 8.799762] postgresql-pre-start[800]: performing post-bootstrap initialization ... ok1036gitlab # [ 9.203472] postgresql-pre-start[800]: syncing data to disk ... ok1037gitlab # [ 9.207597] postgresql-pre-start[800]: initdb: warning: enabling "trust" authentication for local connections1038gitlab # [ 9.213563] postgresql-pre-start[800]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1039gitlab # [ 9.222750] postgresql-pre-start[800]: Success. You can now start the database server using:1040gitlab # [ 9.228592] postgresql-pre-start[800]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1041gitlab # [ 9.319161] postgres[853]: [853] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1042gitlab # [ 9.322719] postgres[853]: [853] LOG: listening on IPv6 address "::1", port 54321043gitlab # [ 9.325422] postgres[853]: [853] LOG: listening on IPv4 address "127.0.0.1", port 54321044gitlab # [ 9.342850] postgres[853]: [853] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1045gitlab # [ 9.357938] postgres[872]: [872] LOG: database system was shut down at 2026-09-06 06:46:05 GMT1046gitlab # [ 9.370327] postgres[853]: [853] LOG: database system is ready to accept connections1047gitlab # [ 9.377500] systemd[1]: Started PostgreSQL Server.1048gitlab # [ 9.384980] systemd[1]: Starting PostgreSQL Setup Scripts...1049gitlab # [ 9.773650] postgresql-setup-start[883]: CREATE DATABASE1050gitlab # [ 9.798855] postgresql-setup-start[893]: CREATE ROLE1051gitlab # [ 9.809357] postgresql-setup-start[895]: ALTER DATABASE1052gitlab # [ 9.833483] postgresql-setup-start[900]: CREATE ROLE1053gitlab # [ 9.838501] systemd[1]: Finished PostgreSQL Setup Scripts.1054gitlab # [ 9.841082] systemd[1]: Reached target PostgreSQL.1055gitlab # [ 9.842945] systemd[1]: Starting gitlab-postgresql.service...1056gitlab # [ 9.847494] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[888]: mkdir -p /var/gitlab/state/home/.ssh: OK1057gitlab # [ 9.851874] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[888]: chmod 700 /var/gitlab/state/home/.ssh: OK1058gitlab # [ 9.887548] dhcpcd[769]: eth0: soliciting an IPv6 router1059gitlab # [ 9.889515] dhcpcd[769]: eth0: Router Advertisement from fe80::21060gitlab # [ 9.891552] dhcpcd[769]: eth0: adding address fec0::5054:ff:fe12:3456/641061gitlab # [ 9.894519] dhcpcd[769]: eth0: adding route to fec0::/641062gitlab # [ 9.896453] dhcpcd[769]: eth0: adding default route via fe80::21063gitlab # [ 9.900218] systemd[1]: Finished gitlab-config.service.1064gitlab # [ 9.904358] systemd[1]: Started gitaly.service.1065gitlab # [ 9.906208] systemd[1]: Starting gitlab-db-config.service...1066gitlab # [ 9.950502] gitlab-postgresql-start[915]: CREATE DATABASE1067gitlab # [ 10.001308] gitlab-postgresql-start[929]: CREATE EXTENSION1068gitlab # [ 10.084648] gitlab-postgresql-start[931]: CREATE EXTENSION1069gitlab # [ 10.090143] systemd[1]: Finished gitlab-postgresql.service.1070gitlab # [ 10.401668] gitaly[922]: time="2026-09-06T06:46:07.604Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9221071gitlab # [ 10.419714] gitaly[922]: time="2026-09-06T06:46:07.604Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9221072gitlab # [ 10.426723] gitaly[922]: time="2026-09-06T06:46:07.604Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9221073gitlab # [ 10.435346] gitaly[922]: time="2026-09-06T06:46:07.604Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9221074gitlab # [ 10.442093] gitaly[922]: time="2026-09-06T06:46:07.604Z" level=info msg="Starting Gitaly" pid=922 version=1075gitlab # [ 10.575101] gitaly[922]: time="2026-09-06T06:46:07.778Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=170 pid=9221076gitlab # [ 10.578357] gitaly[922]: time="2026-09-06T06:46:07.778Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9221077gitlab # [ 10.581369] gitaly[922]: time="2026-09-06T06:46:07.779Z" level=info msg="finished initializing command factory" duration_ms=0 pid=9221078gitlab # [ 10.584334] gitaly[922]: time="2026-09-06T06:46:07.779Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-922/git-exec-4131801638.d/git pid=9221079gitlab # [ 10.588170] gitaly[922]: time="2026-09-06T06:46:07.783Z" level=info msg="finished detecting git version" duration_ms=4 pid=9221080gitlab # [ 10.591255] gitaly[922]: time="2026-09-06T06:46:07.783Z" level=info msg="using Git version" pid=922 version=2.53.g1081gitlab # [ 10.594161] gitaly[922]: time="2026-09-06T06:46:07.783Z" level=info msg="clearing disk cache object folder" pid=922 storage=default1082gitlab # [ 10.597388] gitaly[922]: time="2026-09-06T06:46:07.784Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4079595900 pid=922 storage=default1083gitlab # [ 10.602173] gitaly[922]: time="2026-09-06T06:46:07.784Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4079595900 pid=922 storage=default1084gitlab # [ 10.607539] gitaly[922]: time="2026-09-06T06:46:07.784Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9221085gitlab # [ 10.612294] gitaly[922]: time="2026-09-06T06:46:07.784Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9221086gitlab # [ 10.617207] gitaly[922]: time="2026-09-06T06:46:07.784Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4079595900 clear_duration_ms=0 pid=922 storage=default1087gitlab # [ 10.651788] gitaly[922]: time="2026-09-06T06:46:07.855Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9221088gitlab # [ 10.653092] gitaly[922]: time="2026-09-06T06:46:07.855Z" level=info msg="counting repositories" pid=9221089gitlab # [ 10.654305] gitaly[922]: time="2026-09-06T06:46:07.855Z" level=info msg="finished tempdir cleaner walk" pid=922 storage=default time_ms=01090gitlab # [ 10.654889] gitaly[922]: time="2026-09-06T06:46:07.855Z" level=info msg="starting to count repositories" pid=922 storage_path=/var/gitlab/state/repositories1091gitlab # [ 10.655947] gitaly[922]: time="2026-09-06T06:46:07.855Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=922 storage_path=/var/gitlab/state/repositories1092gitlab # [ 10.656945] gitaly[922]: time="2026-09-06T06:46:07.855Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9221093gitlab # [ 10.658377] gitaly[922]: time="2026-09-06T06:46:07.855Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=922 schema=unix1094gitlab # [ 10.659404] gitaly[922]: time="2026-09-06T06:46:07.855Z" level=info msg="listening at address" address=/run/gitaly/gitaly-922/sock.d/intern pid=922 schema=unix1095gitlab # [ 10.679609] gitaly[922]: time="2026-09-06T06:46:07.883Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9221096gitlab # [ 10.682761] gitaly[922]: time="2026-09-06T06:46:07.883Z" level=info msg="Started Gitaly" duration_ms=276 pid=9221097gitlab # [ 10.685417] gitaly[922]: time="2026-09-06T06:46:07.883Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9221098gitlab # [ 10.688485] gitaly[922]: time="2026-09-06T06:46:07.884Z" level=info msg="maintenance: daily scheduled" pid=922 scheduled="2026-09-06 12:00:00 +0000 UTC"1099gitlab # [ 11.232684] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[925]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1100gitlab # [ 11.234299] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[925]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1101gitlab # [ 11.257426] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[925]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1102gitlab # [ 12.547421] gitaly[922]: time="2026-09-06T06:46:09.750Z" level=info msg="License database preloaded" duration_ms=2145 pid=9221103gitlab # [ 14.167218] dhcpcd[769]: eth0: leased 10.0.2.15 for 86400 seconds1104gitlab # [ 14.171505] dhcpcd[769]: eth0: adding route to 10.0.2.0/241105gitlab # [ 14.175146] dhcpcd[769]: eth0: adding default route via 10.0.2.21106gitlab # [ 14.307652] systemd[1]: Started DHCP Client.1107gitlab # [ 14.312652] systemd[1]: Reached target Network is Online.1108gitlab # [ 42.275206] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[925]: W, [2026-09-06T06:46:39.478005 #925] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1109gitlab # [ 44.098201] postgres[1322]: [1322] ERROR: relation "feature_gates" does not exist at character 5231110gitlab # [ 44.100986] postgres[1322]: [1322] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1111gitlab # [ 44.102961] postgres[1322]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1112gitlab # [ 44.105698] postgres[1322]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1113gitlab # [ 44.109178] postgres[1322]: attidentity AS identity,1114gitlab # [ 44.112555] postgres[1322]: attgenerated as attgenerated1115gitlab # [ 44.115951] postgres[1322]: FROM pg_attribute a1116gitlab # [ 44.120084] postgres[1322]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1117gitlab # [ 44.122792] postgres[1322]: LEFT JOIN pg_type t ON a.atttypid = t.oid1118gitlab # [ 44.126842] postgres[1322]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1119gitlab # [ 44.130925] postgres[1322]: WHERE a.attrelid = '"feature_gates"'::regclass1120gitlab # [ 44.135116] postgres[1322]: AND a.attnum > 0 AND NOT a.attisdropped1121gitlab # [ 44.138651] postgres[1322]: ORDER BY a.attnum1122gitlab # [ 44.142444] postgres[1322]:1123gitlab # [ 47.679315] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1364]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1124gitlab # [ 47.682851] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1364]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1125gitlab # [ 48.193336] gitlab-workhorse[828]: time="2026-09-06T06:46:45Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1126gitlab # [ 58.200781] gitlab-workhorse[828]: time="2026-09-06T06:46:55Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1127gitlab # [ 65.841398] postgres[1448]: [1448] ERROR: relation "table_without_models" does not exist1128gitlab # [ 65.843859] postgres[1448]: [1448] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1129gitlab # [ 68.210700] gitlab-workhorse[828]: time="2026-09-06T06:47:05Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1130gitlab # [ 78.211500] gitlab-workhorse[828]: time="2026-09-06T06:47:15Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1131gitlab # [ 80.922208] systemd[1]: Finished gitlab-db-config.service.1132gitlab # [ 80.928795] systemd[1]: Started gitlab-sidekiq.service.1133gitlab # [ 80.933451] systemd[1]: Starting gitlab.service...1134gitlab # [ 81.356496] bundle[1651]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1135gitlab # [ 81.358611] bundle[1651]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1136gitlab # [ 81.360632] bundle[1651]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1137gitlab # [ 84.194203] sidekiq-cluster[1650]: {"severity":"INFO","time":"2026-09-06T06:47:21.379Z","message":"Starting cluster with 1 processes"}1138gitlab # [ 84.343591] bundle[1651]: {"timestamp":"2026-09-06T06:47:21.526Z","pid":1651,"message":"* Enabling systemd notification integration"}1139gitlab # [ 84.346905] bundle[1651]: {"timestamp":"2026-09-06T06:47:21.546Z","pid":1651,"message":"Puma starting in cluster mode..."}1140gitlab # [ 84.350182] bundle[1651]: {"timestamp":"2026-09-06T06:47:21.546Z","pid":1651,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1141gitlab # [ 84.353193] bundle[1651]: {"timestamp":"2026-09-06T06:47:21.546Z","pid":1651,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1142gitlab # [ 84.355865] bundle[1651]: {"timestamp":"2026-09-06T06:47:21.546Z","pid":1651,"message":"* Min threads: 0"}1143gitlab # [ 84.359971] bundle[1651]: {"timestamp":"2026-09-06T06:47:21.546Z","pid":1651,"message":"* Max threads: 4"}1144gitlab # [ 84.364651] bundle[1651]: {"timestamp":"2026-09-06T06:47:21.546Z","pid":1651,"message":"* Environment: production"}1145gitlab # [ 84.367283] bundle[1651]: {"timestamp":"2026-09-06T06:47:21.546Z","pid":1651,"message":"* Master PID: 1651"}1146gitlab # [ 84.369978] bundle[1651]: {"timestamp":"2026-09-06T06:47:21.546Z","pid":1651,"message":"* Workers: 2"}1147gitlab # [ 84.372792] bundle[1651]: {"timestamp":"2026-09-06T06:47:21.546Z","pid":1651,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1148gitlab # [ 84.376314] bundle[1651]: {"timestamp":"2026-09-06T06:47:21.546Z","pid":1651,"message":"* Preloading application"}1149gitlab # [ 88.222908] gitlab-workhorse[828]: time="2026-09-06T06:47:25Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1150gitlab # [ 98.233981] gitlab-workhorse[828]: time="2026-09-06T06:47:35Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1151gitlab # [ 108.171940] bundle[1651]: W, [2026-09-06T06:47:45.374651 #1651] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1152gitlab # [ 108.244558] gitlab-workhorse[828]: time="2026-09-06T06:47:45Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1153gitlab # [ 110.735217] sidekiq-cluster[1681]: 2026-09-06T06:47:47.938Z pid=1681 tid=wft INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1681, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>449974272}1154gitlab # [ 110.905604] sidekiq-cluster[1681]: W, [2026-09-06T06:47:48.109051 #1681] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1155gitlab # [ 110.945298] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:48.148Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1156gitlab # [ 113.046928] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.249Z","message":"GitLab reliable fetch activated!"}1157gitlab # [ 113.053758] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.249Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1158gitlab # [ 113.073175] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.276Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1159gitlab # [ 113.083282] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.280Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1160gitlab # [ 113.086657] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.284Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1161gitlab # [ 113.089650] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.291Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1162gitlab # [ 113.093802] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.297Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1163gitlab # [ 113.101335] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.304Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1164gitlab # [ 113.105832] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.309Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1165gitlab # [ 113.112335] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.315Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1166gitlab # [ 113.118255] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.321Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1167gitlab # [ 113.123979] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.327Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1168gitlab # [ 113.128474] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.332Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1169gitlab # [ 113.133569] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.337Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1170gitlab # [ 113.138446] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.342Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1171gitlab # [ 113.142941] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.346Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1172gitlab # [ 113.146896] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.350Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1173gitlab # [ 113.150856] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.354Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1174gitlab # [ 113.154961] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.358Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1175gitlab # [ 113.158797] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.362Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1176gitlab # [ 113.165305] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.369Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1177gitlab # [ 113.171623] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.375Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1178gitlab # [ 113.178285] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.381Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1179gitlab # [ 113.184884] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.388Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1180gitlab # [ 113.190996] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.394Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1181gitlab # [ 113.197060] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.400Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1182gitlab # [ 113.203864] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.407Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1183gitlab # [ 113.210255] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.413Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1184gitlab # [ 113.216050] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.419Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1185gitlab # [ 113.219881] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.423Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1186gitlab # [ 113.223734] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.427Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1187gitlab # [ 113.227498] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.431Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1188gitlab # [ 113.231246] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.434Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1189gitlab # [ 113.235317] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.439Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1190gitlab # [ 113.239327] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.443Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1191gitlab # [ 113.243271] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.446Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1192gitlab # [ 113.246930] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.450Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1193gitlab # [ 113.250654] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.454Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1194gitlab # [ 113.254445] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.458Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1195gitlab # [ 113.258694] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.462Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1196gitlab # [ 113.261925] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.465Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1197gitlab # [ 113.265368] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.469Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1198gitlab # [ 113.269097] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.472Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1199gitlab # [ 113.272430] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.476Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1200gitlab # [ 113.276231] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.479Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1201gitlab # [ 113.279880] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.483Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1202gitlab # [ 113.283643] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.487Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1203gitlab # [ 113.287752] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.491Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1204gitlab # [ 113.291215] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.494Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1205gitlab # [ 113.294716] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.498Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1206gitlab # [ 113.298412] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.502Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1207gitlab # [ 113.302346] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.506Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1208gitlab # [ 113.330189] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.533Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1209gitlab # [ 113.334181] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.537Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1210gitlab # [ 113.344958] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.548Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1211gitlab # [ 113.349363] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.553Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1212gitlab # [ 113.353110] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.556Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1213gitlab # [ 113.356776] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.560Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1214gitlab # [ 113.360619] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.564Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1215gitlab # [ 113.364591] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.568Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1216gitlab # [ 113.368697] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.572Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1217gitlab # [ 113.372218] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.575Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1218gitlab # [ 113.376300] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.580Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1219gitlab # [ 113.379593] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.583Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1220gitlab # [ 113.384195] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.587Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1221gitlab # [ 113.387917] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.591Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1222gitlab # [ 113.391813] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.595Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1223gitlab # [ 113.395531] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.599Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1224gitlab # [ 113.399496] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.603Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1225gitlab # [ 113.402911] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.606Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1226gitlab # [ 113.406573] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.610Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1227gitlab # [ 113.410040] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.613Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1228gitlab # [ 113.412977] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.616Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1229gitlab # [ 113.416814] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.620Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1230gitlab # [ 113.420048] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.623Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1231gitlab # [ 113.423522] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.627Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1232gitlab # [ 113.426609] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.630Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1233gitlab # [ 113.429646] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.633Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1234gitlab # [ 113.433184] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.636Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1235gitlab # [ 113.436181] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.639Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1236gitlab # [ 113.439511] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.643Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1237gitlab # [ 113.442839] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.646Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1238gitlab # [ 113.446249] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.649Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1239gitlab # [ 113.449463] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.653Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1240gitlab # [ 113.454137] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.657Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1241gitlab # [ 113.457351] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.661Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1242gitlab # [ 113.460607] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.664Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1243gitlab # [ 113.464107] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.667Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1244gitlab # [ 113.467965] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.671Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1245gitlab # [ 113.471404] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.675Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1246gitlab # [ 113.474327] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.678Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1247gitlab # [ 113.477822] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.681Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1248gitlab # [ 113.481095] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.684Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1249gitlab # [ 113.484057] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.687Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1250gitlab # [ 113.487320] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.691Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1251gitlab # [ 113.490543] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.694Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1252gitlab # [ 113.494701] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.698Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1253gitlab # [ 113.498526] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.702Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1254gitlab # [ 113.501877] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.705Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1255gitlab # [ 113.505389] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.709Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1256gitlab # [ 113.516567] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.720Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1257gitlab # [ 113.520154] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.723Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1258gitlab # [ 113.523498] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.727Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1259gitlab # [ 113.528089] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.731Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1260gitlab # [ 113.531791] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.735Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1261gitlab # [ 113.535506] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.739Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1262gitlab # [ 113.539333] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.743Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1263gitlab # [ 113.542763] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.746Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1264gitlab # [ 113.546088] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.749Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1265gitlab # [ 113.549980] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.753Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1266gitlab # [ 113.553503] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:47:50.757Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1267gitlab # [ 118.255625] gitlab-workhorse[828]: time="2026-09-06T06:47:55Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1268gitlab # [ 128.257161] gitlab-workhorse[828]: time="2026-09-06T06:48:05Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1269gitlab # [ 134.610988] postgres[2148]: [2148] ERROR: relation "table_without_models" does not exist1270gitlab # [ 134.613633] postgres[2148]: [2148] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1271gitlab # [ 135.521641] postgres[2159]: [2159] ERROR: relation "table_without_models" does not exist1272gitlab # [ 135.523693] postgres[2159]: [2159] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1273gitlab # [ 137.221947] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:14.422Z","message":"Booted Rails 7.2.3.1 application in production environment"}1274gitlab # [ 137.225304] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:14.423Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1275gitlab # [ 137.228576] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:14.423Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1276gitlab # [ 137.231627] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:14.424Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1277gitlab # [ 137.235094] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:14.426Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1278gitlab # [ 138.268152] gitlab-workhorse[828]: time="2026-09-06T06:48:15Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1279gitlab # [ 138.520548] bundle[1651]: {"timestamp":"2026-09-06T06:48:15.723Z","pid":1651,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1280gitlab # [ 138.523852] bundle[1651]: {"timestamp":"2026-09-06T06:48:15.723Z","pid":1651,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1281gitlab # [ 138.527212] bundle[1651]: {"timestamp":"2026-09-06T06:48:15.723Z","pid":1651,"message":"! #\u003cThread:0x000078c9955de828 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1282gitlab # [ 138.529909] bundle[1651]: {"timestamp":"2026-09-06T06:48:15.723Z","pid":1651,"message":"! #\u003cThread:0x000078c9957b4968 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1283gitlab # [ 138.534277] bundle[1651]: {"timestamp":"2026-09-06T06:48:15.723Z","pid":1651,"message":"Use Ctrl-C to stop"}1284gitlab # [ 138.536846] bundle[1651]: {"timestamp":"2026-09-06T06:48:15.724Z","pid":1651,"message":"Sending status to systemd every 1.0 sec"}1285gitlab # [ 138.612936] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:15.815Z","message":"Cleaning working queues"}1286gitlab # [ 138.615895] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:15.817Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"c94763e52d7630117715e5f1","created_at":"2026-09-06T06:47:17.733Z","trace_propagation_headers":{"sentry-trace":"04122b90604a43798eec0f8ebef9ef25-52a848a19b8849d0","baggage":"sentry-trace_id=04122b90604a43798eec0f8ebef9ef25,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"6c6ba7c3c0f8d5b29a0da7aa92d8c4a9","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-06T06:47:17.744Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-c94763e52d7630117715e5f1: start","job_status":"start","queue_duration_s":58.073175,"scheduling_latency_s":58.073237}1287gitlab # [ 138.821996] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:16.025Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"c94763e52d7630117715e5f1","created_at":"2026-09-06T06:47:17.733Z","trace_propagation_headers":{"sentry-trace":"04122b90604a43798eec0f8ebef9ef25-52a848a19b8849d0","baggage":"sentry-trace_id=04122b90604a43798eec0f8ebef9ef25,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"6c6ba7c3c0f8d5b29a0da7aa92d8c4a9","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-06T06:47:17.744Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-c94763e52d7630117715e5f1: done: 0.208001 sec","job_status":"done","queue_duration_s":58.073175,"scheduling_latency_s":58.073237,"redis_calls":26,"redis_duration_s":0.006477,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.003445,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001755,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001277,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062079,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.095232496,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.208001,"completed_at":"2026-09-06T06:48:16.025Z","load_balancing_strategy":"primary","db_duration_s":0.064136,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1288gitlab # [ 140.810288] bundle[1651]: {"timestamp":"2026-09-06T06:48:18.012Z","pid":1651,"message":"- Worker 1 (PID: 2224) booted in 2.14s, phase: 0"}1289gitlab # [ 140.827270] bundle[1651]: {"timestamp":"2026-09-06T06:48:18.030Z","pid":1651,"message":"- Worker 0 (PID: 2220) booted in 2.18s, phase: 0"}1290gitlab # [ 140.836460] systemd[1]: Started gitlab.service.1291gitlab # [ 140.838698] systemd[1]: Reached target Common target for all GitLab services..1292gitlab # [ 140.843258] systemd[1]: Starting setup-gitlab.service...1293gitlab # [ 140.863298] setup-gitlab-start[2268]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1294gitlab # [ 141.396309] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:48:18 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 5021295gitlab # [ 141.405267] setup-gitlab-start[2268]: + TOKEN=nixbot-test-token-of-20-chars1296gitlab # [ 141.408171] setup-gitlab-start[2268]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1297gitlab # [ 141.442337] runuser[2278]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1298gitlab # [ 141.841689] setup-gitlab-start[2283]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1299gitlab # [ 141.844563] setup-gitlab-start[2283]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1300gitlab # [ 141.847317] setup-gitlab-start[2283]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1301gitlab # [ 142.468895] setup-gitlab-start[2283]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1302gitlab # [ 142.472311] setup-gitlab-start[2283]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1303gitlab # [ 142.474870] setup-gitlab-start[2283]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1304gitlab # [ 150.409907] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:27.611Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"2472912ec75e902d939372b1","created_at":"2026-09-06T06:48:27.572Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac0da81039a1e0b2869b7de2b70759d6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.607Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-2472912ec75e902d939372b1: start","job_status":"start","queue_duration_s":0.003746,"scheduling_latency_s":0.003813}1305gitlab # [ 150.546750] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:27.749Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"2472912ec75e902d939372b1","created_at":"2026-09-06T06:48:27.572Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac0da81039a1e0b2869b7de2b70759d6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.607Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-2472912ec75e902d939372b1: done: 0.138215 sec","job_status":"done","queue_duration_s":0.003746,"scheduling_latency_s":0.003813,"redis_calls":12,"redis_duration_s":0.020209,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.007102,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007985,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005122,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001711391,"duration_s":0.138215,"completed_at":"2026-09-06T06:48:27.749Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003111,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 150.629816] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:27.833Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"81f058cff7843f24d33c8c3c","created_at":"2026-09-06T06:48:27.676Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a7900fa406c1ae4637b6eec8d891c0ac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.698Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-81f058cff7843f24d33c8c3c: start","job_status":"start","queue_duration_s":0.134405,"scheduling_latency_s":0.134443}1307gitlab # [ 150.765475] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:27.968Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"81f058cff7843f24d33c8c3c","created_at":"2026-09-06T06:48:27.676Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a7900fa406c1ae4637b6eec8d891c0ac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.698Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-81f058cff7843f24d33c8c3c: done: 0.134982 sec","job_status":"done","queue_duration_s":0.134405,"scheduling_latency_s":0.134443,"redis_calls":12,"redis_duration_s":0.018154,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001991,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011662,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004501,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001931252,"exclusive_lock_hold_duration_s":0.052948908,"duration_s":0.134982,"completed_at":"2026-09-06T06:48:27.968Z","load_balancing_strategy":"primary","db_duration_s":0.047159,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 150.772703] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:27.975Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"ab60fad0512f4fd46be1d2a4","created_at":"2026-09-06T06:48:27.720Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4b25aee346b1fe4fa277a9d8b0e3ab5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T06:48:27.879Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-ab60fad0512f4fd46be1d2a4: start","job_status":"start","queue_duration_s":0.096109,"scheduling_latency_s":0.096138}1309gitlab # [ 150.790514] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:27.993Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1310gitlab # [ 150.801106] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.004Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"ab60fad0512f4fd46be1d2a4","created_at":"2026-09-06T06:48:27.720Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4b25aee346b1fe4fa277a9d8b0e3ab5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T06:48:27.879Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-ab60fad0512f4fd46be1d2a4: done: 0.029261 sec","job_status":"done","queue_duration_s":0.096109,"scheduling_latency_s":0.096138,"redis_calls":10,"redis_duration_s":0.0047139999999999994,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002734,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001481,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000499,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000438324,"duration_s":0.029261,"completed_at":"2026-09-06T06:48:28.004Z","load_balancing_strategy":"primary","db_duration_s":0.003012,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 150.897455] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.012Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"ae2117e2bbb34db852b0b863","created_at":"2026-09-06T06:48:27.934Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"977741d22b8bdbfd038826de94e0e937","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.951Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-ae2117e2bbb34db852b0b863: start","job_status":"start","queue_duration_s":0.060703,"scheduling_latency_s":0.060739}1312gitlab # [ 150.898900] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.030Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1313gitlab # [ 150.900087] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.048Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"ae2117e2bbb34db852b0b863","created_at":"2026-09-06T06:48:27.934Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"977741d22b8bdbfd038826de94e0e937","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:27.951Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-ae2117e2bbb34db852b0b863: done: 0.036557 sec","job_status":"done","queue_duration_s":0.060703,"scheduling_latency_s":0.060739,"redis_calls":10,"redis_duration_s":0.0023870000000000002,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000529,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001409,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000449,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000497269,"duration_s":0.036557,"completed_at":"2026-09-06T06:48:28.048Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003038,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 150.976485] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.052Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"33ca7227081653f8ca444146","created_at":"2026-09-06T06:48:27.973Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d8632a8cba2d04742c868dc9b283b41a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T06:48:27.987Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-33ca7227081653f8ca444146: start","job_status":"start","queue_duration_s":0.064982,"scheduling_latency_s":0.065003}1315gitlab # [ 150.977894] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.098Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1316gitlab # [ 150.982128] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.110Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"33ca7227081653f8ca444146","created_at":"2026-09-06T06:48:27.973Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d8632a8cba2d04742c868dc9b283b41a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T06:48:27.987Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-33ca7227081653f8ca444146: done: 0.058093 sec","job_status":"done","queue_duration_s":0.064982,"scheduling_latency_s":0.065003,"redis_calls":10,"redis_duration_s":0.018664999999999998,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001324,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.016748,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000593,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000389993,"duration_s":0.058093,"completed_at":"2026-09-06T06:48:28.110Z","load_balancing_strategy":"primary","db_duration_s":0.002157,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 151.102333] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.118Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"e422a0e827018f23790efbaf","created_at":"2026-09-06T06:48:27.991Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b95a424ea45b0415e8b9eb96df2ec516","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.009Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-e422a0e827018f23790efbaf: start","job_status":"start","queue_duration_s":0.108584,"scheduling_latency_s":0.108615}1318gitlab # [ 151.103743] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.177Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"e422a0e827018f23790efbaf","created_at":"2026-09-06T06:48:27.991Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b95a424ea45b0415e8b9eb96df2ec516","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.009Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-e422a0e827018f23790efbaf: done: 0.058582 sec","job_status":"done","queue_duration_s":0.108584,"scheduling_latency_s":0.108615,"redis_calls":12,"redis_duration_s":0.021065,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001903,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005205,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.013957,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014263,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.003346235,"exclusive_lock_hold_duration_s":0.006718452000000001,"duration_s":0.058582,"completed_at":"2026-09-06T06:48:28.177Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00564,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 151.184273] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.189Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"abec31c885616580b6680a55","created_at":"2026-09-06T06:48:28.015Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"192a32c7926e1aab68ca7b12e559d5ae","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.027Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-abec31c885616580b6680a55: start","job_status":"start","queue_duration_s":0.161569,"scheduling_latency_s":0.161594}1320gitlab # [ 151.186546] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.245Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"abec31c885616580b6680a55","created_at":"2026-09-06T06:48:28.015Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"192a32c7926e1aab68ca7b12e559d5ae","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.027Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-abec31c885616580b6680a55: done: 0.056114 sec","job_status":"done","queue_duration_s":0.161569,"scheduling_latency_s":0.161594,"redis_calls":12,"redis_duration_s":0.015998000000000002,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.01084,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002813,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002345,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000547835,"exclusive_lock_hold_duration_s":0.004155836,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.056114,"completed_at":"2026-09-06T06:48:28.245Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006035,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 151.260083] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.246Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"a50f435083eae935cafafdf7","created_at":"2026-09-06T06:48:28.038Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b550090fc97021d77054f4dd5101176","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.051Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-a50f435083eae935cafafdf7: start","job_status":"start","queue_duration_s":0.195655,"scheduling_latency_s":0.195677}1322gitlab # [ 151.260981] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.274Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1323gitlab # [ 151.262128] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.283Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"a50f435083eae935cafafdf7","created_at":"2026-09-06T06:48:28.038Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b550090fc97021d77054f4dd5101176","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.051Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-a50f435083eae935cafafdf7: done: 0.036973 sec","job_status":"done","queue_duration_s":0.195655,"scheduling_latency_s":0.195677,"redis_calls":10,"redis_duration_s":0.003254,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001365,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001446,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000443,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000416534,"duration_s":0.036973,"completed_at":"2026-09-06T06:48:28.283Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003291,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 151.342880] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.285Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"436c81f82f3106d960925009","created_at":"2026-09-06T06:48:28.058Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f54d54b379d6f9f226e299f9d797f2d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.062Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-436c81f82f3106d960925009: start","job_status":"start","queue_duration_s":0.222898,"scheduling_latency_s":0.222919}1325gitlab # [ 151.344190] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.424Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"436c81f82f3106d960925009","created_at":"2026-09-06T06:48:28.058Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f54d54b379d6f9f226e299f9d797f2d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.062Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-436c81f82f3106d960925009: done: 0.138531 sec","job_status":"done","queue_duration_s":0.222898,"scheduling_latency_s":0.222919,"redis_calls":12,"redis_duration_s":0.009497,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.007036,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001323,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001138,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000740317,"exclusive_lock_hold_duration_s":0.07904356700000001,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.138531,"completed_at":"2026-09-06T06:48:28.424Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027871,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 151.413346] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.425Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"0226a11ff8efb009a5e2a222","created_at":"2026-09-06T06:48:28.066Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba9f5c0561f483a96cb9d13067a458f0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.077Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-0226a11ff8efb009a5e2a222: start","job_status":"start","queue_duration_s":0.347757,"scheduling_latency_s":0.347779}1327gitlab # [ 151.486093] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.581Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"0226a11ff8efb009a5e2a222","created_at":"2026-09-06T06:48:28.066Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba9f5c0561f483a96cb9d13067a458f0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.077Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-0226a11ff8efb009a5e2a222: done: 0.155459 sec","job_status":"done","queue_duration_s":0.347757,"scheduling_latency_s":0.347779,"redis_calls":19,"redis_duration_s":0.008768999999999999,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000883,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000373,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002163,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00535,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000372673,"duration_s":0.155459,"completed_at":"2026-09-06T06:48:28.581Z","load_balancing_strategy":"primary","db_duration_s":0.001721,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 151.567987] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.582Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"3ef033ae22b029049a7571de","created_at":"2026-09-06T06:48:28.090Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"70878d68f2642c2a029abb106c041875","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.107Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-3ef033ae22b029049a7571de: start","job_status":"start","queue_duration_s":0.475416,"scheduling_latency_s":0.475438}1329gitlab # [ 151.569758] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.610Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"3ef033ae22b029049a7571de","created_at":"2026-09-06T06:48:28.090Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"70878d68f2642c2a029abb106c041875","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.107Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-3ef033ae22b029049a7571de: done: 0.027826 sec","job_status":"done","queue_duration_s":0.475416,"scheduling_latency_s":0.475438,"redis_calls":16,"redis_duration_s":0.00372,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001918,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001381,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000421,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000371835,"duration_s":0.027826,"completed_at":"2026-09-06T06:48:28.610Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003821,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 151.641084] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.612Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"d13fea7c10abb73d0f50ddcd","created_at":"2026-09-06T06:48:28.114Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.121Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-d13fea7c10abb73d0f50ddcd: start","job_status":"start","queue_duration_s":0.490883,"scheduling_latency_s":0.490903}1331gitlab # [ 151.642361] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.713Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"d13fea7c10abb73d0f50ddcd","created_at":"2026-09-06T06:48:28.114Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.121Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-d13fea7c10abb73d0f50ddcd: done: 0.101742 sec","job_status":"done","queue_duration_s":0.490883,"scheduling_latency_s":0.490903,"redis_calls":71,"redis_duration_s":0.016946,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002191,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000874,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.013041,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00084,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038301,"duration_s":0.101742,"completed_at":"2026-09-06T06:48:28.713Z","load_balancing_strategy":"primary","db_duration_s":0.001816,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 151.722167] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.715Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"fbdf856e0be69841322e0e89","created_at":"2026-09-06T06:48:28.127Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17af5fa240e80dc62f6a531738f2405f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.136Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-fbdf856e0be69841322e0e89: start","job_status":"start","queue_duration_s":0.579211,"scheduling_latency_s":0.579234}1333gitlab # [ 151.725355] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.798Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"fbdf856e0be69841322e0e89","created_at":"2026-09-06T06:48:28.127Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17af5fa240e80dc62f6a531738f2405f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.136Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-fbdf856e0be69841322e0e89: done: 0.082592 sec","job_status":"done","queue_duration_s":0.579211,"scheduling_latency_s":0.579234,"redis_calls":14,"redis_duration_s":0.003327,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000811,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001531,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.052,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000669918,"exclusive_lock_hold_duration_s":0.061180121999999997,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.082592,"completed_at":"2026-09-06T06:48:28.798Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.053621,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 151.808175] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.799Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"52a517f8d3f335cf50d17c98","created_at":"2026-09-06T06:48:28.141Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b054b3523288b95623cb00d57495087d","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.151Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-52a517f8d3f335cf50d17c98: start","job_status":"start","queue_duration_s":0.647797,"scheduling_latency_s":0.647819}1335gitlab # [ 151.809537] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.825Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"52a517f8d3f335cf50d17c98","created_at":"2026-09-06T06:48:28.141Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b054b3523288b95623cb00d57495087d","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.151Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-52a517f8d3f335cf50d17c98: done: 0.025529 sec","job_status":"done","queue_duration_s":0.647797,"scheduling_latency_s":0.647819,"redis_calls":10,"redis_duration_s":0.00247,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000598,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001414,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000458,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015871,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000403962,"duration_s":0.025529,"completed_at":"2026-09-06T06:48:28.825Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002639,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 151.881077] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.826Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"a0fb63c386bdd0ab8dea449a","created_at":"2026-09-06T06:48:28.156Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83b0155a5a883ac491792a0c8eff70bd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.166Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-a0fb63c386bdd0ab8dea449a: start","job_status":"start","queue_duration_s":0.66,"scheduling_latency_s":0.660022}1337gitlab # [ 151.882329] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.838Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1338gitlab # [ 151.883199] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.850Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"a0fb63c386bdd0ab8dea449a","created_at":"2026-09-06T06:48:28.156Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83b0155a5a883ac491792a0c8eff70bd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.166Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-a0fb63c386bdd0ab8dea449a: done: 0.024049 sec","job_status":"done","queue_duration_s":0.66,"scheduling_latency_s":0.660022,"redis_calls":10,"redis_duration_s":0.002126,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000417,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001271,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000438,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000342222,"duration_s":0.024049,"completed_at":"2026-09-06T06:48:28.850Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000349,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 151.955484] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.852Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"4498840187865e299fac15e1","created_at":"2026-09-06T06:48:28.169Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"834a465246868f309e5c5354b97d2c3b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T06:48:28.179Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-4498840187865e299fac15e1: start","job_status":"start","queue_duration_s":0.673289,"scheduling_latency_s":0.67332}1340gitlab # [ 151.967938] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.928Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"4498840187865e299fac15e1","created_at":"2026-09-06T06:48:28.169Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"834a465246868f309e5c5354b97d2c3b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T06:48:28.179Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-4498840187865e299fac15e1: done: 0.075587 sec","job_status":"done","queue_duration_s":0.673289,"scheduling_latency_s":0.67332,"redis_calls":10,"redis_duration_s":0.0024029999999999998,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000493,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001452,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000458,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000582197,"duration_s":0.075587,"completed_at":"2026-09-06T06:48:28.928Z","load_balancing_strategy":"primary","db_duration_s":0.046598,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 152.056201] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:28.934Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"5a690ce7f67412fa338a87f2","created_at":"2026-09-06T06:48:28.185Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.197Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-5a690ce7f67412fa338a87f2: start","job_status":"start","queue_duration_s":0.736389,"scheduling_latency_s":0.736412}1342gitlab # [ 152.057684] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.027Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"5a690ce7f67412fa338a87f2","created_at":"2026-09-06T06:48:28.185Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.197Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-5a690ce7f67412fa338a87f2: done: 0.09341 sec","job_status":"done","queue_duration_s":0.736389,"scheduling_latency_s":0.736412,"redis_calls":65,"redis_duration_s":0.020464999999999997,"redis_read_bytes":115,"redis_write_bytes":41282,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000866,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":656,"redis_queues_calls":2,"redis_queues_duration_s":0.000738,"redis_queues_read_bytes":4,"redis_queues_write_bytes":36985,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.016248,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3374,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002613,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":267,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000361777,"duration_s":0.09341,"completed_at":"2026-09-06T06:48:29.027Z","load_balancing_strategy":"primary","db_duration_s":0.000711,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 152.130908] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.029Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"cd84d64b90050629901a9cfd","created_at":"2026-09-06T06:48:28.201Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bc24ca8f420187a6914f057728e76bf7","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.215Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-cd84d64b90050629901a9cfd: start","job_status":"start","queue_duration_s":0.813583,"scheduling_latency_s":0.813606}1344gitlab # [ 152.142929] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.055Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"cd84d64b90050629901a9cfd","created_at":"2026-09-06T06:48:28.201Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bc24ca8f420187a6914f057728e76bf7","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.215Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-cd84d64b90050629901a9cfd: done: 0.026146 sec","job_status":"done","queue_duration_s":0.813583,"scheduling_latency_s":0.813606,"redis_calls":13,"redis_duration_s":0.0029419999999999997,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000474,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001522,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016602,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0069349599999999996,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.026146,"completed_at":"2026-09-06T06:48:29.055Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002408,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1345gitlab # [ 152.215966] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.056Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"b57c05d3f70e761b76225fd4","created_at":"2026-09-06T06:48:28.233Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0cfcdcd6b600841dca3b270712a65918","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.243Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-b57c05d3f70e761b76225fd4: start","job_status":"start","queue_duration_s":0.812742,"scheduling_latency_s":0.812763}1346gitlab # [ 152.286245] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.487Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"b57c05d3f70e761b76225fd4","created_at":"2026-09-06T06:48:28.233Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0cfcdcd6b600841dca3b270712a65918","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.243Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-b57c05d3f70e761b76225fd4: done: 0.430358 sec","job_status":"done","queue_duration_s":0.812742,"scheduling_latency_s":0.812763,"redis_calls":565,"redis_duration_s":0.137181,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000456,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001314,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.135411,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.333827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000365689,"duration_s":0.430358,"completed_at":"2026-09-06T06:48:29.487Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000393,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 152.355164] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.488Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"39da568d4a9fc485ef39f1c3","created_at":"2026-09-06T06:48:28.259Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2b39ebb391015552bd8d7f2d6325fd5","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.275Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-39da568d4a9fc485ef39f1c3: start","job_status":"start","queue_duration_s":1.212803,"scheduling_latency_s":1.212826}1348gitlab # [ 152.356822] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.523Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"39da568d4a9fc485ef39f1c3","created_at":"2026-09-06T06:48:28.259Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2b39ebb391015552bd8d7f2d6325fd5","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.275Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-39da568d4a9fc485ef39f1c3: done: 0.034562 sec","job_status":"done","queue_duration_s":1.212803,"scheduling_latency_s":1.212826,"redis_calls":10,"redis_duration_s":0.002452,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000419,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001452,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000581,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000385803,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.034562,"completed_at":"2026-09-06T06:48:29.523Z","load_balancing_strategy":"primary","db_duration_s":0.009837,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 152.446538] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.525Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"10d9c5e36b52e786053e6951","created_at":"2026-09-06T06:48:28.288Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a931212de4847fc6f2be5089c788e17","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.294Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-10d9c5e36b52e786053e6951: start","job_status":"start","queue_duration_s":1.230388,"scheduling_latency_s":1.230411}1350gitlab # [ 152.447860] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.543Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"10d9c5e36b52e786053e6951","created_at":"2026-09-06T06:48:28.288Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a931212de4847fc6f2be5089c788e17","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.294Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-10d9c5e36b52e786053e6951: done: 0.01824 sec","job_status":"done","queue_duration_s":1.230388,"scheduling_latency_s":1.230411,"redis_calls":10,"redis_duration_s":0.002358,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000455,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001392,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000511,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010716,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000369042,"duration_s":0.01824,"completed_at":"2026-09-06T06:48:29.543Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000377,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 152.517979] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.544Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"a045a475977027722280ea6f","created_at":"2026-09-06T06:48:28.311Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b466c04c19b37192679494d7f62cb01e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.320Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-a045a475977027722280ea6f: start","job_status":"start","queue_duration_s":1.224666,"scheduling_latency_s":1.224687}1352gitlab # [ 152.521267] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.569Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"a045a475977027722280ea6f","created_at":"2026-09-06T06:48:28.311Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b466c04c19b37192679494d7f62cb01e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.320Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-a045a475977027722280ea6f: done: 0.025179 sec","job_status":"done","queue_duration_s":1.224666,"scheduling_latency_s":1.224687,"redis_calls":12,"redis_duration_s":0.010175,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000443,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004802,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00493,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.003180572,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.025179,"completed_at":"2026-09-06T06:48:29.569Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0004,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 152.601358] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.573Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"3fe996d24d01e86f3d2219ab","created_at":"2026-09-06T06:48:28.333Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"b16b9f9554f1098b86cd211265e2b430","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.340Z","job_size_bytes":3,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-3fe996d24d01e86f3d2219ab: start","job_status":"start","queue_duration_s":1.233026,"scheduling_latency_s":1.233047}1354gitlab # [ 152.602756] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.593Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"3fe996d24d01e86f3d2219ab","created_at":"2026-09-06T06:48:28.333Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"b16b9f9554f1098b86cd211265e2b430","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.340Z","job_size_bytes":3,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-3fe996d24d01e86f3d2219ab: done: 0.020033 sec","job_status":"done","queue_duration_s":1.233026,"scheduling_latency_s":1.233047,"redis_calls":10,"redis_duration_s":0.004499,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000487,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002903,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001109,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035647,"duration_s":0.020033,"completed_at":"2026-09-06T06:48:29.593Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000427,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 152.670920] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.594Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"878aab078d56daa21d664f7a","created_at":"2026-09-06T06:48:28.349Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58b732d59195328d556da4ffa5fe7230","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.360Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-878aab078d56daa21d664f7a: start","job_status":"start","queue_duration_s":1.234222,"scheduling_latency_s":1.234242}1356gitlab # [ 152.738958] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.612Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"878aab078d56daa21d664f7a","created_at":"2026-09-06T06:48:28.349Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58b732d59195328d556da4ffa5fe7230","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.360Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-878aab078d56daa21d664f7a: done: 0.017685 sec","job_status":"done","queue_duration_s":1.234222,"scheduling_latency_s":1.234242,"redis_calls":12,"redis_duration_s":0.002678,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000552,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000413,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001256,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000457,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000342222,"duration_s":0.017685,"completed_at":"2026-09-06T06:48:29.612Z","load_balancing_strategy":"primary","db_duration_s":0.000374,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 152.741259] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.613Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"4ecdec45b12601eaa1d65a28","created_at":"2026-09-06T06:48:28.363Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fa4e42dd4d510df080a9e96de5f34fdc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.368Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-4ecdec45b12601eaa1d65a28: start","job_status":"start","queue_duration_s":1.245101,"scheduling_latency_s":1.245121}1358gitlab # [ 152.809851] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.794Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"4ecdec45b12601eaa1d65a28","created_at":"2026-09-06T06:48:28.363Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fa4e42dd4d510df080a9e96de5f34fdc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.368Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-4ecdec45b12601eaa1d65a28: done: 0.181508 sec","job_status":"done","queue_duration_s":1.245101,"scheduling_latency_s":1.245121,"redis_calls":14,"redis_duration_s":0.003124,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000833,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001278,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.12547,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000503695,"exclusive_lock_hold_duration_s":0.16072322,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.181508,"completed_at":"2026-09-06T06:48:29.794Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.062477,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 152.886070] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.796Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"8778e1007e8ec41804ce6195","created_at":"2026-09-06T06:48:28.371Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30bdbe59eb9c486fd5d1aa0c5979a1be","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.376Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-8778e1007e8ec41804ce6195: start","job_status":"start","queue_duration_s":1.419964,"scheduling_latency_s":1.419987}1360gitlab # [ 152.887283] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.809Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1361gitlab # [ 152.888793] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.815Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"8778e1007e8ec41804ce6195","created_at":"2026-09-06T06:48:28.371Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30bdbe59eb9c486fd5d1aa0c5979a1be","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.376Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-8778e1007e8ec41804ce6195: done: 0.018814 sec","job_status":"done","queue_duration_s":1.419964,"scheduling_latency_s":1.419987,"redis_calls":10,"redis_duration_s":0.003516,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000609,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002487,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00042,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000342223,"duration_s":0.018814,"completed_at":"2026-09-06T06:48:29.815Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000442,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 152.961951] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.816Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a48e38f78f0d7bd7ca522dfb","created_at":"2026-09-06T06:48:28.394Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e5112e1784e5506c11c0cc6e14fcb6e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.400Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a48e38f78f0d7bd7ca522dfb: start","job_status":"start","queue_duration_s":1.416765,"scheduling_latency_s":1.416786}1363gitlab # [ 152.963158] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.837Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a48e38f78f0d7bd7ca522dfb","created_at":"2026-09-06T06:48:28.394Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e5112e1784e5506c11c0cc6e14fcb6e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.400Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a48e38f78f0d7bd7ca522dfb: done: 0.020245 sec","job_status":"done","queue_duration_s":1.416765,"scheduling_latency_s":1.416786,"redis_calls":10,"redis_duration_s":0.00222,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000469,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001329,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000422,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000344178,"duration_s":0.020245,"completed_at":"2026-09-06T06:48:29.837Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001928,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 153.032364] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.838Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3d103b41a43f8a0488c8e970","created_at":"2026-09-06T06:48:28.564Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-ab501e7e2d024c48","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ba9f5c0561f483a96cb9d13067a458f0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.574Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3d103b41a43f8a0488c8e970: start","job_status":"start","queue_duration_s":1.264054,"scheduling_latency_s":1.264074}1365gitlab # [ 153.033616] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.853Z","message":"No existing merge request to be cleaned up."}1366gitlab # [ 153.035523] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.863Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3d103b41a43f8a0488c8e970","created_at":"2026-09-06T06:48:28.564Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-ab501e7e2d024c48","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ba9f5c0561f483a96cb9d13067a458f0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.574Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3d103b41a43f8a0488c8e970: done: 0.0248 sec","job_status":"done","queue_duration_s":1.264054,"scheduling_latency_s":1.264074,"redis_calls":13,"redis_duration_s":0.003285,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000777,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001083,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001425,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000342501,"duration_s":0.0248,"completed_at":"2026-09-06T06:48:29.863Z","load_balancing_strategy":"primary","db_duration_s":0.002628,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 153.107906] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.864Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5abb7ffd9c9c833ce0d49af7","created_at":"2026-09-06T06:48:28.564Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-ab501e7e2d024c48","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ba9f5c0561f483a96cb9d13067a458f0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.574Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5abb7ffd9c9c833ce0d49af7: start","job_status":"start","queue_duration_s":1.290292,"scheduling_latency_s":1.290312}1368gitlab # [ 153.112093] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.876Z","message":"No existing merge request to be cleaned up."}1369gitlab # [ 153.114918] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.883Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5abb7ffd9c9c833ce0d49af7","created_at":"2026-09-06T06:48:28.564Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-ab501e7e2d024c48","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ba9f5c0561f483a96cb9d13067a458f0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.574Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5abb7ffd9c9c833ce0d49af7: done: 0.018282 sec","job_status":"done","queue_duration_s":1.290292,"scheduling_latency_s":1.290312,"redis_calls":10,"redis_duration_s":0.0021809999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000846,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001335,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018282,"completed_at":"2026-09-06T06:48:29.883Z","load_balancing_strategy":"primary","db_duration_s":0.00457,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 153.188146] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.884Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"03a5c7a748af98aa4f6b56c0","created_at":"2026-09-06T06:48:28.564Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-ab501e7e2d024c48","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ba9f5c0561f483a96cb9d13067a458f0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.574Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-03a5c7a748af98aa4f6b56c0: start","job_status":"start","queue_duration_s":1.310015,"scheduling_latency_s":1.310036}1371gitlab # [ 153.255760] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.894Z","message":"No existing merge request to be cleaned up."}1372gitlab # [ 153.257333] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.901Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"03a5c7a748af98aa4f6b56c0","created_at":"2026-09-06T06:48:28.564Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-ab501e7e2d024c48","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ba9f5c0561f483a96cb9d13067a458f0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.574Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-03a5c7a748af98aa4f6b56c0: done: 0.016544 sec","job_status":"done","queue_duration_s":1.310015,"scheduling_latency_s":1.310036,"redis_calls":10,"redis_duration_s":0.002219,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000864,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001355,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016544,"completed_at":"2026-09-06T06:48:29.901Z","load_balancing_strategy":"primary","db_duration_s":0.001718,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 153.259122] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.902Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"de73890b27d54949905e37fc","created_at":"2026-09-06T06:48:28.564Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-ab501e7e2d024c48","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ba9f5c0561f483a96cb9d13067a458f0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.574Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-de73890b27d54949905e37fc: start","job_status":"start","queue_duration_s":1.327878,"scheduling_latency_s":1.327899}1374gitlab # [ 153.330432] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.912Z","message":"No existing merge request to be cleaned up."}1375gitlab # [ 153.331819] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.918Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"de73890b27d54949905e37fc","created_at":"2026-09-06T06:48:28.564Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-ab501e7e2d024c48","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ba9f5c0561f483a96cb9d13067a458f0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.574Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-de73890b27d54949905e37fc: done: 0.01663 sec","job_status":"done","queue_duration_s":1.327878,"scheduling_latency_s":1.327899,"redis_calls":10,"redis_duration_s":0.0026699999999999996,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001336,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001334,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01663,"completed_at":"2026-09-06T06:48:29.918Z","load_balancing_strategy":"primary","db_duration_s":0.001533,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 153.337911] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"740891271a0cc453ccd0cf08","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-740891271a0cc453ccd0cf08: start","job_status":"start","queue_duration_s":1.215258,"scheduling_latency_s":1.21528}1377gitlab # [ 153.414188] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"740891271a0cc453ccd0cf08","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-740891271a0cc453ccd0cf08: done: 0.020953 sec","job_status":"done","queue_duration_s":1.215258,"scheduling_latency_s":1.21528,"redis_calls":16,"redis_duration_s":0.003623,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000455,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001034,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002134,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000352279,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020953,"completed_at":"2026-09-06T06:48:29.941Z","load_balancing_strategy":"primary","db_duration_s":0.000359,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 153.420198] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.946Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce536e5e2bf545ce21adfd82","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce536e5e2bf545ce21adfd82: start","job_status":"start","queue_duration_s":1.241172,"scheduling_latency_s":1.241194}1379gitlab # [ 153.490439] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce536e5e2bf545ce21adfd82","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce536e5e2bf545ce21adfd82: done: 0.015579 sec","job_status":"done","queue_duration_s":1.241172,"scheduling_latency_s":1.241194,"redis_calls":13,"redis_duration_s":0.0028,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001887,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015579,"completed_at":"2026-09-06T06:48:29.961Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 153.500315] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.963Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e35faaf7344e66bcf4e0b3b7","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e35faaf7344e66bcf4e0b3b7: start","job_status":"start","queue_duration_s":1.258077,"scheduling_latency_s":1.258098}1381gitlab # [ 153.573233] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.978Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e35faaf7344e66bcf4e0b3b7","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e35faaf7344e66bcf4e0b3b7: done: 0.015591 sec","job_status":"done","queue_duration_s":1.258077,"scheduling_latency_s":1.258098,"redis_calls":13,"redis_duration_s":0.002891,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010613,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015591,"completed_at":"2026-09-06T06:48:29.978Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 153.641959] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e7db6c7c912765411f68472","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e7db6c7c912765411f68472: start","job_status":"start","queue_duration_s":1.275031,"scheduling_latency_s":1.275062}1383gitlab # [ 153.643196] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.995Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e7db6c7c912765411f68472","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e7db6c7c912765411f68472: done: 0.015623 sec","job_status":"done","queue_duration_s":1.275031,"scheduling_latency_s":1.275062,"redis_calls":13,"redis_duration_s":0.002853,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000863,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00199,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015623,"completed_at":"2026-09-06T06:48:29.995Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 153.725117] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:29.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b22fb764ea2f7ad8ebd27a81","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b22fb764ea2f7ad8ebd27a81: start","job_status":"start","queue_duration_s":1.291962,"scheduling_latency_s":1.291983}1385gitlab # [ 153.726646] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.012Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b22fb764ea2f7ad8ebd27a81","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b22fb764ea2f7ad8ebd27a81: done: 0.015803 sec","job_status":"done","queue_duration_s":1.291962,"scheduling_latency_s":1.291983,"redis_calls":13,"redis_duration_s":0.00304,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001042,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015803,"completed_at":"2026-09-06T06:48:30.012Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 153.802899] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.018Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6710aeb28e28ccd240c69df6","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6710aeb28e28ccd240c69df6: start","job_status":"start","queue_duration_s":1.313213,"scheduling_latency_s":1.313234}1387gitlab # [ 153.804053] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6710aeb28e28ccd240c69df6","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6710aeb28e28ccd240c69df6: done: 0.01611 sec","job_status":"done","queue_duration_s":1.313213,"scheduling_latency_s":1.313234,"redis_calls":13,"redis_duration_s":0.002995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000833,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002162,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01611,"completed_at":"2026-09-06T06:48:30.034Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 153.882360] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e294bffc672774533e51774c","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e294bffc672774533e51774c: start","job_status":"start","queue_duration_s":1.330587,"scheduling_latency_s":1.330607}1389gitlab # [ 153.884104] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e294bffc672774533e51774c","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e294bffc672774533e51774c: done: 0.015648 sec","job_status":"done","queue_duration_s":1.330587,"scheduling_latency_s":1.330607,"redis_calls":13,"redis_duration_s":0.0028539999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001015,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001839,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015648,"completed_at":"2026-09-06T06:48:30.051Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 153.959058] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41632cf1e20b74f83e14c98f","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41632cf1e20b74f83e14c98f: start","job_status":"start","queue_duration_s":1.347657,"scheduling_latency_s":1.347678}1391gitlab # [ 153.960392] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41632cf1e20b74f83e14c98f","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41632cf1e20b74f83e14c98f: done: 0.015594 sec","job_status":"done","queue_duration_s":1.347657,"scheduling_latency_s":1.347678,"redis_calls":13,"redis_duration_s":0.002735,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000825,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00191,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015594,"completed_at":"2026-09-06T06:48:30.068Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 154.033072] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"439d11ed9c42fcf2f9c1d1a8","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-439d11ed9c42fcf2f9c1d1a8: start","job_status":"start","queue_duration_s":1.364669,"scheduling_latency_s":1.364689}1393gitlab # [ 154.034249] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.085Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"439d11ed9c42fcf2f9c1d1a8","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-439d11ed9c42fcf2f9c1d1a8: done: 0.01546 sec","job_status":"done","queue_duration_s":1.364669,"scheduling_latency_s":1.364689,"redis_calls":13,"redis_duration_s":0.002741,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000825,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01546,"completed_at":"2026-09-06T06:48:30.085Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 154.117755] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.086Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f00d25569f0c857ad5497e9","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f00d25569f0c857ad5497e9: start","job_status":"start","queue_duration_s":1.381532,"scheduling_latency_s":1.381553}1395gitlab # [ 154.119382] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f00d25569f0c857ad5497e9","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f00d25569f0c857ad5497e9: done: 0.019838 sec","job_status":"done","queue_duration_s":1.381532,"scheduling_latency_s":1.381553,"redis_calls":13,"redis_duration_s":0.006385999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003427,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010721,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019838,"completed_at":"2026-09-06T06:48:30.106Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 154.195747] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.107Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33b494f6546cf97df3df7818","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33b494f6546cf97df3df7818: start","job_status":"start","queue_duration_s":1.402892,"scheduling_latency_s":1.402913}1397gitlab # [ 154.197376] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33b494f6546cf97df3df7818","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33b494f6546cf97df3df7818: done: 0.015436 sec","job_status":"done","queue_duration_s":1.402892,"scheduling_latency_s":1.402913,"redis_calls":13,"redis_duration_s":0.002713,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000857,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001856,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015436,"completed_at":"2026-09-06T06:48:30.123Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 154.272148] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"507542fb0f20d924639af02d","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-507542fb0f20d924639af02d: start","job_status":"start","queue_duration_s":1.419926,"scheduling_latency_s":1.419947}1399gitlab # [ 154.273730] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"507542fb0f20d924639af02d","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-507542fb0f20d924639af02d: done: 0.015455 sec","job_status":"done","queue_duration_s":1.419926,"scheduling_latency_s":1.419947,"redis_calls":13,"redis_duration_s":0.00281,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000823,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015455,"completed_at":"2026-09-06T06:48:30.140Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 154.301367] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aaa9e9a7cea27fdc5adc00f3","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aaa9e9a7cea27fdc5adc00f3: start","job_status":"start","queue_duration_s":1.4368,"scheduling_latency_s":1.436866}1401gitlab # [ 154.380114] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.157Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aaa9e9a7cea27fdc5adc00f3","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aaa9e9a7cea27fdc5adc00f3: done: 0.015558 sec","job_status":"done","queue_duration_s":1.4368,"scheduling_latency_s":1.436866,"redis_calls":13,"redis_duration_s":0.0029189999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000815,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015558,"completed_at":"2026-09-06T06:48:30.157Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 154.382417] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.158Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5fedcf08edfa646373fe259","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5fedcf08edfa646373fe259: start","job_status":"start","queue_duration_s":1.453768,"scheduling_latency_s":1.453789}1403gitlab # [ 154.461194] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.174Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5fedcf08edfa646373fe259","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5fedcf08edfa646373fe259: done: 0.015919 sec","job_status":"done","queue_duration_s":1.453768,"scheduling_latency_s":1.453789,"redis_calls":13,"redis_duration_s":0.003203,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002241,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015919,"completed_at":"2026-09-06T06:48:30.174Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 154.463196] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b5e35adfc31e473118616fa","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b5e35adfc31e473118616fa: start","job_status":"start","queue_duration_s":1.471067,"scheduling_latency_s":1.471238}1405gitlab # [ 154.539600] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b5e35adfc31e473118616fa","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b5e35adfc31e473118616fa: done: 0.015781 sec","job_status":"done","queue_duration_s":1.471067,"scheduling_latency_s":1.471238,"redis_calls":13,"redis_duration_s":0.002767,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015781,"completed_at":"2026-09-06T06:48:30.191Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 154.541452] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.193Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6089c96fe66e95a0de9574f","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6089c96fe66e95a0de9574f: start","job_status":"start","queue_duration_s":1.488169,"scheduling_latency_s":1.48819}1407gitlab # [ 154.619096] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6089c96fe66e95a0de9574f","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6089c96fe66e95a0de9574f: done: 0.015856 sec","job_status":"done","queue_duration_s":1.488169,"scheduling_latency_s":1.48819,"redis_calls":13,"redis_duration_s":0.002723,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001858,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015856,"completed_at":"2026-09-06T06:48:30.209Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 154.621384] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3747139e7a41346b290d220","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3747139e7a41346b290d220: start","job_status":"start","queue_duration_s":1.505303,"scheduling_latency_s":1.505324}1409gitlab # [ 154.689200] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3747139e7a41346b290d220","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3747139e7a41346b290d220: done: 0.015544 sec","job_status":"done","queue_duration_s":1.505303,"scheduling_latency_s":1.505324,"redis_calls":13,"redis_duration_s":0.002709,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001811,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015544,"completed_at":"2026-09-06T06:48:30.225Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 154.764968] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.227Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07a50944280b2f33226f3c11","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07a50944280b2f33226f3c11: start","job_status":"start","queue_duration_s":1.522173,"scheduling_latency_s":1.522194}1411gitlab # [ 154.766129] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07a50944280b2f33226f3c11","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07a50944280b2f33226f3c11: done: 0.020354 sec","job_status":"done","queue_duration_s":1.522173,"scheduling_latency_s":1.522194,"redis_calls":13,"redis_duration_s":0.007213,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000886,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006327,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020354,"completed_at":"2026-09-06T06:48:30.247Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 154.841150] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.248Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"579abb848b64d54661dfdd65","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-579abb848b64d54661dfdd65: start","job_status":"start","queue_duration_s":1.543814,"scheduling_latency_s":1.543879}1413gitlab # [ 154.842797] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"579abb848b64d54661dfdd65","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-579abb848b64d54661dfdd65: done: 0.015665 sec","job_status":"done","queue_duration_s":1.543814,"scheduling_latency_s":1.543879,"redis_calls":13,"redis_duration_s":0.0027670000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001855,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010366,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015665,"completed_at":"2026-09-06T06:48:30.264Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 154.922973] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96dea3d23465fb5a60fbf42e","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96dea3d23465fb5a60fbf42e: start","job_status":"start","queue_duration_s":1.560977,"scheduling_latency_s":1.560998}1415gitlab # [ 154.924187] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96dea3d23465fb5a60fbf42e","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96dea3d23465fb5a60fbf42e: done: 0.016242 sec","job_status":"done","queue_duration_s":1.560977,"scheduling_latency_s":1.560998,"redis_calls":13,"redis_duration_s":0.003627,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001671,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016242,"completed_at":"2026-09-06T06:48:30.282Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 154.941282] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c255f0cae5ff7447524749c0","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c255f0cae5ff7447524749c0: start","job_status":"start","queue_duration_s":1.57864,"scheduling_latency_s":1.578661}1417gitlab # [ 155.016813] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c255f0cae5ff7447524749c0","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c255f0cae5ff7447524749c0: done: 0.015556 sec","job_status":"done","queue_duration_s":1.57864,"scheduling_latency_s":1.578661,"redis_calls":13,"redis_duration_s":0.002691,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000827,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001864,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015556,"completed_at":"2026-09-06T06:48:30.299Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 155.021257] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a5d0b4af1b803f44eb6d25e","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a5d0b4af1b803f44eb6d25e: start","job_status":"start","queue_duration_s":1.595644,"scheduling_latency_s":1.595665}1419gitlab # [ 155.099203] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a5d0b4af1b803f44eb6d25e","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a5d0b4af1b803f44eb6d25e: done: 0.015743 sec","job_status":"done","queue_duration_s":1.595644,"scheduling_latency_s":1.595665,"redis_calls":13,"redis_duration_s":0.003022,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000857,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002165,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015743,"completed_at":"2026-09-06T06:48:30.316Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 155.101290] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f99c0dd47dd8f2906443af9a","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f99c0dd47dd8f2906443af9a: start","job_status":"start","queue_duration_s":1.612952,"scheduling_latency_s":1.612972}1421gitlab # [ 155.177067] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f99c0dd47dd8f2906443af9a","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f99c0dd47dd8f2906443af9a: done: 0.015847 sec","job_status":"done","queue_duration_s":1.612952,"scheduling_latency_s":1.612972,"redis_calls":13,"redis_duration_s":0.00298,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015847,"completed_at":"2026-09-06T06:48:30.333Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 155.181199] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d22fbd966fb0a9e594bdd7b6","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d22fbd966fb0a9e594bdd7b6: start","job_status":"start","queue_duration_s":1.630394,"scheduling_latency_s":1.630415}1423gitlab # [ 155.201324] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d22fbd966fb0a9e594bdd7b6","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d22fbd966fb0a9e594bdd7b6: done: 0.018125 sec","job_status":"done","queue_duration_s":1.630394,"scheduling_latency_s":1.630415,"redis_calls":13,"redis_duration_s":0.00313,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001204,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018125,"completed_at":"2026-09-06T06:48:30.353Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 155.277911] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f466891224462852980fa193","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f466891224462852980fa193: start","job_status":"start","queue_duration_s":1.65033,"scheduling_latency_s":1.650358}1425gitlab # [ 155.281074] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f466891224462852980fa193","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f466891224462852980fa193: done: 0.015713 sec","job_status":"done","queue_duration_s":1.65033,"scheduling_latency_s":1.650358,"redis_calls":13,"redis_duration_s":0.002896,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000994,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015713,"completed_at":"2026-09-06T06:48:30.370Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 155.370387] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2a9937705654a8cda048147","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2a9937705654a8cda048147: start","job_status":"start","queue_duration_s":1.667298,"scheduling_latency_s":1.667318}1427gitlab # [ 155.372051] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2a9937705654a8cda048147","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2a9937705654a8cda048147: done: 0.015515 sec","job_status":"done","queue_duration_s":1.667298,"scheduling_latency_s":1.667318,"redis_calls":13,"redis_duration_s":0.002717,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001852,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015515,"completed_at":"2026-09-06T06:48:30.387Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 155.451204] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b07b30d2a189aab254d871d8","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b07b30d2a189aab254d871d8: start","job_status":"start","queue_duration_s":1.684138,"scheduling_latency_s":1.684159}1429gitlab # [ 155.452322] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b07b30d2a189aab254d871d8","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b07b30d2a189aab254d871d8: done: 0.016528 sec","job_status":"done","queue_duration_s":1.684138,"scheduling_latency_s":1.684159,"redis_calls":13,"redis_duration_s":0.002909,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016528,"completed_at":"2026-09-06T06:48:30.405Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 155.537832] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bf0cb693712ddffd5a414fb","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bf0cb693712ddffd5a414fb: start","job_status":"start","queue_duration_s":1.702051,"scheduling_latency_s":1.702073}1431gitlab # [ 155.539177] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bf0cb693712ddffd5a414fb","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bf0cb693712ddffd5a414fb: done: 0.015703 sec","job_status":"done","queue_duration_s":1.702051,"scheduling_latency_s":1.702073,"redis_calls":13,"redis_duration_s":0.002827,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000826,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015703,"completed_at":"2026-09-06T06:48:30.422Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 155.627480] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f85699ed165a9484eaface4","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f85699ed165a9484eaface4: start","job_status":"start","queue_duration_s":1.719074,"scheduling_latency_s":1.719095}1433gitlab # [ 155.629059] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f85699ed165a9484eaface4","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f85699ed165a9484eaface4: done: 0.015365 sec","job_status":"done","queue_duration_s":1.719074,"scheduling_latency_s":1.719095,"redis_calls":13,"redis_duration_s":0.002804,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000859,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010349,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015365,"completed_at":"2026-09-06T06:48:30.439Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 155.702445] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7af42f28e3dcd9a67d4222dc","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7af42f28e3dcd9a67d4222dc: start","job_status":"start","queue_duration_s":1.735694,"scheduling_latency_s":1.735715}1435gitlab # [ 155.704495] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.456Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7af42f28e3dcd9a67d4222dc","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7af42f28e3dcd9a67d4222dc: done: 0.015532 sec","job_status":"done","queue_duration_s":1.735694,"scheduling_latency_s":1.735715,"redis_calls":13,"redis_duration_s":0.002993,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000814,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002179,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015532,"completed_at":"2026-09-06T06:48:30.456Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 155.807213] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0fe210e475a4533f003b564d","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0fe210e475a4533f003b564d: start","job_status":"start","queue_duration_s":1.752655,"scheduling_latency_s":1.752675}1437gitlab # [ 155.808930] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0fe210e475a4533f003b564d","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0fe210e475a4533f003b564d: done: 0.019169 sec","job_status":"done","queue_duration_s":1.752655,"scheduling_latency_s":1.752675,"redis_calls":13,"redis_duration_s":0.004375,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002336,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002039,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019169,"completed_at":"2026-09-06T06:48:30.476Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 155.877362] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"deeb0b209e04655ad7d5ac06","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-deeb0b209e04655ad7d5ac06: start","job_status":"start","queue_duration_s":1.773312,"scheduling_latency_s":1.773333}1439gitlab # [ 155.878472] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"deeb0b209e04655ad7d5ac06","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-deeb0b209e04655ad7d5ac06: done: 0.015337 sec","job_status":"done","queue_duration_s":1.773312,"scheduling_latency_s":1.773333,"redis_calls":13,"redis_duration_s":0.002808,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010509,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015337,"completed_at":"2026-09-06T06:48:30.493Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 155.959283] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b7ee600c3fc690864d7b3ad","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b7ee600c3fc690864d7b3ad: start","job_status":"start","queue_duration_s":1.790109,"scheduling_latency_s":1.790129}1441gitlab # [ 155.960208] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b7ee600c3fc690864d7b3ad","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b7ee600c3fc690864d7b3ad: done: 0.015394 sec","job_status":"done","queue_duration_s":1.790109,"scheduling_latency_s":1.790129,"redis_calls":13,"redis_duration_s":0.002946,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001045,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015394,"completed_at":"2026-09-06T06:48:30.510Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 156.028905] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0318c3f6662f43a48f99e52e","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0318c3f6662f43a48f99e52e: start","job_status":"start","queue_duration_s":1.806932,"scheduling_latency_s":1.806953}1443gitlab # [ 156.030112] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0318c3f6662f43a48f99e52e","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0318c3f6662f43a48f99e52e: done: 0.015302 sec","job_status":"done","queue_duration_s":1.806932,"scheduling_latency_s":1.806953,"redis_calls":13,"redis_duration_s":0.0027879999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000819,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015302,"completed_at":"2026-09-06T06:48:30.527Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 156.108266] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba74dfa8b5ee83ada72f7aa1","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba74dfa8b5ee83ada72f7aa1: start","job_status":"start","queue_duration_s":1.823911,"scheduling_latency_s":1.823932}1445gitlab # [ 156.109829] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba74dfa8b5ee83ada72f7aa1","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba74dfa8b5ee83ada72f7aa1: done: 0.023764 sec","job_status":"done","queue_duration_s":1.823911,"scheduling_latency_s":1.823932,"redis_calls":13,"redis_duration_s":0.01111,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00594,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00517,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023764,"completed_at":"2026-09-06T06:48:30.552Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 156.187909] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.554Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2740894d75bc5861a85282d6","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2740894d75bc5861a85282d6: start","job_status":"start","queue_duration_s":1.849195,"scheduling_latency_s":1.849218}1447gitlab # [ 156.189157] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2740894d75bc5861a85282d6","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2740894d75bc5861a85282d6: done: 0.015642 sec","job_status":"done","queue_duration_s":1.849195,"scheduling_latency_s":1.849218,"redis_calls":13,"redis_duration_s":0.0027069999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001852,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015642,"completed_at":"2026-09-06T06:48:30.569Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 156.274058] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.571Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6736c414a7637fa91514b14","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6736c414a7637fa91514b14: start","job_status":"start","queue_duration_s":1.866065,"scheduling_latency_s":1.866086}1449gitlab # [ 156.275305] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6736c414a7637fa91514b14","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6736c414a7637fa91514b14: done: 0.015511 sec","job_status":"done","queue_duration_s":1.866065,"scheduling_latency_s":1.866086,"redis_calls":13,"redis_duration_s":0.002878,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00086,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015511,"completed_at":"2026-09-06T06:48:30.586Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 156.351781] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"408538af7143534f0a05d241","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-408538af7143534f0a05d241: start","job_status":"start","queue_duration_s":1.883018,"scheduling_latency_s":1.88304}1451gitlab # [ 156.353202] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"408538af7143534f0a05d241","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-408538af7143534f0a05d241: done: 0.015387 sec","job_status":"done","queue_duration_s":1.883018,"scheduling_latency_s":1.88304,"redis_calls":13,"redis_duration_s":0.002797,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000859,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015387,"completed_at":"2026-09-06T06:48:30.603Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 156.443197] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b59728ba59c09fcea35888e","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b59728ba59c09fcea35888e: start","job_status":"start","queue_duration_s":1.899676,"scheduling_latency_s":1.899698}1453gitlab # [ 156.444789] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.623Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b59728ba59c09fcea35888e","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b59728ba59c09fcea35888e: done: 0.019138 sec","job_status":"done","queue_duration_s":1.899676,"scheduling_latency_s":1.899698,"redis_calls":13,"redis_duration_s":0.006444,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004105,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002339,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019138,"completed_at":"2026-09-06T06:48:30.623Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 156.517798] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"274cf357b7f693792a6e8f98","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-274cf357b7f693792a6e8f98: start","job_status":"start","queue_duration_s":1.922021,"scheduling_latency_s":1.922042}1455gitlab # [ 156.518108] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"274cf357b7f693792a6e8f98","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-274cf357b7f693792a6e8f98: done: 0.01562 sec","job_status":"done","queue_duration_s":1.922021,"scheduling_latency_s":1.922042,"redis_calls":13,"redis_duration_s":0.002747,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000868,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001879,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01562,"completed_at":"2026-09-06T06:48:30.642Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 156.600186] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"732fdbfc95f2a1ad6ed0650a","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-732fdbfc95f2a1ad6ed0650a: start","job_status":"start","queue_duration_s":1.938947,"scheduling_latency_s":1.938968}1457gitlab # [ 156.601833] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.659Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"732fdbfc95f2a1ad6ed0650a","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-732fdbfc95f2a1ad6ed0650a: done: 0.015688 sec","job_status":"done","queue_duration_s":1.938947,"scheduling_latency_s":1.938968,"redis_calls":13,"redis_duration_s":0.0029319999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000891,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002041,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015688,"completed_at":"2026-09-06T06:48:30.659Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 156.673487] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"455e2513bd549781f100b021","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-455e2513bd549781f100b021: start","job_status":"start","queue_duration_s":1.956105,"scheduling_latency_s":1.956125}1459gitlab # [ 156.674788] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"455e2513bd549781f100b021","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-455e2513bd549781f100b021: done: 0.015492 sec","job_status":"done","queue_duration_s":1.956105,"scheduling_latency_s":1.956125,"redis_calls":13,"redis_duration_s":0.002752,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001849,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015492,"completed_at":"2026-09-06T06:48:30.676Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 156.751048] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92a2698bdc177025cc5754ca","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92a2698bdc177025cc5754ca: start","job_status":"start","queue_duration_s":1.973062,"scheduling_latency_s":1.973083}1461gitlab # [ 156.752142] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.693Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92a2698bdc177025cc5754ca","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92a2698bdc177025cc5754ca: done: 0.015221 sec","job_status":"done","queue_duration_s":1.973062,"scheduling_latency_s":1.973083,"redis_calls":13,"redis_duration_s":0.0026709999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000812,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001859,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015221,"completed_at":"2026-09-06T06:48:30.693Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 156.823233] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.698Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8806c9b4fab2f5c093c1631f","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8806c9b4fab2f5c093c1631f: start","job_status":"start","queue_duration_s":1.993164,"scheduling_latency_s":1.993184}1463gitlab # [ 156.824378] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.716Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8806c9b4fab2f5c093c1631f","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8806c9b4fab2f5c093c1631f: done: 0.018632 sec","job_status":"done","queue_duration_s":1.993164,"scheduling_latency_s":1.993184,"redis_calls":13,"redis_duration_s":0.005386,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002404,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018632,"completed_at":"2026-09-06T06:48:30.716Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 156.902978] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c59dca2a1e84762aeda2e89a","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c59dca2a1e84762aeda2e89a: start","job_status":"start","queue_duration_s":2.013286,"scheduling_latency_s":2.013309}1465gitlab # [ 156.904248] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c59dca2a1e84762aeda2e89a","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c59dca2a1e84762aeda2e89a: done: 0.015334 sec","job_status":"done","queue_duration_s":2.013286,"scheduling_latency_s":2.013309,"redis_calls":13,"redis_duration_s":0.002791,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015334,"completed_at":"2026-09-06T06:48:30.733Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 156.977943] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.735Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea4bea90bd36a7448694f5da","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea4bea90bd36a7448694f5da: start","job_status":"start","queue_duration_s":2.030097,"scheduling_latency_s":2.030117}1467gitlab # [ 156.979110] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea4bea90bd36a7448694f5da","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea4bea90bd36a7448694f5da: done: 0.015327 sec","job_status":"done","queue_duration_s":2.030097,"scheduling_latency_s":2.030117,"redis_calls":13,"redis_duration_s":0.002805,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015327,"completed_at":"2026-09-06T06:48:30.750Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 157.050346] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c01c5eaedea1ff31eeb5d9f9","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c01c5eaedea1ff31eeb5d9f9: start","job_status":"start","queue_duration_s":2.046745,"scheduling_latency_s":2.046767}1469gitlab # [ 157.051500] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c01c5eaedea1ff31eeb5d9f9","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c01c5eaedea1ff31eeb5d9f9: done: 0.01544 sec","job_status":"done","queue_duration_s":2.046745,"scheduling_latency_s":2.046767,"redis_calls":13,"redis_duration_s":0.002778,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000849,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01544,"completed_at":"2026-09-06T06:48:30.767Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 157.126956] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.768Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10540476b3bd0946fa1f8aec","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10540476b3bd0946fa1f8aec: start","job_status":"start","queue_duration_s":2.06359,"scheduling_latency_s":2.063611}1471gitlab # [ 157.128118] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.786Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10540476b3bd0946fa1f8aec","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10540476b3bd0946fa1f8aec: done: 0.01766 sec","job_status":"done","queue_duration_s":2.06359,"scheduling_latency_s":2.063611,"redis_calls":13,"redis_duration_s":0.0049819999999999994,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000822,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00416,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01766,"completed_at":"2026-09-06T06:48:30.786Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 157.210371] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.787Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf7cb7a0cba5ffb729c8d44e","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf7cb7a0cba5ffb729c8d44e: start","job_status":"start","queue_duration_s":2.082516,"scheduling_latency_s":2.082537}1473gitlab # [ 157.211523] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.803Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf7cb7a0cba5ffb729c8d44e","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf7cb7a0cba5ffb729c8d44e: done: 0.015701 sec","job_status":"done","queue_duration_s":2.082516,"scheduling_latency_s":2.082537,"redis_calls":13,"redis_duration_s":0.002807,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000827,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00198,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015701,"completed_at":"2026-09-06T06:48:30.803Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 157.287162] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.804Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66472c2463a7bc7574bf2d36","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66472c2463a7bc7574bf2d36: start","job_status":"start","queue_duration_s":2.099526,"scheduling_latency_s":2.099547}1475gitlab # [ 157.288490] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66472c2463a7bc7574bf2d36","created_at":"2026-09-06T06:48:28.632Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-e12cd19114e54571","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"efc19110a824e9291274d40ba59eb5bf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:28.705Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66472c2463a7bc7574bf2d36: done: 0.015493 sec","job_status":"done","queue_duration_s":2.099526,"scheduling_latency_s":2.099547,"redis_calls":13,"redis_duration_s":0.002726,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000848,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001878,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015493,"completed_at":"2026-09-06T06:48:30.819Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 157.378423] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.821Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c1051faa97aae3e591741076","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c1051faa97aae3e591741076: start","job_status":"start","queue_duration_s":1.801966,"scheduling_latency_s":1.801987}1477gitlab # [ 157.379737] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.852Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c1051faa97aae3e591741076","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c1051faa97aae3e591741076: done: 0.030743 sec","job_status":"done","queue_duration_s":1.801966,"scheduling_latency_s":1.801987,"redis_calls":13,"redis_duration_s":0.003138,"redis_read_bytes":12,"redis_write_bytes":1300,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00051,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":289,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001128,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":395,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.0015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":616,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.006,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000569626,"duration_s":0.030743,"completed_at":"2026-09-06T06:48:30.852Z","load_balancing_strategy":"primary","db_duration_s":0.005601,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 157.448052] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"054ebbd2dbbe2ceb319f201c","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-054ebbd2dbbe2ceb319f201c: start","job_status":"start","queue_duration_s":1.834603,"scheduling_latency_s":1.834626}1479gitlab # [ 157.449386] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"054ebbd2dbbe2ceb319f201c","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-054ebbd2dbbe2ceb319f201c: done: 0.017567 sec","job_status":"done","queue_duration_s":1.834603,"scheduling_latency_s":1.834626,"redis_calls":10,"redis_duration_s":0.002464,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000933,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001531,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017567,"completed_at":"2026-09-06T06:48:30.871Z","load_balancing_strategy":"primary","db_duration_s":0.001505,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 157.522117] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1c2d3cd036c1e72eb6c1c9ca","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1c2d3cd036c1e72eb6c1c9ca: start","job_status":"start","queue_duration_s":1.853521,"scheduling_latency_s":1.853542}1481gitlab # [ 157.524896] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.890Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1c2d3cd036c1e72eb6c1c9ca","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1c2d3cd036c1e72eb6c1c9ca: done: 0.017707 sec","job_status":"done","queue_duration_s":1.853521,"scheduling_latency_s":1.853542,"redis_calls":10,"redis_duration_s":0.002437,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000959,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001478,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017707,"completed_at":"2026-09-06T06:48:30.890Z","load_balancing_strategy":"primary","db_duration_s":0.002979,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 157.644285] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"37cb709cf75a00031ace06da","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-37cb709cf75a00031ace06da: start","job_status":"start","queue_duration_s":1.872621,"scheduling_latency_s":1.872653}1483gitlab # [ 157.644764] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.909Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"37cb709cf75a00031ace06da","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-37cb709cf75a00031ace06da: done: 0.017042 sec","job_status":"done","queue_duration_s":1.872621,"scheduling_latency_s":1.872653,"redis_calls":10,"redis_duration_s":0.002499,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001127,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001372,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017042,"completed_at":"2026-09-06T06:48:30.909Z","load_balancing_strategy":"primary","db_duration_s":0.001426,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 157.720783] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cf2390a82f75501869111fb1","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cf2390a82f75501869111fb1: start","job_status":"start","queue_duration_s":1.891486,"scheduling_latency_s":1.891525}1485gitlab # [ 157.722344] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.934Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cf2390a82f75501869111fb1","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cf2390a82f75501869111fb1: done: 0.023654 sec","job_status":"done","queue_duration_s":1.891486,"scheduling_latency_s":1.891525,"redis_calls":10,"redis_duration_s":0.005755,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00385,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001905,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012937,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023654,"completed_at":"2026-09-06T06:48:30.934Z","load_balancing_strategy":"primary","db_duration_s":0.001554,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 157.797953] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.937Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9b60460a8bb18567d556893f","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9b60460a8bb18567d556893f: start","job_status":"start","queue_duration_s":1.917784,"scheduling_latency_s":1.917805}1487gitlab # [ 157.799283] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9b60460a8bb18567d556893f","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9b60460a8bb18567d556893f: done: 0.017171 sec","job_status":"done","queue_duration_s":1.917784,"scheduling_latency_s":1.917805,"redis_calls":10,"redis_duration_s":0.002202,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000821,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001381,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017171,"completed_at":"2026-09-06T06:48:30.954Z","load_balancing_strategy":"primary","db_duration_s":0.001513,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 157.815460] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7ca28d6734c30d843438eefb","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7ca28d6734c30d843438eefb: start","job_status":"start","queue_duration_s":1.936372,"scheduling_latency_s":1.936393}1489gitlab # [ 157.899069] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7ca28d6734c30d843438eefb","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7ca28d6734c30d843438eefb: done: 0.017161 sec","job_status":"done","queue_duration_s":1.936372,"scheduling_latency_s":1.936393,"redis_calls":10,"redis_duration_s":0.0022700000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000879,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001391,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017161,"completed_at":"2026-09-06T06:48:30.972Z","load_balancing_strategy":"primary","db_duration_s":0.002249,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 157.900955] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"98398163fc00ac038012bc0e","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-98398163fc00ac038012bc0e: start","job_status":"start","queue_duration_s":1.954989,"scheduling_latency_s":1.95501}1491gitlab # [ 157.912271] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"98398163fc00ac038012bc0e","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-98398163fc00ac038012bc0e: done: 0.016554 sec","job_status":"done","queue_duration_s":1.954989,"scheduling_latency_s":1.95501,"redis_calls":10,"redis_duration_s":0.002134,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00084,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001294,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011417,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016554,"completed_at":"2026-09-06T06:48:30.990Z","load_balancing_strategy":"primary","db_duration_s":0.001415,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 157.989104] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:30.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"740bcdf36f1af5c0cc18a1fa","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-740bcdf36f1af5c0cc18a1fa: start","job_status":"start","queue_duration_s":1.972975,"scheduling_latency_s":1.972995}1493gitlab # [ 157.990603] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"740bcdf36f1af5c0cc18a1fa","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-740bcdf36f1af5c0cc18a1fa: done: 0.024676 sec","job_status":"done","queue_duration_s":1.972975,"scheduling_latency_s":1.972995,"redis_calls":10,"redis_duration_s":0.009685,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005303,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004382,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024676,"completed_at":"2026-09-06T06:48:31.017Z","load_balancing_strategy":"primary","db_duration_s":0.002507,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 158.063143] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5d05a65f6ac7511688ba05db","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5d05a65f6ac7511688ba05db: start","job_status":"start","queue_duration_s":2.000305,"scheduling_latency_s":2.000328}1495gitlab # [ 158.066233] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5d05a65f6ac7511688ba05db","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5d05a65f6ac7511688ba05db: done: 0.021531 sec","job_status":"done","queue_duration_s":2.000305,"scheduling_latency_s":2.000328,"redis_calls":10,"redis_duration_s":0.0021869999999999997,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001277,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021531,"completed_at":"2026-09-06T06:48:31.041Z","load_balancing_strategy":"primary","db_duration_s":0.008817,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 158.154147] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f2b1b5244f0beb06b6c1dd39","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f2b1b5244f0beb06b6c1dd39: start","job_status":"start","queue_duration_s":2.023462,"scheduling_latency_s":2.023485}1497gitlab # [ 158.155658] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f2b1b5244f0beb06b6c1dd39","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f2b1b5244f0beb06b6c1dd39: done: 0.020221 sec","job_status":"done","queue_duration_s":2.023462,"scheduling_latency_s":2.023485,"redis_calls":10,"redis_duration_s":0.005159,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003852,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001307,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020221,"completed_at":"2026-09-06T06:48:31.063Z","load_balancing_strategy":"primary","db_duration_s":0.001559,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 158.248046] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"deff4dbc8b2711da2137f898","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-deff4dbc8b2711da2137f898: start","job_status":"start","queue_duration_s":2.044915,"scheduling_latency_s":2.044936}1499gitlab # [ 158.249401] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"deff4dbc8b2711da2137f898","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-deff4dbc8b2711da2137f898: done: 0.016599 sec","job_status":"done","queue_duration_s":2.044915,"scheduling_latency_s":2.044936,"redis_calls":10,"redis_duration_s":0.002218,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001298,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011178,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016599,"completed_at":"2026-09-06T06:48:31.080Z","load_balancing_strategy":"primary","db_duration_s":0.001304,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 158.326497] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c21ad81f7dddac25ef9431de","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c21ad81f7dddac25ef9431de: start","job_status":"start","queue_duration_s":2.063084,"scheduling_latency_s":2.063104}1501gitlab # [ 158.328192] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.102Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c21ad81f7dddac25ef9431de","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c21ad81f7dddac25ef9431de: done: 0.019683 sec","job_status":"done","queue_duration_s":2.063084,"scheduling_latency_s":2.063104,"redis_calls":10,"redis_duration_s":0.005063,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001718,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003345,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019683,"completed_at":"2026-09-06T06:48:31.102Z","load_balancing_strategy":"primary","db_duration_s":0.001324,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 158.407881] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a4f9d4fbb738798f94093c52","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a4f9d4fbb738798f94093c52: start","job_status":"start","queue_duration_s":2.084164,"scheduling_latency_s":2.084184}1503gitlab # [ 158.409300] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a4f9d4fbb738798f94093c52","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a4f9d4fbb738798f94093c52: done: 0.016366 sec","job_status":"done","queue_duration_s":2.084164,"scheduling_latency_s":2.084184,"redis_calls":10,"redis_duration_s":0.002311,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000875,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001436,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016366,"completed_at":"2026-09-06T06:48:31.119Z","load_balancing_strategy":"primary","db_duration_s":0.001293,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 158.483054] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6a254227c383873a984c202c","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6a254227c383873a984c202c: start","job_status":"start","queue_duration_s":2.102135,"scheduling_latency_s":2.102156}1505gitlab # [ 158.484229] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6a254227c383873a984c202c","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6a254227c383873a984c202c: done: 0.016565 sec","job_status":"done","queue_duration_s":2.102135,"scheduling_latency_s":2.102156,"redis_calls":10,"redis_duration_s":0.002184,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001306,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011345,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016565,"completed_at":"2026-09-06T06:48:31.138Z","load_balancing_strategy":"primary","db_duration_s":0.001306,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 158.558369] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.139Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0b7a9425b08c3901c46bc2d9","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0b7a9425b08c3901c46bc2d9: start","job_status":"start","queue_duration_s":2.120009,"scheduling_latency_s":2.12003}1507gitlab # [ 158.559439] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0b7a9425b08c3901c46bc2d9","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0b7a9425b08c3901c46bc2d9: done: 0.01688 sec","job_status":"done","queue_duration_s":2.120009,"scheduling_latency_s":2.12003,"redis_calls":10,"redis_duration_s":0.0021089999999999998,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000824,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001285,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011366,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01688,"completed_at":"2026-09-06T06:48:31.156Z","load_balancing_strategy":"primary","db_duration_s":0.001488,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 158.644984] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.157Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ea0e9a4ed82a4840df2830be","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ea0e9a4ed82a4840df2830be: start","job_status":"start","queue_duration_s":2.1382,"scheduling_latency_s":2.13822}1509gitlab # [ 158.646618] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ea0e9a4ed82a4840df2830be","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ea0e9a4ed82a4840df2830be: done: 0.021497 sec","job_status":"done","queue_duration_s":2.1382,"scheduling_latency_s":2.13822,"redis_calls":10,"redis_duration_s":0.006693,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00215,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004543,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021497,"completed_at":"2026-09-06T06:48:31.179Z","load_balancing_strategy":"primary","db_duration_s":0.001281,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 158.726404] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"2490a19f5480f969a454ad97","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-2490a19f5480f969a454ad97: start","job_status":"start","queue_duration_s":2.161131,"scheduling_latency_s":2.161152}1511gitlab # [ 158.727557] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.197Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"2490a19f5480f969a454ad97","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-2490a19f5480f969a454ad97: done: 0.016711 sec","job_status":"done","queue_duration_s":2.161131,"scheduling_latency_s":2.161152,"redis_calls":10,"redis_duration_s":0.002143,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000837,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001306,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016711,"completed_at":"2026-09-06T06:48:31.197Z","load_balancing_strategy":"primary","db_duration_s":0.001295,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 158.806791] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ddf7fad277f0d08f9c33ff2c","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ddf7fad277f0d08f9c33ff2c: start","job_status":"start","queue_duration_s":2.179183,"scheduling_latency_s":2.179204}1513gitlab # [ 158.808344] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.215Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ddf7fad277f0d08f9c33ff2c","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ddf7fad277f0d08f9c33ff2c: done: 0.016736 sec","job_status":"done","queue_duration_s":2.179183,"scheduling_latency_s":2.179204,"redis_calls":10,"redis_duration_s":0.002179,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000822,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001357,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016736,"completed_at":"2026-09-06T06:48:31.215Z","load_balancing_strategy":"primary","db_duration_s":0.001341,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 158.883381] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"204370e8f3cab998c935b8c3","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-204370e8f3cab998c935b8c3: start","job_status":"start","queue_duration_s":2.197529,"scheduling_latency_s":2.19755}1515gitlab # [ 158.884995] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"204370e8f3cab998c935b8c3","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-204370e8f3cab998c935b8c3: done: 0.06635 sec","job_status":"done","queue_duration_s":2.197529,"scheduling_latency_s":2.19755,"redis_calls":10,"redis_duration_s":0.002297,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001361,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.06635,"completed_at":"2026-09-06T06:48:31.283Z","load_balancing_strategy":"primary","db_duration_s":0.001713,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 158.955995] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5bcc65d0f36ab8250e08e900","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5bcc65d0f36ab8250e08e900: start","job_status":"start","queue_duration_s":2.265281,"scheduling_latency_s":2.265303}1517gitlab # [ 158.957219] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5bcc65d0f36ab8250e08e900","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5bcc65d0f36ab8250e08e900: done: 0.01661 sec","job_status":"done","queue_duration_s":2.265281,"scheduling_latency_s":2.265303,"redis_calls":10,"redis_duration_s":0.002198,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000826,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001372,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01661,"completed_at":"2026-09-06T06:48:31.301Z","load_balancing_strategy":"primary","db_duration_s":0.001412,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 158.986268] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8eef4c86149d91a4b2f23b67","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8eef4c86149d91a4b2f23b67: start","job_status":"start","queue_duration_s":2.283477,"scheduling_latency_s":2.283498}1519gitlab # [ 159.056458] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.319Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8eef4c86149d91a4b2f23b67","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8eef4c86149d91a4b2f23b67: done: 0.016289 sec","job_status":"done","queue_duration_s":2.283477,"scheduling_latency_s":2.283498,"redis_calls":10,"redis_duration_s":0.00221,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00083,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00138,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016289,"completed_at":"2026-09-06T06:48:31.319Z","load_balancing_strategy":"primary","db_duration_s":0.001311,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 159.064487] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.320Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b575dc5646256d06e31ea943","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b575dc5646256d06e31ea943: start","job_status":"start","queue_duration_s":2.301006,"scheduling_latency_s":2.301027}1521gitlab # [ 159.139815] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b575dc5646256d06e31ea943","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b575dc5646256d06e31ea943: done: 0.020245 sec","job_status":"done","queue_duration_s":2.301006,"scheduling_latency_s":2.301027,"redis_calls":10,"redis_duration_s":0.0050030000000000005,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002948,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020245,"completed_at":"2026-09-06T06:48:31.340Z","load_balancing_strategy":"primary","db_duration_s":0.00133,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 159.143129] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"83f4d7928c9de47dc9bb1915","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-83f4d7928c9de47dc9bb1915: start","job_status":"start","queue_duration_s":2.322644,"scheduling_latency_s":2.322665}1523gitlab # [ 159.219355] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"83f4d7928c9de47dc9bb1915","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-83f4d7928c9de47dc9bb1915: done: 0.016268 sec","job_status":"done","queue_duration_s":2.322644,"scheduling_latency_s":2.322665,"redis_calls":10,"redis_duration_s":0.002395,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001038,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001357,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016268,"completed_at":"2026-09-06T06:48:31.358Z","load_balancing_strategy":"primary","db_duration_s":0.001268,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524gitlab # [ 159.221926] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"357e5207af21062d7212034e","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-357e5207af21062d7212034e: start","job_status":"start","queue_duration_s":2.340611,"scheduling_latency_s":2.340632}1525gitlab # [ 159.294175] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"357e5207af21062d7212034e","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-357e5207af21062d7212034e: done: 0.016083 sec","job_status":"done","queue_duration_s":2.340611,"scheduling_latency_s":2.340632,"redis_calls":10,"redis_duration_s":0.002174,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001356,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016083,"completed_at":"2026-09-06T06:48:31.376Z","load_balancing_strategy":"primary","db_duration_s":0.0013,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526gitlab # [ 159.363135] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f87b333da8822fa6d9c77c69","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f87b333da8822fa6d9c77c69: start","job_status":"start","queue_duration_s":2.357965,"scheduling_latency_s":2.357986}1527gitlab # [ 159.364256] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f87b333da8822fa6d9c77c69","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f87b333da8822fa6d9c77c69: done: 0.016098 sec","job_status":"done","queue_duration_s":2.357965,"scheduling_latency_s":2.357986,"redis_calls":10,"redis_duration_s":0.002203,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00086,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001343,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016098,"completed_at":"2026-09-06T06:48:31.393Z","load_balancing_strategy":"primary","db_duration_s":0.001336,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528gitlab # [ 159.379287] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a104810050ef96075113705b","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a104810050ef96075113705b: start","job_status":"start","queue_duration_s":2.375399,"scheduling_latency_s":2.37546}1529gitlab # [ 159.455197] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a104810050ef96075113705b","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a104810050ef96075113705b: done: 0.020271 sec","job_status":"done","queue_duration_s":2.375399,"scheduling_latency_s":2.37546,"redis_calls":10,"redis_duration_s":0.00571,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001476,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004234,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020271,"completed_at":"2026-09-06T06:48:31.415Z","load_balancing_strategy":"primary","db_duration_s":0.001322,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 159.457330] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ed09ac57ebb3f946c4b2d9fd","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ed09ac57ebb3f946c4b2d9fd: start","job_status":"start","queue_duration_s":2.396974,"scheduling_latency_s":2.396995}1531gitlab # [ 159.534074] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ed09ac57ebb3f946c4b2d9fd","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ed09ac57ebb3f946c4b2d9fd: done: 0.016369 sec","job_status":"done","queue_duration_s":2.396974,"scheduling_latency_s":2.396995,"redis_calls":10,"redis_duration_s":0.002166,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001259,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016369,"completed_at":"2026-09-06T06:48:31.432Z","load_balancing_strategy":"primary","db_duration_s":0.001297,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532gitlab # [ 159.536400] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c0612ecce6f4d367ee9a0838","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c0612ecce6f4d367ee9a0838: start","job_status":"start","queue_duration_s":2.414663,"scheduling_latency_s":2.414684}1533gitlab # [ 159.556081] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c0612ecce6f4d367ee9a0838","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c0612ecce6f4d367ee9a0838: done: 0.016174 sec","job_status":"done","queue_duration_s":2.414663,"scheduling_latency_s":2.414684,"redis_calls":10,"redis_duration_s":0.002247,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001393,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016174,"completed_at":"2026-09-06T06:48:31.450Z","load_balancing_strategy":"primary","db_duration_s":0.001287,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534gitlab # [ 159.636109] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.451Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7183e5ca1459c586099bdf93","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7183e5ca1459c586099bdf93: start","job_status":"start","queue_duration_s":2.432092,"scheduling_latency_s":2.432112}1535gitlab # [ 159.637464] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.467Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7183e5ca1459c586099bdf93","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7183e5ca1459c586099bdf93: done: 0.01641 sec","job_status":"done","queue_duration_s":2.432092,"scheduling_latency_s":2.432112,"redis_calls":10,"redis_duration_s":0.002366,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001018,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001348,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010707,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01641,"completed_at":"2026-09-06T06:48:31.467Z","load_balancing_strategy":"primary","db_duration_s":0.001364,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536gitlab # [ 159.714319] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d8f6b3659074cf07cc6bcde1","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d8f6b3659074cf07cc6bcde1: start","job_status":"start","queue_duration_s":2.450188,"scheduling_latency_s":2.450209}1537gitlab # [ 159.715885] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.490Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d8f6b3659074cf07cc6bcde1","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d8f6b3659074cf07cc6bcde1: done: 0.021211 sec","job_status":"done","queue_duration_s":2.450188,"scheduling_latency_s":2.450209,"redis_calls":10,"redis_duration_s":0.007168,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003754,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003414,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021211,"completed_at":"2026-09-06T06:48:31.490Z","load_balancing_strategy":"primary","db_duration_s":0.001347,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538gitlab # [ 159.794300] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d1a5ce67b8194770c54fbbd4","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d1a5ce67b8194770c54fbbd4: start","job_status":"start","queue_duration_s":2.474757,"scheduling_latency_s":2.474778}1539gitlab # [ 159.795898] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d1a5ce67b8194770c54fbbd4","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d1a5ce67b8194770c54fbbd4: done: 0.021488 sec","job_status":"done","queue_duration_s":2.474757,"scheduling_latency_s":2.474778,"redis_calls":10,"redis_duration_s":0.006693,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003764,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021488,"completed_at":"2026-09-06T06:48:31.515Z","load_balancing_strategy":"primary","db_duration_s":0.001355,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 159.869992] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"62d39ccfdf973ffdab5b27bf","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-62d39ccfdf973ffdab5b27bf: start","job_status":"start","queue_duration_s":2.498239,"scheduling_latency_s":2.49826}1541gitlab # [ 159.871188] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"62d39ccfdf973ffdab5b27bf","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-62d39ccfdf973ffdab5b27bf: done: 0.01647 sec","job_status":"done","queue_duration_s":2.498239,"scheduling_latency_s":2.49826,"redis_calls":10,"redis_duration_s":0.002175,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001309,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010565,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01647,"completed_at":"2026-09-06T06:48:31.534Z","load_balancing_strategy":"primary","db_duration_s":0.001297,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542gitlab # [ 159.949107] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b6477c6fd1c719e3fe4ca2bf","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b6477c6fd1c719e3fe4ca2bf: start","job_status":"start","queue_duration_s":2.515997,"scheduling_latency_s":2.516017}1543gitlab # [ 159.950499] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b6477c6fd1c719e3fe4ca2bf","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b6477c6fd1c719e3fe4ca2bf: done: 0.016004 sec","job_status":"done","queue_duration_s":2.515997,"scheduling_latency_s":2.516017,"redis_calls":10,"redis_duration_s":0.002148,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000896,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001252,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016004,"completed_at":"2026-09-06T06:48:31.551Z","load_balancing_strategy":"primary","db_duration_s":0.001336,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544gitlab # [ 160.029843] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"78817bbe6042ea1a277b1c96","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-78817bbe6042ea1a277b1c96: start","job_status":"start","queue_duration_s":2.533342,"scheduling_latency_s":2.533362}1545gitlab # [ 160.031292] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"78817bbe6042ea1a277b1c96","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-78817bbe6042ea1a277b1c96: done: 0.016481 sec","job_status":"done","queue_duration_s":2.533342,"scheduling_latency_s":2.533362,"redis_calls":10,"redis_duration_s":0.002397,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001065,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001332,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011178,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016481,"completed_at":"2026-09-06T06:48:31.569Z","load_balancing_strategy":"primary","db_duration_s":0.001318,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1546gitlab # [ 160.105354] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.570Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5d3c157800b158ef87675813","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5d3c157800b158ef87675813: start","job_status":"start","queue_duration_s":2.551099,"scheduling_latency_s":2.551119}1547gitlab # [ 160.107073] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.589Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5d3c157800b158ef87675813","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5d3c157800b158ef87675813: done: 0.019123 sec","job_status":"done","queue_duration_s":2.551099,"scheduling_latency_s":2.551119,"redis_calls":10,"redis_duration_s":0.004617,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002842,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001775,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019123,"completed_at":"2026-09-06T06:48:31.589Z","load_balancing_strategy":"primary","db_duration_s":0.001328,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1548gitlab # [ 160.199907] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"13f8cba1374ace3ed12ea006","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-13f8cba1374ace3ed12ea006: start","job_status":"start","queue_duration_s":2.573847,"scheduling_latency_s":2.573869}1549gitlab # [ 160.201051] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.610Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"13f8cba1374ace3ed12ea006","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-13f8cba1374ace3ed12ea006: done: 0.016877 sec","job_status":"done","queue_duration_s":2.573847,"scheduling_latency_s":2.573869,"redis_calls":10,"redis_duration_s":0.002494,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000834,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00166,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016877,"completed_at":"2026-09-06T06:48:31.610Z","load_balancing_strategy":"primary","db_duration_s":0.001673,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1550gitlab # [ 160.285367] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.611Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ad3f1901ef1a8d40c374ae8f","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ad3f1901ef1a8d40c374ae8f: start","job_status":"start","queue_duration_s":2.591994,"scheduling_latency_s":2.592015}1551gitlab # [ 160.286943] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ad3f1901ef1a8d40c374ae8f","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ad3f1901ef1a8d40c374ae8f: done: 0.01608 sec","job_status":"done","queue_duration_s":2.591994,"scheduling_latency_s":2.592015,"redis_calls":10,"redis_duration_s":0.00219,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001324,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01608,"completed_at":"2026-09-06T06:48:31.627Z","load_balancing_strategy":"primary","db_duration_s":0.001345,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1552gitlab # [ 160.375234] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.629Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0c80e39eb603a030b0048c30","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0c80e39eb603a030b0048c30: start","job_status":"start","queue_duration_s":2.609737,"scheduling_latency_s":2.609758}1553gitlab # [ 160.376858] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.645Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0c80e39eb603a030b0048c30","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0c80e39eb603a030b0048c30: done: 0.016375 sec","job_status":"done","queue_duration_s":2.609737,"scheduling_latency_s":2.609758,"redis_calls":10,"redis_duration_s":0.0027140000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001399,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001315,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0112,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016375,"completed_at":"2026-09-06T06:48:31.645Z","load_balancing_strategy":"primary","db_duration_s":0.001315,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1554gitlab # [ 160.402764] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a538d3634fa7dda1e44247ea","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a538d3634fa7dda1e44247ea: start","job_status":"start","queue_duration_s":2.627491,"scheduling_latency_s":2.627512}1555gitlab # [ 160.487206] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.663Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a538d3634fa7dda1e44247ea","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a538d3634fa7dda1e44247ea: done: 0.016428 sec","job_status":"done","queue_duration_s":2.627491,"scheduling_latency_s":2.627512,"redis_calls":10,"redis_duration_s":0.002271,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000822,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001449,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016428,"completed_at":"2026-09-06T06:48:31.663Z","load_balancing_strategy":"primary","db_duration_s":0.001407,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1556gitlab # [ 160.488985] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.668Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3727b25e5661bb80578cb779","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3727b25e5661bb80578cb779: start","job_status":"start","queue_duration_s":2.648989,"scheduling_latency_s":2.649011}1557gitlab # [ 160.500414] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.686Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3727b25e5661bb80578cb779","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3727b25e5661bb80578cb779: done: 0.018175 sec","job_status":"done","queue_duration_s":2.648989,"scheduling_latency_s":2.649011,"redis_calls":10,"redis_duration_s":0.003673,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001338,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002335,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01087,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018175,"completed_at":"2026-09-06T06:48:31.686Z","load_balancing_strategy":"primary","db_duration_s":0.001329,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1558gitlab # [ 160.575395] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"881f5b96cd1ef5a7818addbe","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-881f5b96cd1ef5a7818addbe: start","job_status":"start","queue_duration_s":2.668897,"scheduling_latency_s":2.668917}1559gitlab # [ 160.579299] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.704Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"881f5b96cd1ef5a7818addbe","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-881f5b96cd1ef5a7818addbe: done: 0.016239 sec","job_status":"done","queue_duration_s":2.668897,"scheduling_latency_s":2.668917,"redis_calls":10,"redis_duration_s":0.002142,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001249,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016239,"completed_at":"2026-09-06T06:48:31.704Z","load_balancing_strategy":"primary","db_duration_s":0.001343,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1560gitlab # [ 160.655944] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.705Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"aba8d4320e889205abaddda2","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-aba8d4320e889205abaddda2: start","job_status":"start","queue_duration_s":2.686504,"scheduling_latency_s":2.686525}1561gitlab # [ 160.657480] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"aba8d4320e889205abaddda2","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-aba8d4320e889205abaddda2: done: 0.016602 sec","job_status":"done","queue_duration_s":2.686504,"scheduling_latency_s":2.686525,"redis_calls":10,"redis_duration_s":0.002257,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001343,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016602,"completed_at":"2026-09-06T06:48:31.722Z","load_balancing_strategy":"primary","db_duration_s":0.00135,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1562gitlab # [ 160.739359] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.723Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7888f8540062f98c75128205","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7888f8540062f98c75128205: start","job_status":"start","queue_duration_s":2.704379,"scheduling_latency_s":2.7044}1563gitlab # [ 160.740949] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.739Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7888f8540062f98c75128205","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7888f8540062f98c75128205: done: 0.016069 sec","job_status":"done","queue_duration_s":2.704379,"scheduling_latency_s":2.7044,"redis_calls":10,"redis_duration_s":0.002157,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00129,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016069,"completed_at":"2026-09-06T06:48:31.739Z","load_balancing_strategy":"primary","db_duration_s":0.001292,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1564gitlab # [ 160.814356] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e5ac47efa67c712e9012cec8","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e5ac47efa67c712e9012cec8: start","job_status":"start","queue_duration_s":2.721742,"scheduling_latency_s":2.721763}1565gitlab # [ 160.815856] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e5ac47efa67c712e9012cec8","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e5ac47efa67c712e9012cec8: done: 0.022192 sec","job_status":"done","queue_duration_s":2.721742,"scheduling_latency_s":2.721763,"redis_calls":10,"redis_duration_s":0.005303,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003215,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01135,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022192,"completed_at":"2026-09-06T06:48:31.763Z","load_balancing_strategy":"primary","db_duration_s":0.001408,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1566gitlab # [ 160.889919] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e6fe4a27cdae93005f018d63","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e6fe4a27cdae93005f018d63: start","job_status":"start","queue_duration_s":2.745238,"scheduling_latency_s":2.745259}1567gitlab # [ 160.892934] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e6fe4a27cdae93005f018d63","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e6fe4a27cdae93005f018d63: done: 0.016059 sec","job_status":"done","queue_duration_s":2.745238,"scheduling_latency_s":2.745259,"redis_calls":10,"redis_duration_s":0.002188,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00087,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001318,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016059,"completed_at":"2026-09-06T06:48:31.780Z","load_balancing_strategy":"primary","db_duration_s":0.001303,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1568gitlab # [ 160.965349] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"fd850ee7ae6d143262527a16","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-fd850ee7ae6d143262527a16: start","job_status":"start","queue_duration_s":2.762612,"scheduling_latency_s":2.762633}1569gitlab # [ 160.971328] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"fd850ee7ae6d143262527a16","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-fd850ee7ae6d143262527a16: done: 0.016918 sec","job_status":"done","queue_duration_s":2.762612,"scheduling_latency_s":2.762633,"redis_calls":10,"redis_duration_s":0.002163,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000876,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001287,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016918,"completed_at":"2026-09-06T06:48:31.798Z","load_balancing_strategy":"primary","db_duration_s":0.001297,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1570gitlab # [ 161.039985] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7acfdd45c670e21407eb74c7","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7acfdd45c670e21407eb74c7: start","job_status":"start","queue_duration_s":2.78083,"scheduling_latency_s":2.780851}1571gitlab # [ 161.049373] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7acfdd45c670e21407eb74c7","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7acfdd45c670e21407eb74c7: done: 0.016319 sec","job_status":"done","queue_duration_s":2.78083,"scheduling_latency_s":2.780851,"redis_calls":10,"redis_duration_s":0.0026420000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001784,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016319,"completed_at":"2026-09-06T06:48:31.816Z","load_balancing_strategy":"primary","db_duration_s":0.001317,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1572gitlab # [ 161.142331] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c5f50bdc323bb37c42859594","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c5f50bdc323bb37c42859594: start","job_status":"start","queue_duration_s":2.798417,"scheduling_latency_s":2.798469}1573gitlab # [ 161.143487] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c5f50bdc323bb37c42859594","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c5f50bdc323bb37c42859594: done: 0.019332 sec","job_status":"done","queue_duration_s":2.798417,"scheduling_latency_s":2.798469,"redis_calls":10,"redis_duration_s":0.004987,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004074,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011436,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019332,"completed_at":"2026-09-06T06:48:31.837Z","load_balancing_strategy":"primary","db_duration_s":0.001342,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1574gitlab # [ 161.217057] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.839Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"aa21074d479663b090e7f6a2","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-aa21074d479663b090e7f6a2: start","job_status":"start","queue_duration_s":2.819565,"scheduling_latency_s":2.819586}1575gitlab # [ 161.218167] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:48:31.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"aa21074d479663b090e7f6a2","created_at":"2026-09-06T06:48:28.949Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-53ee80e2f54342af","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"1690e08164df161a4f6fd19874b3a4e7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:48:29.019Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-aa21074d479663b090e7f6a2: done: 0.016299 sec","job_status":"done","queue_duration_s":2.819565,"scheduling_latency_s":2.819586,"redis_calls":10,"redis_duration_s":0.002214,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000824,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00139,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016299,"completed_at":"2026-09-06T06:48:31.855Z","load_balancing_strategy":"primary","db_duration_s":0.001313,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1576gitlab # [ 161.602716] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 11064018952 wd_nsec: 110640184881577gitlab # [ 168.739789] setup-gitlab-start[2283]: W, [2026-09-06T06:48:45.942499 #2283] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1578gitlab # [ 187.686879] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:04.888Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"2285d3422378cbea094eb012","created_at":"2026-09-06T06:49:04.850Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d8e57fff87aa897b393c25d17c589fb8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.885Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-2285d3422378cbea094eb012: start","job_status":"start","queue_duration_s":0.003061,"scheduling_latency_s":0.003125}1579gitlab # [ 187.845257] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.048Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"2285d3422378cbea094eb012","created_at":"2026-09-06T06:49:04.850Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d8e57fff87aa897b393c25d17c589fb8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.885Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-2285d3422378cbea094eb012: done: 0.159282 sec","job_status":"done","queue_duration_s":0.003061,"scheduling_latency_s":0.003125,"redis_calls":7,"redis_duration_s":0.012549000000000001,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0099,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002649,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.159282,"completed_at":"2026-09-06T06:49:05.047Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1580gitlab # [ 187.944546] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.147Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"e8adcc53549b1409a63cc4d5","created_at":"2026-09-06T06:49:04.950Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30adaa601340beb7f30dbbaff7a4bcdb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.958Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-e8adcc53549b1409a63cc4d5: start","job_status":"start","queue_duration_s":0.188667,"scheduling_latency_s":0.188729}1581gitlab # [ 188.063984] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.266Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"e8adcc53549b1409a63cc4d5","created_at":"2026-09-06T06:49:04.950Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30adaa601340beb7f30dbbaff7a4bcdb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:04.958Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-e8adcc53549b1409a63cc4d5: done: 0.119463 sec","job_status":"done","queue_duration_s":0.188667,"scheduling_latency_s":0.188729,"redis_calls":9,"redis_duration_s":0.01393,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006743,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.007187,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.059,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.059,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030918,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00471289,"exclusive_lock_hold_duration_s":0.063352466,"duration_s":0.119463,"completed_at":"2026-09-06T06:49:05.266Z","load_balancing_strategy":"primary","db_duration_s":0.086834,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1582gitlab # [ 188.155970] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.358Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"c10deded1b31e05d606fbaee","created_at":"2026-09-06T06:49:04.980Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e0ee95bc363a0bb01884db1a12e197c7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T06:49:04.993Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-c10deded1b31e05d606fbaee: start","job_status":"start","queue_duration_s":0.36531,"scheduling_latency_s":0.365365}1583gitlab # [ 188.201493] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.404Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1584gitlab # [ 188.233162] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.436Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"c10deded1b31e05d606fbaee","created_at":"2026-09-06T06:49:04.980Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e0ee95bc363a0bb01884db1a12e197c7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T06:49:04.993Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-c10deded1b31e05d606fbaee: done: 0.07795 sec","job_status":"done","queue_duration_s":0.36531,"scheduling_latency_s":0.365365,"redis_calls":7,"redis_duration_s":0.020176,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.017536,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00264,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.07795,"completed_at":"2026-09-06T06:49:05.436Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585gitlab # [ 188.299583] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.502Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"9c390fa9b94fd59da3d25de9","created_at":"2026-09-06T06:49:05.042Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c4790fbe82512e6d6f8a324c05f5dcf5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.050Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-9c390fa9b94fd59da3d25de9: start","job_status":"start","queue_duration_s":0.451906,"scheduling_latency_s":0.451961}1586gitlab # [ 188.344683] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.548Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1587gitlab # [ 188.365126] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.567Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"9c390fa9b94fd59da3d25de9","created_at":"2026-09-06T06:49:05.042Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c4790fbe82512e6d6f8a324c05f5dcf5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.050Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-9c390fa9b94fd59da3d25de9: done: 0.06466 sec","job_status":"done","queue_duration_s":0.451906,"scheduling_latency_s":0.451961,"redis_calls":7,"redis_duration_s":0.015017,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011088,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003929,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.06466,"completed_at":"2026-09-06T06:49:05.567Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1588gitlab # [ 188.437260] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.640Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"457713fa540d3aefd3025b74","created_at":"2026-09-06T06:49:05.153Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb2ee625dc516575d05c1df97d488375","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T06:49:05.158Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-457713fa540d3aefd3025b74: start","job_status":"start","queue_duration_s":0.482446,"scheduling_latency_s":0.482474}1589gitlab # [ 188.471375] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.674Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1590gitlab # [ 188.479403] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.682Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"457713fa540d3aefd3025b74","created_at":"2026-09-06T06:49:05.153Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb2ee625dc516575d05c1df97d488375","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T06:49:05.158Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-457713fa540d3aefd3025b74: done: 0.042298 sec","job_status":"done","queue_duration_s":0.482446,"scheduling_latency_s":0.482474,"redis_calls":7,"redis_duration_s":0.006240000000000001,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004223,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002017,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042298,"completed_at":"2026-09-06T06:49:05.682Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591gitlab # [ 188.517834] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.719Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"40edbc6528f6aa276ce931d7","created_at":"2026-09-06T06:49:05.191Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f53a5a49240e2f7343d376f29cbcfe61","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.196Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-40edbc6528f6aa276ce931d7: start","job_status":"start","queue_duration_s":0.522632,"scheduling_latency_s":0.52268}1592gitlab # [ 188.550444] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.753Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"40edbc6528f6aa276ce931d7","created_at":"2026-09-06T06:49:05.191Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f53a5a49240e2f7343d376f29cbcfe61","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.196Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-40edbc6528f6aa276ce931d7: done: 0.034939 sec","job_status":"done","queue_duration_s":0.522632,"scheduling_latency_s":0.52268,"redis_calls":9,"redis_duration_s":0.00609,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004066,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002024,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000787251,"exclusive_lock_hold_duration_s":0.002672966,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.034939,"completed_at":"2026-09-06T06:49:05.753Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000929,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593gitlab # [ 188.561454] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.755Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"858d3f895dec62f53edd4f5a","created_at":"2026-09-06T06:49:05.212Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14ab594ecb5841f972063d4ac7f9fb1e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.215Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-858d3f895dec62f53edd4f5a: start","job_status":"start","queue_duration_s":0.539838,"scheduling_latency_s":0.539861}1594gitlab # [ 188.654556] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.763Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1595gitlab # [ 188.655903] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.767Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"858d3f895dec62f53edd4f5a","created_at":"2026-09-06T06:49:05.212Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14ab594ecb5841f972063d4ac7f9fb1e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.215Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-858d3f895dec62f53edd4f5a: done: 0.012613 sec","job_status":"done","queue_duration_s":0.539838,"scheduling_latency_s":0.539861,"redis_calls":7,"redis_duration_s":0.001623,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001183,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00044,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012613,"completed_at":"2026-09-06T06:49:05.767Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1596gitlab # [ 188.657856] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.769Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"117b348caf09431e00126b37","created_at":"2026-09-06T06:49:05.225Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1fb673feefef4d3a9aeba0a51e9bacc8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.227Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-117b348caf09431e00126b37: start","job_status":"start","queue_duration_s":0.542287,"scheduling_latency_s":0.542307}1597gitlab # [ 188.726664] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.798Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"117b348caf09431e00126b37","created_at":"2026-09-06T06:49:05.225Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1fb673feefef4d3a9aeba0a51e9bacc8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.227Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-117b348caf09431e00126b37: done: 0.029206 sec","job_status":"done","queue_duration_s":0.542287,"scheduling_latency_s":0.542307,"redis_calls":9,"redis_duration_s":0.002797,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001572,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001225,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013989,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000597004,"exclusive_lock_hold_duration_s":0.008373969,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.029206,"completed_at":"2026-09-06T06:49:05.798Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0101,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1598gitlab # [ 188.795513] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.799Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"b6724af58dad3d7ab2fcc25c","created_at":"2026-09-06T06:49:05.230Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"387cd475c453bb77d3540f564eba11ac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.232Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-b6724af58dad3d7ab2fcc25c: start","job_status":"start","queue_duration_s":0.567628,"scheduling_latency_s":0.567648}1599gitlab # [ 188.796894] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.822Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"b6724af58dad3d7ab2fcc25c","created_at":"2026-09-06T06:49:05.230Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"387cd475c453bb77d3540f564eba11ac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.232Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-b6724af58dad3d7ab2fcc25c: done: 0.022491 sec","job_status":"done","queue_duration_s":0.567628,"scheduling_latency_s":0.567648,"redis_calls":14,"redis_duration_s":0.0031290000000000003,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000322,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002112,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000695,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022491,"completed_at":"2026-09-06T06:49:05.822Z","load_balancing_strategy":"primary","db_duration_s":0.001923,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1600gitlab # [ 188.865424] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.823Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"352c9cfda8922fa71a5c8c48","created_at":"2026-09-06T06:49:05.244Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d6d53cb016802a3c353bda0949c9f2f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.245Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-352c9cfda8922fa71a5c8c48: start","job_status":"start","queue_duration_s":0.577809,"scheduling_latency_s":0.577831}1601gitlab # [ 188.866988] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.842Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"352c9cfda8922fa71a5c8c48","created_at":"2026-09-06T06:49:05.244Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d6d53cb016802a3c353bda0949c9f2f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.245Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-352c9cfda8922fa71a5c8c48: done: 0.019177 sec","job_status":"done","queue_duration_s":0.577809,"scheduling_latency_s":0.577831,"redis_calls":7,"redis_duration_s":0.00179,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00129,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0005,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019177,"completed_at":"2026-09-06T06:49:05.842Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002506,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1602gitlab # [ 188.946922] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:05.844Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"2f911fa808be4f12908e7d59","created_at":"2026-09-06T06:49:05.258Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.260Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-2f911fa808be4f12908e7d59: start","job_status":"start","queue_duration_s":0.584053,"scheduling_latency_s":0.584079}1603gitlab # [ 188.947990] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:06.085Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"2f911fa808be4f12908e7d59","created_at":"2026-09-06T06:49:05.258Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.260Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-2f911fa808be4f12908e7d59: done: 0.241318 sec","job_status":"done","queue_duration_s":0.584053,"scheduling_latency_s":0.584079,"redis_calls":60,"redis_duration_s":0.022035,"redis_read_bytes":108,"redis_write_bytes":41009,"redis_queues_calls":2,"redis_queues_duration_s":0.000831,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37385,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.019941,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001263,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.241318,"completed_at":"2026-09-06T06:49:06.085Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1604gitlab # [ 189.025248] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:06.087Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"7e82f6db28af1c87bbd9d49e","created_at":"2026-09-06T06:49:05.357Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"105b9bb3dbbb41a0de467b0280ccbf2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.397Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-7e82f6db28af1c87bbd9d49e: start","job_status":"start","queue_duration_s":0.689637,"scheduling_latency_s":0.689662}1605gitlab # [ 189.029402] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:06.215Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"7e82f6db28af1c87bbd9d49e","created_at":"2026-09-06T06:49:05.357Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"105b9bb3dbbb41a0de467b0280ccbf2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.397Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-7e82f6db28af1c87bbd9d49e: done: 0.128475 sec","job_status":"done","queue_duration_s":0.689637,"scheduling_latency_s":0.689662,"redis_calls":12,"redis_duration_s":0.003453,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000423,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001928,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001102,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.104244,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000447263,"exclusive_lock_hold_duration_s":0.109810325,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.128475,"completed_at":"2026-09-06T06:49:06.215Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01543,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1606gitlab # [ 189.112311] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:06.217Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"92d03bb7b7742b4736d90fea","created_at":"2026-09-06T06:49:05.424Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"19591935af0e5ee733ab4bc0b870e958","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.438Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-92d03bb7b7742b4736d90fea: start","job_status":"start","queue_duration_s":0.779255,"scheduling_latency_s":0.779277}1607gitlab # [ 189.116304] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:06.254Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"92d03bb7b7742b4736d90fea","created_at":"2026-09-06T06:49:05.424Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"19591935af0e5ee733ab4bc0b870e958","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.438Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-92d03bb7b7742b4736d90fea: done: 0.037479 sec","job_status":"done","queue_duration_s":0.779255,"scheduling_latency_s":0.779277,"redis_calls":9,"redis_duration_s":0.002524,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001455,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001069,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017219,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000527441,"exclusive_lock_hold_duration_s":0.022007546,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.037479,"completed_at":"2026-09-06T06:49:06.254Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015651,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1608gitlab # [ 189.191109] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:06.256Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"64047da1a1423bcc512a66b1","created_at":"2026-09-06T06:49:05.544Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b37fa9f40f8e35961fdb29175ff47870","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.558Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-64047da1a1423bcc512a66b1: start","job_status":"start","queue_duration_s":0.698132,"scheduling_latency_s":0.69816}1609gitlab # [ 189.195967] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:06.264Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1610gitlab # [ 189.202183] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:06.268Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"64047da1a1423bcc512a66b1","created_at":"2026-09-06T06:49:05.544Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b37fa9f40f8e35961fdb29175ff47870","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.558Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-64047da1a1423bcc512a66b1: done: 0.012282 sec","job_status":"done","queue_duration_s":0.698132,"scheduling_latency_s":0.69816,"redis_calls":7,"redis_duration_s":0.00158,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001159,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000421,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012282,"completed_at":"2026-09-06T06:49:06.268Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1611gitlab # [ 189.282284] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:06.270Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"884c57d7a71cd38fa3b1804c","created_at":"2026-09-06T06:49:05.572Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"450d10146282afb57b2e4544bbfc12ed","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T06:49:05.576Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-884c57d7a71cd38fa3b1804c: start","job_status":"start","queue_duration_s":0.694212,"scheduling_latency_s":0.694232}1612gitlab # [ 189.284179] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:06.301Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"884c57d7a71cd38fa3b1804c","created_at":"2026-09-06T06:49:05.572Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"450d10146282afb57b2e4544bbfc12ed","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T06:49:05.576Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-884c57d7a71cd38fa3b1804c: done: 0.03074 sec","job_status":"done","queue_duration_s":0.694212,"scheduling_latency_s":0.694232,"redis_calls":7,"redis_duration_s":0.004014,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00351,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000504,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03074,"completed_at":"2026-09-06T06:49:06.301Z","load_balancing_strategy":"primary","db_duration_s":0.005759,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1613gitlab # [ 189.405764] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:06.302Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e715e5db430fae1771daff57","created_at":"2026-09-06T06:49:05.588Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f9c574ce054cb772e473e3329cb513b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.593Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e715e5db430fae1771daff57: start","job_status":"start","queue_duration_s":0.709608,"scheduling_latency_s":0.709634}1614gitlab # [ 189.407176] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:06.393Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e715e5db430fae1771daff57","created_at":"2026-09-06T06:49:05.588Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f9c574ce054cb772e473e3329cb513b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.593Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e715e5db430fae1771daff57: done: 0.090629 sec","job_status":"done","queue_duration_s":0.709608,"scheduling_latency_s":0.709634,"redis_calls":10,"redis_duration_s":0.012817,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005146,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.007671,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.035302811,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.090629,"completed_at":"2026-09-06T06:49:06.393Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.039295,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1615gitlab # [ 189.486465] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:06.410Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"18a986d1f34308cc47ae2137","created_at":"2026-09-06T06:49:05.607Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b4f6b4c5a677b053e9ccaa3b4402e7c","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.609Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-18a986d1f34308cc47ae2137: start","job_status":"start","queue_duration_s":0.801247,"scheduling_latency_s":0.801274}1616gitlab # [ 189.973114] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:07.175Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"18a986d1f34308cc47ae2137","created_at":"2026-09-06T06:49:05.607Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b4f6b4c5a677b053e9ccaa3b4402e7c","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.609Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-18a986d1f34308cc47ae2137: done: 0.765494 sec","job_status":"done","queue_duration_s":0.801247,"scheduling_latency_s":0.801274,"redis_calls":562,"redis_duration_s":0.464873,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012164,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.452709,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.33982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.765494,"completed_at":"2026-09-06T06:49:07.175Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617gitlab # [ 189.977359] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:07.180Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"b866a82a28f5d03bf2b14b5f","created_at":"2026-09-06T06:49:05.620Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f1cab0f4540734e83b4a416baffafbde","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.622Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-b866a82a28f5d03bf2b14b5f: start","job_status":"start","queue_duration_s":1.558893,"scheduling_latency_s":1.558921}1618gitlab # [ 190.010742] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:07.214Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"b866a82a28f5d03bf2b14b5f","created_at":"2026-09-06T06:49:05.620Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f1cab0f4540734e83b4a416baffafbde","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.622Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-b866a82a28f5d03bf2b14b5f: done: 0.033362 sec","job_status":"done","queue_duration_s":1.558893,"scheduling_latency_s":1.558921,"redis_calls":7,"redis_duration_s":0.008101,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002384,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009438,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.033362,"completed_at":"2026-09-06T06:49:07.214Z","load_balancing_strategy":"primary","db_duration_s":0.005371,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1619gitlab # [ 190.086367] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:07.227Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"83413618eff257555e18664a","created_at":"2026-09-06T06:49:05.626Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1fbcc90e20e91ef8b757cac7cd4092e4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.627Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-83413618eff257555e18664a: start","job_status":"start","queue_duration_s":1.600035,"scheduling_latency_s":1.600059}1620gitlab # [ 190.088366] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:07.252Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"83413618eff257555e18664a","created_at":"2026-09-06T06:49:05.626Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1fbcc90e20e91ef8b757cac7cd4092e4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.627Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-83413618eff257555e18664a: done: 0.025012 sec","job_status":"done","queue_duration_s":1.600035,"scheduling_latency_s":1.600059,"redis_calls":7,"redis_duration_s":0.0064670000000000005,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004205,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002262,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025012,"completed_at":"2026-09-06T06:49:07.252Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621gitlab # [ 190.164232] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:07.257Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"170f0c04d90f30ae6d8397c4","created_at":"2026-09-06T06:49:05.639Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe2bb95192d2ee89a45d2e9400c759f5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.641Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-170f0c04d90f30ae6d8397c4: start","job_status":"start","queue_duration_s":1.615635,"scheduling_latency_s":1.615658}1622gitlab # [ 190.354441] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:07.557Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"170f0c04d90f30ae6d8397c4","created_at":"2026-09-06T06:49:05.639Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe2bb95192d2ee89a45d2e9400c759f5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.641Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-170f0c04d90f30ae6d8397c4: done: 0.300655 sec","job_status":"done","queue_duration_s":1.615635,"scheduling_latency_s":1.615658,"redis_calls":9,"redis_duration_s":0.01202,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007895,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004125,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.067,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.067,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.135176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001418057,"exclusive_lock_hold_duration_s":0.267715869,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.300655,"completed_at":"2026-09-06T06:49:07.557Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.157695,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623gitlab # [ 190.419725] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:07.561Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f45f696c119f1a638c875341","created_at":"2026-09-06T06:49:05.672Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d082bb29d51e1898a52c30fcf946ccc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.676Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f45f696c119f1a638c875341: start","job_status":"start","queue_duration_s":1.884907,"scheduling_latency_s":1.884941}1624gitlab # [ 190.441986] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:07.574Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1625gitlab # [ 190.447260] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:07.583Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f45f696c119f1a638c875341","created_at":"2026-09-06T06:49:05.672Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d082bb29d51e1898a52c30fcf946ccc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.676Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f45f696c119f1a638c875341: done: 0.021908 sec","job_status":"done","queue_duration_s":1.884907,"scheduling_latency_s":1.884941,"redis_calls":7,"redis_duration_s":0.001728,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001291,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000437,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008077,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021908,"completed_at":"2026-09-06T06:49:07.583Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1626gitlab # [ 190.509756] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:07.585Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"87aa2c8cbf319812c1ed3d28","created_at":"2026-09-06T06:49:05.718Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5cb3bc6cad07bcdcb23e4f1d231698d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.724Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-87aa2c8cbf319812c1ed3d28: start","job_status":"start","queue_duration_s":1.860645,"scheduling_latency_s":1.860667}1627gitlab # [ 190.510763] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:07.608Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"87aa2c8cbf319812c1ed3d28","created_at":"2026-09-06T06:49:05.718Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-d639dc5192894d01","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5cb3bc6cad07bcdcb23e4f1d231698d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.724Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-87aa2c8cbf319812c1ed3d28: done: 0.023583 sec","job_status":"done","queue_duration_s":1.860645,"scheduling_latency_s":1.860667,"redis_calls":7,"redis_duration_s":0.003407,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002953,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000454,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023583,"completed_at":"2026-09-06T06:49:07.608Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001238,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1628gitlab # [ 190.580798] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:07.616Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f47d7f106bedce2cfad66bd3","created_at":"2026-09-06T06:49:05.811Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-5422853d6a294f6a","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"387cd475c453bb77d3540f564eba11ac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.817Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f47d7f106bedce2cfad66bd3: start","job_status":"start","queue_duration_s":1.798834,"scheduling_latency_s":1.798856}1629gitlab # [ 190.582418] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:07.674Z","message":"No existing merge request to be cleaned up."}1630gitlab # [ 190.584215] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:07.700Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f47d7f106bedce2cfad66bd3","created_at":"2026-09-06T06:49:05.811Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-5422853d6a294f6a","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"387cd475c453bb77d3540f564eba11ac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.817Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f47d7f106bedce2cfad66bd3: done: 0.084528 sec","job_status":"done","queue_duration_s":1.798834,"scheduling_latency_s":1.798856,"redis_calls":10,"redis_duration_s":0.014563,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004424,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.010139,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.084528,"completed_at":"2026-09-06T06:49:07.700Z","load_balancing_strategy":"primary","db_duration_s":0.074017,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1631gitlab # [ 190.606915] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:07.707Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e59876aceddac97c0f51444b","created_at":"2026-09-06T06:49:05.811Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-5422853d6a294f6a","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"387cd475c453bb77d3540f564eba11ac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.817Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e59876aceddac97c0f51444b: start","job_status":"start","queue_duration_s":1.890056,"scheduling_latency_s":1.890084}1632gitlab # [ 190.720626] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:07.924Z","message":"No existing merge request to be cleaned up."}1633gitlab # [ 190.747568] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:07.950Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e59876aceddac97c0f51444b","created_at":"2026-09-06T06:49:05.811Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-5422853d6a294f6a","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"387cd475c453bb77d3540f564eba11ac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.817Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e59876aceddac97c0f51444b: done: 0.243233 sec","job_status":"done","queue_duration_s":1.890056,"scheduling_latency_s":1.890084,"redis_calls":10,"redis_duration_s":0.016473,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004893,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.01158,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.243233,"completed_at":"2026-09-06T06:49:07.950Z","load_balancing_strategy":"primary","db_duration_s":0.007149,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1634gitlab # [ 190.783730] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:07.958Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3944c9a5ad6e54b11a977b9f","created_at":"2026-09-06T06:49:05.811Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-5422853d6a294f6a","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"387cd475c453bb77d3540f564eba11ac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.817Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3944c9a5ad6e54b11a977b9f: start","job_status":"start","queue_duration_s":2.140401,"scheduling_latency_s":2.14046}1635gitlab # [ 190.793979] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:07.997Z","message":"No existing merge request to be cleaned up."}1636gitlab # [ 190.810595] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.014Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3944c9a5ad6e54b11a977b9f","created_at":"2026-09-06T06:49:05.811Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-5422853d6a294f6a","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"387cd475c453bb77d3540f564eba11ac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.817Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3944c9a5ad6e54b11a977b9f: done: 0.056135 sec","job_status":"done","queue_duration_s":2.140401,"scheduling_latency_s":2.14046,"redis_calls":10,"redis_duration_s":0.012607,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003832,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.008775,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.056135,"completed_at":"2026-09-06T06:49:08.013Z","load_balancing_strategy":"primary","db_duration_s":0.005888,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1637gitlab # [ 190.818110] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.016Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e0ae0032ae0770452eebda12","created_at":"2026-09-06T06:49:05.811Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-5422853d6a294f6a","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"387cd475c453bb77d3540f564eba11ac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.817Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e0ae0032ae0770452eebda12: start","job_status":"start","queue_duration_s":2.198711,"scheduling_latency_s":2.19874}1638gitlab # [ 190.888754] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.036Z","message":"No existing merge request to be cleaned up."}1639gitlab # [ 190.890050] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.052Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e0ae0032ae0770452eebda12","created_at":"2026-09-06T06:49:05.811Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-5422853d6a294f6a","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"387cd475c453bb77d3540f564eba11ac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:05.817Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e0ae0032ae0770452eebda12: done: 0.035988 sec","job_status":"done","queue_duration_s":2.198711,"scheduling_latency_s":2.19874,"redis_calls":10,"redis_duration_s":0.006399,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001993,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004406,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035988,"completed_at":"2026-09-06T06:49:08.052Z","load_balancing_strategy":"primary","db_duration_s":0.00666,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1640gitlab # [ 190.957917] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8349d6ddaa488d923ff8abb","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8349d6ddaa488d923ff8abb: start","job_status":"start","queue_duration_s":1.977073,"scheduling_latency_s":1.977096}1641gitlab # [ 190.959264] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8349d6ddaa488d923ff8abb","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8349d6ddaa488d923ff8abb: done: 0.031821 sec","job_status":"done","queue_duration_s":1.977073,"scheduling_latency_s":1.977096,"redis_calls":13,"redis_duration_s":0.012147999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002995,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009153,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010971,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031821,"completed_at":"2026-09-06T06:49:08.087Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1642gitlab # [ 191.028336] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b491a5a1bf022cd324808cfe","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b491a5a1bf022cd324808cfe: start","job_status":"start","queue_duration_s":2.013349,"scheduling_latency_s":2.013383}1643gitlab # [ 191.029983] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b491a5a1bf022cd324808cfe","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b491a5a1bf022cd324808cfe: done: 0.033039 sec","job_status":"done","queue_duration_s":2.013349,"scheduling_latency_s":2.013383,"redis_calls":13,"redis_duration_s":0.011589,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00375,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007839,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033039,"completed_at":"2026-09-06T06:49:08.125Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1644gitlab # [ 191.096448] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd22e44627df0daaadb44a83","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd22e44627df0daaadb44a83: start","job_status":"start","queue_duration_s":2.050774,"scheduling_latency_s":2.050802}1645gitlab # [ 191.098229] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd22e44627df0daaadb44a83","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd22e44627df0daaadb44a83: done: 0.031144 sec","job_status":"done","queue_duration_s":2.050774,"scheduling_latency_s":2.050802,"redis_calls":13,"redis_duration_s":0.011542,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003766,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007776,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011062,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031144,"completed_at":"2026-09-06T06:49:08.160Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1646gitlab # [ 191.172321] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.167Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c4bcc97b301edd9e2d43172","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c4bcc97b301edd9e2d43172: start","job_status":"start","queue_duration_s":2.088204,"scheduling_latency_s":2.088237}1647gitlab # [ 191.173845] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c4bcc97b301edd9e2d43172","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c4bcc97b301edd9e2d43172: done: 0.034204 sec","job_status":"done","queue_duration_s":2.088204,"scheduling_latency_s":2.088237,"redis_calls":13,"redis_duration_s":0.011501,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003765,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007736,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034204,"completed_at":"2026-09-06T06:49:08.201Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1648gitlab # [ 191.244307] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.205Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3a9ab9b6da5a61e8e8920d0","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3a9ab9b6da5a61e8e8920d0: start","job_status":"start","queue_duration_s":2.12666,"scheduling_latency_s":2.126682}1649gitlab # [ 191.245354] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3a9ab9b6da5a61e8e8920d0","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3a9ab9b6da5a61e8e8920d0: done: 0.037783 sec","job_status":"done","queue_duration_s":2.12666,"scheduling_latency_s":2.126682,"redis_calls":13,"redis_duration_s":0.015564,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.007122,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008442,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037783,"completed_at":"2026-09-06T06:49:08.243Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1650gitlab # [ 191.316211] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f0548dd655a0e46230d4160","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f0548dd655a0e46230d4160: start","job_status":"start","queue_duration_s":2.168021,"scheduling_latency_s":2.168079}1651gitlab # [ 191.317807] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f0548dd655a0e46230d4160","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f0548dd655a0e46230d4160: done: 0.032791 sec","job_status":"done","queue_duration_s":2.168021,"scheduling_latency_s":2.168079,"redis_calls":13,"redis_duration_s":0.01175,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002295,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009455,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032791,"completed_at":"2026-09-06T06:49:08.279Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1652gitlab # [ 191.397076] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64ef8689a348ccdff44b84a8","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64ef8689a348ccdff44b84a8: start","job_status":"start","queue_duration_s":2.204391,"scheduling_latency_s":2.204413}1653gitlab # [ 191.398411] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.320Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64ef8689a348ccdff44b84a8","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64ef8689a348ccdff44b84a8: done: 0.037198 sec","job_status":"done","queue_duration_s":2.204391,"scheduling_latency_s":2.204413,"redis_calls":13,"redis_duration_s":0.015571999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.012475,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037198,"completed_at":"2026-09-06T06:49:08.320Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1654gitlab # [ 191.448107] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f2625aa8872a6448ad0d54b","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f2625aa8872a6448ad0d54b: start","job_status":"start","queue_duration_s":2.245976,"scheduling_latency_s":2.246004}1655gitlab # [ 191.528808] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f2625aa8872a6448ad0d54b","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f2625aa8872a6448ad0d54b: done: 0.033579 sec","job_status":"done","queue_duration_s":2.245976,"scheduling_latency_s":2.246004,"redis_calls":13,"redis_duration_s":0.009975000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003659,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006316,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033579,"completed_at":"2026-09-06T06:49:08.358Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1656gitlab # [ 191.530376] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.361Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6d71d9f3890d156abf6c046","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6d71d9f3890d156abf6c046: start","job_status":"start","queue_duration_s":2.283101,"scheduling_latency_s":2.283123}1657gitlab # [ 191.609520] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.397Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6d71d9f3890d156abf6c046","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6d71d9f3890d156abf6c046: done: 0.035477 sec","job_status":"done","queue_duration_s":2.283101,"scheduling_latency_s":2.283123,"redis_calls":13,"redis_duration_s":0.013163000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035477,"completed_at":"2026-09-06T06:49:08.397Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1658gitlab # [ 191.611389] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52054bdd1a88378160c6ddc8","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52054bdd1a88378160c6ddc8: start","job_status":"start","queue_duration_s":2.322881,"scheduling_latency_s":2.322908}1659gitlab # [ 191.680392] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52054bdd1a88378160c6ddc8","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52054bdd1a88378160c6ddc8: done: 0.033198 sec","job_status":"done","queue_duration_s":2.322881,"scheduling_latency_s":2.322908,"redis_calls":13,"redis_duration_s":0.010624999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00433,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006295,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033198,"completed_at":"2026-09-06T06:49:08.434Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1660gitlab # [ 191.684101] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b16d90f15f734fc05c2dffc","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b16d90f15f734fc05c2dffc: start","job_status":"start","queue_duration_s":2.360334,"scheduling_latency_s":2.360357}1661gitlab # [ 191.761501] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b16d90f15f734fc05c2dffc","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b16d90f15f734fc05c2dffc: done: 0.044732 sec","job_status":"done","queue_duration_s":2.360334,"scheduling_latency_s":2.360357,"redis_calls":13,"redis_duration_s":0.023322,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002127,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.021195,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011087,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.044732,"completed_at":"2026-09-06T06:49:08.483Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1662gitlab # [ 191.762976] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.487Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa33c87cd8cac9b403eba9a5","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa33c87cd8cac9b403eba9a5: start","job_status":"start","queue_duration_s":2.408499,"scheduling_latency_s":2.408522}1663gitlab # [ 191.838454] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.518Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa33c87cd8cac9b403eba9a5","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa33c87cd8cac9b403eba9a5: done: 0.031548 sec","job_status":"done","queue_duration_s":2.408499,"scheduling_latency_s":2.408522,"redis_calls":13,"redis_duration_s":0.011215,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002905,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00831,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031548,"completed_at":"2026-09-06T06:49:08.518Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1664gitlab # [ 191.905812] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e474f5af570c52db2ac67220","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e474f5af570c52db2ac67220: start","job_status":"start","queue_duration_s":2.445926,"scheduling_latency_s":2.445949}1665gitlab # [ 191.907337] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e474f5af570c52db2ac67220","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e474f5af570c52db2ac67220: done: 0.033648 sec","job_status":"done","queue_duration_s":2.445926,"scheduling_latency_s":2.445949,"redis_calls":13,"redis_duration_s":0.011666,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003861,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007805,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033648,"completed_at":"2026-09-06T06:49:08.558Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1666gitlab # [ 191.978485] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.562Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f5714dbd742acecdb85fc72","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f5714dbd742acecdb85fc72: start","job_status":"start","queue_duration_s":2.48324,"scheduling_latency_s":2.483275}1667gitlab # [ 191.979838] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f5714dbd742acecdb85fc72","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f5714dbd742acecdb85fc72: done: 0.033255 sec","job_status":"done","queue_duration_s":2.48324,"scheduling_latency_s":2.483275,"redis_calls":13,"redis_duration_s":0.011041,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003602,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007439,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033255,"completed_at":"2026-09-06T06:49:08.595Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1668gitlab # [ 192.048511] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.599Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1d171d1648a11ad3af34279","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1d171d1648a11ad3af34279: start","job_status":"start","queue_duration_s":2.520609,"scheduling_latency_s":2.520632}1669gitlab # [ 192.049737] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1d171d1648a11ad3af34279","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1d171d1648a11ad3af34279: done: 0.077024 sec","job_status":"done","queue_duration_s":2.520609,"scheduling_latency_s":2.520632,"redis_calls":13,"redis_duration_s":0.052952,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.042263,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010689,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.077024,"completed_at":"2026-09-06T06:49:08.676Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1670gitlab # [ 192.117816] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ef2ee3e6bf8888a55412fc5","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ef2ee3e6bf8888a55412fc5: start","job_status":"start","queue_duration_s":2.601317,"scheduling_latency_s":2.601345}1671gitlab # [ 192.119182] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ef2ee3e6bf8888a55412fc5","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ef2ee3e6bf8888a55412fc5: done: 0.033215 sec","job_status":"done","queue_duration_s":2.601317,"scheduling_latency_s":2.601345,"redis_calls":13,"redis_duration_s":0.011027,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00745,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033215,"completed_at":"2026-09-06T06:49:08.713Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1672gitlab # [ 192.190908] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.717Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3655bdafc8945618be50882e","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3655bdafc8945618be50882e: start","job_status":"start","queue_duration_s":2.638702,"scheduling_latency_s":2.638724}1673gitlab # [ 192.192389] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3655bdafc8945618be50882e","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3655bdafc8945618be50882e: done: 0.035142 sec","job_status":"done","queue_duration_s":2.638702,"scheduling_latency_s":2.638724,"redis_calls":13,"redis_duration_s":0.012192,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00417,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035142,"completed_at":"2026-09-06T06:49:08.752Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1674gitlab # [ 192.262953] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.757Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60e90af326a9ae1a5bedd3a0","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60e90af326a9ae1a5bedd3a0: start","job_status":"start","queue_duration_s":2.678344,"scheduling_latency_s":2.678374}1675gitlab # [ 192.264055] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60e90af326a9ae1a5bedd3a0","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60e90af326a9ae1a5bedd3a0: done: 0.035939 sec","job_status":"done","queue_duration_s":2.678344,"scheduling_latency_s":2.678374,"redis_calls":13,"redis_duration_s":0.010124000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003685,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006439,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035939,"completed_at":"2026-09-06T06:49:08.793Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1676gitlab # [ 192.361207] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1bd29a89d3d8204846638557","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1bd29a89d3d8204846638557: start","job_status":"start","queue_duration_s":2.717824,"scheduling_latency_s":2.717846}1677gitlab # [ 192.362468] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.832Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1bd29a89d3d8204846638557","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1bd29a89d3d8204846638557: done: 0.036314 sec","job_status":"done","queue_duration_s":2.717824,"scheduling_latency_s":2.717846,"redis_calls":13,"redis_duration_s":0.01412,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004309,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009811,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036314,"completed_at":"2026-09-06T06:49:08.832Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1678gitlab # [ 192.430234] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cc863eb1d3598e7ae622d75","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cc863eb1d3598e7ae622d75: start","job_status":"start","queue_duration_s":2.758517,"scheduling_latency_s":2.758544}1679gitlab # [ 192.431332] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.870Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cc863eb1d3598e7ae622d75","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cc863eb1d3598e7ae622d75: done: 0.032998 sec","job_status":"done","queue_duration_s":2.758517,"scheduling_latency_s":2.758544,"redis_calls":13,"redis_duration_s":0.012113,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003034,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009079,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032998,"completed_at":"2026-09-06T06:49:08.870Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1680gitlab # [ 192.505409] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.874Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc43a014922b7d9ef5428e9e","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc43a014922b7d9ef5428e9e: start","job_status":"start","queue_duration_s":2.795827,"scheduling_latency_s":2.795849}1681gitlab # [ 192.507053] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.913Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc43a014922b7d9ef5428e9e","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc43a014922b7d9ef5428e9e: done: 0.038827 sec","job_status":"done","queue_duration_s":2.795827,"scheduling_latency_s":2.795849,"redis_calls":13,"redis_duration_s":0.015591,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005006,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010585,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038827,"completed_at":"2026-09-06T06:49:08.913Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1682gitlab # [ 192.579392] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1357f989f4bc240325b1a87e","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1357f989f4bc240325b1a87e: start","job_status":"start","queue_duration_s":2.837634,"scheduling_latency_s":2.837658}1683gitlab # [ 192.580975] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1357f989f4bc240325b1a87e","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1357f989f4bc240325b1a87e: done: 0.022936 sec","job_status":"done","queue_duration_s":2.837634,"scheduling_latency_s":2.837658,"redis_calls":13,"redis_duration_s":0.00638,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00186,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00452,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022936,"completed_at":"2026-09-06T06:49:08.939Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1684gitlab # [ 192.655392] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"825887ef59406cf004fe7a1f","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-825887ef59406cf004fe7a1f: start","job_status":"start","queue_duration_s":2.861843,"scheduling_latency_s":2.861864}1685gitlab # [ 192.656462] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"825887ef59406cf004fe7a1f","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-825887ef59406cf004fe7a1f: done: 0.015072 sec","job_status":"done","queue_duration_s":2.861843,"scheduling_latency_s":2.861864,"redis_calls":13,"redis_duration_s":0.002774,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00082,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015072,"completed_at":"2026-09-06T06:49:08.955Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1686gitlab # [ 192.724798] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.957Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7ab1315db6908d65122ae6e","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7ab1315db6908d65122ae6e: start","job_status":"start","queue_duration_s":2.878208,"scheduling_latency_s":2.878228}1687gitlab # [ 192.734965] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.971Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7ab1315db6908d65122ae6e","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7ab1315db6908d65122ae6e: done: 0.014967 sec","job_status":"done","queue_duration_s":2.878208,"scheduling_latency_s":2.878228,"redis_calls":13,"redis_duration_s":0.002839,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014967,"completed_at":"2026-09-06T06:49:08.971Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1688gitlab # [ 192.816313] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23508d5b04cae87e6a1157ec","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23508d5b04cae87e6a1157ec: start","job_status":"start","queue_duration_s":2.894478,"scheduling_latency_s":2.894499}1689gitlab # [ 192.817487] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23508d5b04cae87e6a1157ec","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23508d5b04cae87e6a1157ec: done: 0.014979 sec","job_status":"done","queue_duration_s":2.894478,"scheduling_latency_s":2.894499,"redis_calls":13,"redis_duration_s":0.0028120000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000848,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001964,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014979,"completed_at":"2026-09-06T06:49:08.988Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1690gitlab # [ 192.919056] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:08.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"121aef3addda42cdb20b68c2","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-121aef3addda42cdb20b68c2: start","job_status":"start","queue_duration_s":2.91074,"scheduling_latency_s":2.91076}1691gitlab # [ 192.920191] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"121aef3addda42cdb20b68c2","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-121aef3addda42cdb20b68c2: done: 0.01492 sec","job_status":"done","queue_duration_s":2.91074,"scheduling_latency_s":2.91076,"redis_calls":13,"redis_duration_s":0.002752,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001868,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01492,"completed_at":"2026-09-06T06:49:09.004Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1692gitlab # [ 192.994197] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74b8fdabe4b928238bffae82","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74b8fdabe4b928238bffae82: start","job_status":"start","queue_duration_s":2.926973,"scheduling_latency_s":2.926994}1693gitlab # [ 192.996142] postgres[2450]: [2450] ERROR: relation "table_without_models" does not exist1694gitlab # [ 192.997166] postgres[2450]: [2450] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1695gitlab # [ 192.998002] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.020Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74b8fdabe4b928238bffae82","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74b8fdabe4b928238bffae82: done: 0.01479 sec","job_status":"done","queue_duration_s":2.926973,"scheduling_latency_s":2.926994,"redis_calls":13,"redis_duration_s":0.002721,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000857,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001864,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01479,"completed_at":"2026-09-06T06:49:09.020Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1696gitlab # [ 193.086323] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.022Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1a0811a0cc46fb53f5f4e5d","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1a0811a0cc46fb53f5f4e5d: start","job_status":"start","queue_duration_s":2.943335,"scheduling_latency_s":2.943355}1697gitlab # [ 193.087868] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.036Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1a0811a0cc46fb53f5f4e5d","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1a0811a0cc46fb53f5f4e5d: done: 0.014815 sec","job_status":"done","queue_duration_s":2.943335,"scheduling_latency_s":2.943355,"redis_calls":13,"redis_duration_s":0.002771,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014815,"completed_at":"2026-09-06T06:49:09.036Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1698gitlab # [ 193.172168] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.038Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56aec7215dad2063ce309318","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56aec7215dad2063ce309318: start","job_status":"start","queue_duration_s":2.95959,"scheduling_latency_s":2.95961}1699gitlab # [ 193.173755] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56aec7215dad2063ce309318","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56aec7215dad2063ce309318: done: 0.014891 sec","job_status":"done","queue_duration_s":2.95959,"scheduling_latency_s":2.95961,"redis_calls":13,"redis_duration_s":0.002705,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000862,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001843,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010177,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014891,"completed_at":"2026-09-06T06:49:09.053Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1700gitlab # [ 193.202288] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.054Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac55312e14b0ccb5cdd30f2d","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac55312e14b0ccb5cdd30f2d: start","job_status":"start","queue_duration_s":2.975804,"scheduling_latency_s":2.975825}1701gitlab # [ 193.275272] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac55312e14b0ccb5cdd30f2d","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac55312e14b0ccb5cdd30f2d: done: 0.01506 sec","job_status":"done","queue_duration_s":2.975804,"scheduling_latency_s":2.975825,"redis_calls":13,"redis_duration_s":0.002784,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000827,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01506,"completed_at":"2026-09-06T06:49:09.069Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1702gitlab # [ 193.283432] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2725bce0bbc864ae415e3625","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2725bce0bbc864ae415e3625: start","job_status":"start","queue_duration_s":2.992268,"scheduling_latency_s":2.992289}1703gitlab # [ 193.303981] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.085Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2725bce0bbc864ae415e3625","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2725bce0bbc864ae415e3625: done: 0.014784 sec","job_status":"done","queue_duration_s":2.992268,"scheduling_latency_s":2.992289,"redis_calls":13,"redis_duration_s":0.002694,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000852,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001842,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010135,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014784,"completed_at":"2026-09-06T06:49:09.085Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1704gitlab # [ 193.370879] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"285cfeb9e7a66683fcab500a","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-285cfeb9e7a66683fcab500a: start","job_status":"start","queue_duration_s":3.008353,"scheduling_latency_s":3.008374}1705gitlab # [ 193.443309] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.102Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"285cfeb9e7a66683fcab500a","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-285cfeb9e7a66683fcab500a: done: 0.015173 sec","job_status":"done","queue_duration_s":3.008353,"scheduling_latency_s":3.008374,"redis_calls":13,"redis_duration_s":0.002742,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000847,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010342,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015173,"completed_at":"2026-09-06T06:49:09.102Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1706gitlab # [ 193.444979] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b98a613896d0ce7b2b6ad0f2","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b98a613896d0ce7b2b6ad0f2: start","job_status":"start","queue_duration_s":3.024789,"scheduling_latency_s":3.024809}1707gitlab # [ 193.515199] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.118Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b98a613896d0ce7b2b6ad0f2","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b98a613896d0ce7b2b6ad0f2: done: 0.015231 sec","job_status":"done","queue_duration_s":3.024789,"scheduling_latency_s":3.024809,"redis_calls":13,"redis_duration_s":0.002739,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000859,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00188,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010348,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015231,"completed_at":"2026-09-06T06:49:09.118Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1708gitlab # [ 193.519958] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.120Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"767efddf092a063b1474cad4","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-767efddf092a063b1474cad4: start","job_status":"start","queue_duration_s":3.041332,"scheduling_latency_s":3.041352}1709gitlab # [ 193.539205] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.135Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"767efddf092a063b1474cad4","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-767efddf092a063b1474cad4: done: 0.015459 sec","job_status":"done","queue_duration_s":3.041332,"scheduling_latency_s":3.041352,"redis_calls":13,"redis_duration_s":0.002924,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00199,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015459,"completed_at":"2026-09-06T06:49:09.135Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1710gitlab # [ 193.629272] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"becbb948dfd07db4fc143d8e","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-becbb948dfd07db4fc143d8e: start","job_status":"start","queue_duration_s":3.05809,"scheduling_latency_s":3.058111}1711gitlab # [ 193.630402] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.151Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"becbb948dfd07db4fc143d8e","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-becbb948dfd07db4fc143d8e: done: 0.014966 sec","job_status":"done","queue_duration_s":3.05809,"scheduling_latency_s":3.058111,"redis_calls":13,"redis_duration_s":0.002828,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000862,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014966,"completed_at":"2026-09-06T06:49:09.151Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1712gitlab # [ 193.698075] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"def07980187c111259e94b4c","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-def07980187c111259e94b4c: start","job_status":"start","queue_duration_s":3.07435,"scheduling_latency_s":3.074371}1713gitlab # [ 193.699497] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"def07980187c111259e94b4c","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-def07980187c111259e94b4c: done: 0.014854 sec","job_status":"done","queue_duration_s":3.07435,"scheduling_latency_s":3.074371,"redis_calls":13,"redis_duration_s":0.0026880000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00183,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014854,"completed_at":"2026-09-06T06:49:09.167Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1714gitlab # [ 193.787053] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.169Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c1b77ce5044362a6aefb7e5","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c1b77ce5044362a6aefb7e5: start","job_status":"start","queue_duration_s":3.090507,"scheduling_latency_s":3.090528}1715gitlab # [ 193.788390] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.184Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c1b77ce5044362a6aefb7e5","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c1b77ce5044362a6aefb7e5: done: 0.014788 sec","job_status":"done","queue_duration_s":3.090507,"scheduling_latency_s":3.090528,"redis_calls":13,"redis_duration_s":0.002764,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00083,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014788,"completed_at":"2026-09-06T06:49:09.184Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1716gitlab # [ 193.856136] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b55967f7ce894206ad47821","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b55967f7ce894206ad47821: start","job_status":"start","queue_duration_s":3.106606,"scheduling_latency_s":3.106626}1717gitlab # [ 193.857244] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b55967f7ce894206ad47821","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b55967f7ce894206ad47821: done: 0.0152 sec","job_status":"done","queue_duration_s":3.106606,"scheduling_latency_s":3.106626,"redis_calls":13,"redis_duration_s":0.002725,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000895,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00183,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0152,"completed_at":"2026-09-06T06:49:09.200Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1718gitlab # [ 193.924353] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d3eba77775d9af257859ac2","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d3eba77775d9af257859ac2: start","job_status":"start","queue_duration_s":3.150722,"scheduling_latency_s":3.150747}1719gitlab # [ 193.931927] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d3eba77775d9af257859ac2","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d3eba77775d9af257859ac2: done: 0.016037 sec","job_status":"done","queue_duration_s":3.150722,"scheduling_latency_s":3.150747,"redis_calls":13,"redis_duration_s":0.002823,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016037,"completed_at":"2026-09-06T06:49:09.245Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1720gitlab # [ 193.999248] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da476d5095825c1fac4e862b","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da476d5095825c1fac4e862b: start","job_status":"start","queue_duration_s":3.168094,"scheduling_latency_s":3.168114}1721gitlab # [ 194.073275] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da476d5095825c1fac4e862b","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da476d5095825c1fac4e862b: done: 0.015226 sec","job_status":"done","queue_duration_s":3.168094,"scheduling_latency_s":3.168114,"redis_calls":13,"redis_duration_s":0.0028,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00082,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00198,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015226,"completed_at":"2026-09-06T06:49:09.262Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1722gitlab # [ 194.075236] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03281ac67be98255882f441f","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03281ac67be98255882f441f: start","job_status":"start","queue_duration_s":3.184559,"scheduling_latency_s":3.18458}1723gitlab # [ 194.146868] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.278Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03281ac67be98255882f441f","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03281ac67be98255882f441f: done: 0.015076 sec","job_status":"done","queue_duration_s":3.184559,"scheduling_latency_s":3.18458,"redis_calls":13,"redis_duration_s":0.002695,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001877,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015076,"completed_at":"2026-09-06T06:49:09.278Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1724gitlab # [ 194.148811] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c91d7896743e4109685b31ac","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c91d7896743e4109685b31ac: start","job_status":"start","queue_duration_s":3.200903,"scheduling_latency_s":3.200924}1725gitlab # [ 194.218904] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c91d7896743e4109685b31ac","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c91d7896743e4109685b31ac: done: 0.017829 sec","job_status":"done","queue_duration_s":3.200903,"scheduling_latency_s":3.200924,"redis_calls":13,"redis_duration_s":0.002948,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001036,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017829,"completed_at":"2026-09-06T06:49:09.297Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1726gitlab # [ 194.225376] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8e1253351b03ae7f61c1b62","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8e1253351b03ae7f61c1b62: start","job_status":"start","queue_duration_s":3.220274,"scheduling_latency_s":3.220302}1727gitlab # [ 194.294526] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8e1253351b03ae7f61c1b62","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8e1253351b03ae7f61c1b62: done: 0.016031 sec","job_status":"done","queue_duration_s":3.220274,"scheduling_latency_s":3.220302,"redis_calls":13,"redis_duration_s":0.00281,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00187,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016031,"completed_at":"2026-09-06T06:49:09.315Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1728gitlab # [ 194.366838] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f939a923ea32abefbc27a4c","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f939a923ea32abefbc27a4c: start","job_status":"start","queue_duration_s":3.237568,"scheduling_latency_s":3.237589}1729gitlab # [ 194.368255] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f939a923ea32abefbc27a4c","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f939a923ea32abefbc27a4c: done: 0.01539 sec","job_status":"done","queue_duration_s":3.237568,"scheduling_latency_s":3.237589,"redis_calls":13,"redis_duration_s":0.0029509999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001068,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01539,"completed_at":"2026-09-06T06:49:09.331Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1730gitlab # [ 194.437468] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd7044be623b5b403d2c97a8","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd7044be623b5b403d2c97a8: start","job_status":"start","queue_duration_s":3.254274,"scheduling_latency_s":3.254295}1731gitlab # [ 194.438793] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd7044be623b5b403d2c97a8","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd7044be623b5b403d2c97a8: done: 0.015129 sec","job_status":"done","queue_duration_s":3.254274,"scheduling_latency_s":3.254295,"redis_calls":13,"redis_duration_s":0.002767,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000841,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015129,"completed_at":"2026-09-06T06:49:09.348Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1732gitlab # [ 194.506481] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0452ab386f296d6d03c018c7","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0452ab386f296d6d03c018c7: start","job_status":"start","queue_duration_s":3.271152,"scheduling_latency_s":3.271173}1733gitlab # [ 194.508083] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0452ab386f296d6d03c018c7","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0452ab386f296d6d03c018c7: done: 0.01528 sec","job_status":"done","queue_duration_s":3.271152,"scheduling_latency_s":3.271173,"redis_calls":13,"redis_duration_s":0.002689,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00082,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001869,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01528,"completed_at":"2026-09-06T06:49:09.365Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1734gitlab # [ 194.576214] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c313d960f359fc91f6cbf331","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c313d960f359fc91f6cbf331: start","job_status":"start","queue_duration_s":3.287692,"scheduling_latency_s":3.287712}1735gitlab # [ 194.577309] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.382Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c313d960f359fc91f6cbf331","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c313d960f359fc91f6cbf331: done: 0.015801 sec","job_status":"done","queue_duration_s":3.287692,"scheduling_latency_s":3.287712,"redis_calls":13,"redis_duration_s":0.003753,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000853,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015801,"completed_at":"2026-09-06T06:49:09.382Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1736gitlab # [ 194.618067] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45bd743a1656c6c6938b1591","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45bd743a1656c6c6938b1591: start","job_status":"start","queue_duration_s":3.304759,"scheduling_latency_s":3.304779}1737gitlab # [ 194.696559] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.398Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45bd743a1656c6c6938b1591","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45bd743a1656c6c6938b1591: done: 0.015088 sec","job_status":"done","queue_duration_s":3.304759,"scheduling_latency_s":3.304779,"redis_calls":13,"redis_duration_s":0.002756,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001889,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010389,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015088,"completed_at":"2026-09-06T06:49:09.398Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1738gitlab # [ 194.698793] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.399Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38d9697baa8c12cc48949bc2","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38d9697baa8c12cc48949bc2: start","job_status":"start","queue_duration_s":3.321144,"scheduling_latency_s":3.321165}1739gitlab # [ 194.768574] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38d9697baa8c12cc48949bc2","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38d9697baa8c12cc48949bc2: done: 0.015064 sec","job_status":"done","queue_duration_s":3.321144,"scheduling_latency_s":3.321165,"redis_calls":13,"redis_duration_s":0.002761,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000848,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015064,"completed_at":"2026-09-06T06:49:09.414Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1740gitlab # [ 194.775084] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da570b75d4b4c69bedccd1c2","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da570b75d4b4c69bedccd1c2: start","job_status":"start","queue_duration_s":3.337975,"scheduling_latency_s":3.337996}1741gitlab # [ 194.852541] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:09.431Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da570b75d4b4c69bedccd1c2","created_at":"2026-09-06T06:49:05.856Z","trace_propagation_headers":{"sentry-trace":"57043ddf102845f7b3cdaba1664ee5a2-b533024d91434555","baggage":"sentry-trace_id=57043ddf102845f7b3cdaba1664ee5a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bca5acf567fca564da012226dee0e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:06.078Z","job_size_bytes":2,"pid":1681,"sidekiq_tid":"mait","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da570b75d4b4c69bedccd1c2: done: 0.015216 sec","job_status":"done","queue_duration_s":3.337975,"scheduling_latency_s":3.337996,"redis_calls":13,"redis_duration_s":0.002672,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001807,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015216,"completed_at":"2026-09-06T06:49:09.431Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1742gitlab # [ 196.501413] runuser[2278]: pam_unix(runuser:session): session closed for user gitlab1743gitlab # [ 196.505658] setup-gitlab-start[2268]: + systemctl restart gitlab-sidekiq.service1744gitlab # [ 196.534409] systemd[1]: Stopping gitlab-sidekiq.service...1745gitlab # [ 196.544653] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:13.747Z","message":"Shutting down"}1746gitlab # [ 196.547918] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:13.747Z","message":"Scheduler exiting..."}1747gitlab # [ 196.555525] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:13.748Z","message":"Terminating quiet threads for default capsule"}1748gitlab # [ 196.558152] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:13.759Z","message":"Scheduler exiting..."}1749gitlab # [ 197.068830] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:14.272Z","message":"Pausing to allow jobs to finish..."}1750gitlab # [ 197.573837] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:14.776Z","message":"Bye!"}1751gitlab # [ 197.602918] sidekiq-cluster[1681]: {"severity":"INFO","time":"2026-09-06T06:49:14.806Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1681,"worker_id":"sidekiq_0","memwd_rss_bytes":979181568,"retry":0}1752gitlab # [ 199.281864] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1753gitlab # [ 199.286758] systemd[1]: Stopped gitlab-sidekiq.service.1754gitlab # [ 199.290209] systemd[1]: gitlab-sidekiq.service: Consumed 1min 3.321s CPU time over 1min 58.352s wall clock time, 967.5M memory peak, 4.4M read from disk.1755gitlab # [ 199.302922] systemd[1]: Started gitlab-sidekiq.service.1756gitlab # [ 199.308407] setup-gitlab-start[2268]: + mkdir -p /var/lib/secrets1757gitlab # [ 199.316586] setup-gitlab-start[2268]: + echo nixbot-test-token-of-20-chars1758gitlab # [ 199.320842] setup-gitlab-start[2268]: + chmod 644 /var/lib/secrets/gitlab-token1759gitlab # [ 199.324591] setup-gitlab-start[2268]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1760gitlab # [ 200.193114] gitaly[922]: time="2026-09-06T06:49:17.395Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQMZ092Z6E46MAHSXVVKGT error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:49:27.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:17.395" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1761gitlab # [ 200.239329] gitaly[922]: time="2026-09-06T06:49:17.395Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQMZ092Z6E46MAHSXVVKGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:49:27.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:17.395" grpc.time_ms=0.459 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1762gitlab # [ 200.286168] gitaly[922]: time="2026-09-06T06:49:17.489Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQMZ092Z6E46MAHSXVVKGT error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:49:27.099" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:17.489" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1763gitlab # [ 200.303490] gitaly[922]: time="2026-09-06T06:49:17.489Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQMZ092Z6E46MAHSXVVKGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:49:27.099" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:17.489" grpc.time_ms=0.227 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1764gitlab # [ 200.330112] gitaly[922]: time="2026-09-06T06:49:17.533Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQMZ092Z6E46MAHSXVVKGT diskcache=ceb2c9f4-483f-4e99-8a36-b434b9f45725 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-06T06:49:27.103" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:17.494" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1765gitlab # [ 200.346911] gitaly[922]: time="2026-09-06T06:49:17.534Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1583 command.oublock=32 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQMZ092Z6E46MAHSXVVKGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-06T06:49:27.103" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:17.494" grpc.time_ms=39.681 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766gitlab # [ 200.347987] gitaly[922]: time="2026-09-06T06:49:17.543Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQMZ092Z6E46MAHSXVVKGT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:49:27.152" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:17.543" pid=922 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1767gitlab # [ 200.348794] gitaly[922]: time="2026-09-06T06:49:17.544Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQMZ092Z6E46MAHSXVVKGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:49:27.152" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:17.543" grpc.time_ms=0.464 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1768gitlab # [ 200.353178] gitaly[922]: time="2026-09-06T06:49:17.556Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQMZ092Z6E46MAHSXVVKGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T06:49:27.157" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:17.547" grpc.time_ms=8.995 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1769gitlab # [ 200.405154] gitaly[922]: time="2026-09-06T06:49:17.608Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQMZ092Z6E46MAHSXVVKGT error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:49:27.217" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:17.608" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1770gitlab # [ 200.406492] gitaly[922]: time="2026-09-06T06:49:17.608Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQMZ092Z6E46MAHSXVVKGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:49:27.217" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:17.608" grpc.time_ms=0.244 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1771gitlab # [ 200.445339] gitaly[922]: time="2026-09-06T06:49:17.648Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQMZ092Z6E46MAHSXVVKGT diskcache=6e663edb-6c45-4992-9822-608e922ad77e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-06T06:49:27.221" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:17.612" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1772gitlab # [ 200.446896] gitaly[922]: time="2026-09-06T06:49:17.649Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1576 command.oublock=32 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQMZ092Z6E46MAHSXVVKGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-06T06:49:27.221" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:17.612" grpc.time_ms=36.663 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1773gitlab # [ 200.452670] gitaly[922]: time="2026-09-06T06:49:17.656Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQMZ092Z6E46MAHSXVVKGT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:49:27.265" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:17.655" pid=922 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1774gitlab # [ 200.453686] gitaly[922]: time="2026-09-06T06:49:17.656Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQMZ092Z6E46MAHSXVVKGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:49:27.265" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:17.655" grpc.time_ms=0.473 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1775gitlab # [ 200.525521] gitaly[922]: time="2026-09-06T06:49:17.669Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQMZ092Z6E46MAHSXVVKGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T06:49:27.273" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:17.663" grpc.time_ms=5.482 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1776gitlab # [ 200.527174] gitaly[922]: time="2026-09-06T06:49:17.689Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQMZ092Z6E46MAHSXVVKGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:49:27.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:17.689" grpc.time_ms=0.117 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1777gitlab # [ 200.528192] gitaly[922]: time="2026-09-06T06:49:17.694Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQMZ092Z6E46MAHSXVVKGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-06T06:49:27.013" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:17.694" grpc.time_ms=0.219 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1778gitlab # [ 201.159727] gitaly[922]: time="2026-09-06T06:49:18.363Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQMZ092Z6E46MAHSXVVKGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T06:49:28.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:18.351" grpc.time_ms=12.043 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1779gitlab # [ 201.508349] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:18 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 21571780gitlab # [ 201.518694] setup-gitlab-start[2268]: + mkdir -p /tmp/test-flake1781gitlab # [ 201.526505] setup-gitlab-start[2268]: + cd /tmp/test-flake1782gitlab # [ 201.529888] setup-gitlab-start[2268]: + git init -b master1783gitlab # [ 201.546146] setup-gitlab-start[2550]: Initialized empty Git repository in /tmp/test-flake/.git/1784gitlab # [ 201.547391] setup-gitlab-start[2268]: + git config user.name test1785gitlab # [ 201.558759] setup-gitlab-start[2268]: + git config user.email test@example.com1786gitlab # [ 201.567109] setup-gitlab-start[2268]: + cat1787gitlab # [ 201.571566] setup-gitlab-start[2268]: + git add flake.nix1788gitlab # [ 201.581447] setup-gitlab-start[2268]: + git commit -m 'initial commit'1789gitlab # [ 201.608492] setup-gitlab-start[2555]: [master (root-commit) a48ce98] initial commit1790gitlab # [ 201.612626] setup-gitlab-start[2555]: 1 file changed, 10 insertions(+)1791gitlab # [ 201.614854] setup-gitlab-start[2555]: create mode 100644 flake.nix1792gitlab # [ 201.617905] setup-gitlab-start[2268]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1793gitlab # [ 201.623808] setup-gitlab-start[2268]: + git push -u origin master1794gitlab # [ 201.679496] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:18 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 361795gitlab # [ 201.793531] gitaly[922]: time="2026-09-06T06:49:18.996Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN19CKNHHRA8NQSYTBV8W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:18.979" grpc.time_ms=16.288 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1796gitlab # [ 201.837966] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:19 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1481797gitlab # [ 202.315371] gitaly[922]: time="2026-09-06T06:49:19.518Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=5 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T06:49:29.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:19.510" grpc.time_ms=7.813 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1798gitlab # [ 202.387617] gitaly[922]: time="2026-09-06T06:49:19.591Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=330 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-06T06:49:49.080" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-06T06:49:19.582" grpc.time_ms=8.742 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1799gitlab # [ 202.416768] gitaly[922]: time="2026-09-06T06:49:19.617Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ duration_ms=200ns method=POST pid=922 status=200 url="http://unix/api/v4/internal/allowed"1800gitlab # [ 202.449868] gitaly[922]: time="2026-09-06T06:49:19.653Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ duration_ms=29ns method=POST pid=922 status=200 url="http://unix/api/v4/internal/pre_receive"1801gitlab # [ 202.451947] gitaly[922]: time="2026-09-06T06:49:19.653Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:19.416" grpc.time_ms=237.063 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1802gitlab # [ 202.512246] gitaly[922]: time="2026-09-06T06:49:19.715Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:19.714" grpc.time_ms=0.848 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1803gitlab # [ 202.559182] gitaly[922]: time="2026-09-06T06:49:19.762Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:19.762" grpc.time_ms=0.496 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1804gitlab # [ 202.596594] gitaly[922]: time="2026-09-06T06:49:19.800Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:19.799" grpc.time_ms=0.377 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1805gitlab # [ 202.720209] gitaly[922]: time="2026-09-06T06:49:19.923Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T06:49:29.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:19.916" grpc.time_ms=7.088 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1806gitlab # [ 202.804786] gitaly[922]: time="2026-09-06T06:49:20.008Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1567 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-06T06:49:29.069" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:49:19.979" grpc.time_ms=28.389 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1807gitlab # [ 202.827188] gitaly[922]: time="2026-09-06T06:49:20.020Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ duration_ms=181ns method=POST pid=922 status=200 url="http://unix/api/v4/internal/post_receive"1808gitlab # [ 202.828897] gitaly[922]: time="2026-09-06T06:49:20.021Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:19.838" grpc.time_ms=182.932 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1809gitlab # [ 202.855851] gitaly[922]: time="2026-09-06T06:49:20.059Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ diskcache=48cf2ef5-d6a6-49a9-ae44-cc44ecd1ed47 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:19.324" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1810gitlab # [ 202.872917] gitaly[922]: time="2026-09-06T06:49:20.059Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=268 command.inblock=8 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13940 command.oublock=32 command.real_time_ms=725 command.spawn_token_fork_ms=0 command.system_time_ms=192 command.user_time_ms=76 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:19.324" grpc.time_ms=735.29 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1811gitlab # [ 202.875169] gitlab-workhorse[828]: time="2026-09-06T06:49:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521812gitlab # [ 202.876593] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:20 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 10081813gitlab # [ 202.902169] setup-gitlab-start[2559]: To http://gitlab/root/test-flake.git1814gitlab # [ 202.903939] setup-gitlab-start[2559]: * [new branch] master -> master1815gitlab # [ 202.907119] setup-gitlab-start[2559]: branch 'master' set up to track 'origin/master'.1816gitlab # [ 202.911925] systemd[1]: Finished setup-gitlab.service.1817gitlab # [ 202.919988] systemd[1]: Starting nixbot CI service...1818gitlab # [ 203.328263] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-09-06T06:49:20.512Z","message":"Starting cluster with 1 processes"}1819gitlab: (finished: waiting for unit setup-gitlab.service, in 204.59 seconds)1820gitlab: waiting for unit nixbot.service1821gitlab # [ 204.184251] nixbot[2646]: {"ts": "2026-09-06T06:49:21.387Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1822gitlab # [ 204.209483] nixbot[2646]: {"ts": "2026-09-06T06:49:21.413Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1823gitlab # [ 204.231611] nixbot[2646]: {"ts": "2026-09-06T06:49:21.435Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1824gitlab # [ 204.246720] nixbot[2646]: {"ts": "2026-09-06T06:49:21.450Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1825gitlab # [ 204.258463] nixbot[2646]: {"ts": "2026-09-06T06:49:21.462Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1826gitlab # [ 204.271780] nixbot[2646]: {"ts": "2026-09-06T06:49:21.475Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1827gitlab # [ 204.283526] nixbot[2646]: {"ts": "2026-09-06T06:49:21.487Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1828gitlab # [ 204.294527] nixbot[2646]: {"ts": "2026-09-06T06:49:21.498Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1829gitlab # [ 204.309926] nixbot[2646]: {"ts": "2026-09-06T06:49:21.513Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1830gitlab # [ 204.320413] nixbot[2646]: {"ts": "2026-09-06T06:49:21.523Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1831gitlab # [ 204.333085] nixbot[2646]: {"ts": "2026-09-06T06:49:21.536Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1832gitlab # [ 204.340084] nixbot[2646]: {"ts": "2026-09-06T06:49:21.542Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1833gitlab # [ 204.348941] nixbot[2646]: {"ts": "2026-09-06T06:49:21.552Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1834gitlab # [ 204.357103] nixbot[2646]: {"ts": "2026-09-06T06:49:21.560Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1835gitlab # [ 204.365322] nixbot[2646]: {"ts": "2026-09-06T06:49:21.568Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1836gitlab # [ 204.371737] nixbot[2646]: {"ts": "2026-09-06T06:49:21.575Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1837gitlab # [ 204.378385] nixbot[2646]: {"ts": "2026-09-06T06:49:21.581Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1838gitlab # [ 204.384721] nixbot[2646]: {"ts": "2026-09-06T06:49:21.588Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1839gitlab # [ 204.395973] nixbot[2646]: {"ts": "2026-09-06T06:49:21.599Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1840gitlab # [ 204.402535] nixbot[2646]: {"ts": "2026-09-06T06:49:21.606Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1841gitlab # [ 204.408808] nixbot[2646]: {"ts": "2026-09-06T06:49:21.612Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1842gitlab # [ 204.420282] nixbot[2646]: {"ts": "2026-09-06T06:49:21.623Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1843gitlab # [ 204.426390] nixbot[2646]: {"ts": "2026-09-06T06:49:21.629Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1844gitlab # [ 204.433180] nixbot[2646]: {"ts": "2026-09-06T06:49:21.636Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1845gitlab # [ 204.440913] nixbot[2646]: {"ts": "2026-09-06T06:49:21.644Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1846gitlab # [ 204.449542] nixbot[2646]: {"ts": "2026-09-06T06:49:21.652Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1847gitlab # [ 204.456176] nixbot[2646]: {"ts": "2026-09-06T06:49:21.659Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1848gitlab # [ 204.462313] nixbot[2646]: {"ts": "2026-09-06T06:49:21.665Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1849gitlab # [ 204.466896] nixbot[2646]: {"ts": "2026-09-06T06:49:21.670Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1850gitlab # [ 204.479661] nixbot[2646]: {"ts": "2026-09-06T06:49:21.683Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1851gitlab # [ 204.488136] nixbot[2646]: {"ts": "2026-09-06T06:49:21.691Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1852gitlab # [ 204.494538] nixbot[2646]: {"ts": "2026-09-06T06:49:21.697Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1853gitlab # [ 204.500760] nixbot[2646]: {"ts": "2026-09-06T06:49:21.704Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1854gitlab # [ 204.842280] nixbot[2646]: INFO: Started server process [2646]1855gitlab # [ 204.844895] nixbot[2646]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1856gitlab # [ 204.872702] nixbot[2646]: INFO: ::ffff:127.0.0.1:36806 - "GET /health HTTP/1.1" 200 OK1857gitlab # [ 204.880945] systemd[1]: Started nixbot CI service.1858gitlab # [ 204.885079] systemd[1]: Reached target Multi-User System.1859gitlab # [ 204.890190] systemd[1]: Startup finished in 1.616s (kernel) + 2.973s (initrd) + 3min 20.300s (userspace) = 3min 24.889s.1860gitlab: (finished: waiting for unit nixbot.service, in 2.10 seconds)1861gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1862gitlab # [ 205.871341] nixbot[2646]: INFO: ::ffff:127.0.0.1:36808 - "GET /health HTTP/1.1" 200 OK1863gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.05 seconds)1864subtest: project discovered and webhook registered1865gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1866gitlab # [ 205.985742] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 641867gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.11 seconds)1868gitlab # [ 206.230638] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:23 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 13531869gitlab # [ 206.232039] nixbot[2646]: {"ts": "2026-09-06T06:49:23.435Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1870gitlab # [ 206.262958] nixbot[2646]: {"ts": "2026-09-06T06:49:23.466Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1871gitlab # [ 206.341502] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 681872gitlab # [ 206.343469] nixbot[2646]: {"ts": "2026-09-06T06:49:23.546Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1873gitlab # [ 206.345988] nixbot[2646]: {"ts": "2026-09-06T06:49:23.549Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1874gitlab # [ 206.456591] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:23 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 1021875gitlab # [ 206.459970] nixbot[2646]: {"ts": "2026-09-06T06:49:23.660Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1876gitlab # [ 206.607616] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:23 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1241877gitlab # [ 206.608956] nixbot[2646]: {"ts": "2026-09-06T06:49:23.811Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1878gitlab # [ 206.697740] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 741879gitlab # [ 206.707585] nixbot[2646]: {"ts": "2026-09-06T06:49:23.911Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1880gitlab # [ 206.777086] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:23 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 541881gitlab # [ 206.786420] nixbot[2646]: {"ts": "2026-09-06T06:49:23.989Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1882gitlab # [ 206.873825] gitaly[922]: time="2026-09-06T06:49:24.074Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN697WW4F06W6STD5SFKW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-06T06:49:54.060" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:49:24.061" grpc.time_ms=12.449 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1883gitlab # [ 206.928388] gitaly[922]: time="2026-09-06T06:49:24.132Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN697WW4F06W6STD5SFKW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:49:54.129" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:49:24.130" grpc.time_ms=1.363 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1884gitlab # [ 206.956733] gitaly[922]: time="2026-09-06T06:49:24.160Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN697WW4F06W6STD5SFKW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-06T06:49:34.005" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:49:24.152" grpc.time_ms=7.59 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1885gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1886gitlab # [ 207.008714] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:24 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 2031887gitlab # [ 207.012449] nixbot[2646]: {"ts": "2026-09-06T06:49:24.214Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1888gitlab # [ 207.070145] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:24 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 421889gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.08 seconds)1890(finished: subtest: project discovered and webhook registered, in 1.19 seconds)1891subtest: push delivers the webhook1892gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1893gitlab # [ 207.102990] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:24 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 851894gitlab # [ 207.107159] nixbot[2646]: {"ts": "2026-09-06T06:49:24.307Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1895gitlab # [ 207.112129] nixbot[2646]: {"ts": "2026-09-06T06:49:24.311Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1896gitlab # [ 207.137787] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:24 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 251897gitlab # [ 207.185928] gitaly[922]: time="2026-09-06T06:49:24.389Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN6KQ6N5SP4P63VAP13EN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:24.379" grpc.time_ms=10.255 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1898gitlab # [ 207.211259] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:24 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 471899gitlab # [ 207.214819] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:24 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 751900gitlab # [ 207.218663] gitaly[922]: time="2026-09-06T06:49:24.417Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=5 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN6KP8YBWVWGSF62HHGCZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:24.407" grpc.time_ms=9.98 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1901gitlab # Enumerating objects: 5, done.1902gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1903gitlab # Delta compression using up to 4 threads1904gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1905gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 137.00 KiB/s, done.1906gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1907gitlab # [ 207.303333] gitaly[922]: time="2026-09-06T06:49:24.507Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN6N8K5NHHA62YBMRVNKM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:24.497" pid=922 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1908gitlab # [ 207.319838] gitaly[922]: time="2026-09-06T06:49:24.507Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN6N8K5NHHA62YBMRVNKM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:24.497" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1909gitlab # [ 207.341668] gitlab-workhorse[828]: time="2026-09-06T06:49:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131910gitlab # [ 207.344878] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:24 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1161911gitlab # [ 207.348212] gitaly[922]: time="2026-09-06T06:49:24.508Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN6N8K5NHHA62YBMRVNKM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:24.497" grpc.time_ms=10.181 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1912gitlab # [ 207.372141] gitaly[922]: time="2026-09-06T06:49:24.574Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN6S0S8NQKR3K8JG4JW4R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:24.561" pid=922 remote_ip="2001:db8:1::1" request_sha=4e463dc28ea592bc52dbbb73fdd9ce255189214c response_bytes=223 span.kind=server system=grpc1913gitlab # [ 207.373290] gitaly[922]: time="2026-09-06T06:49:24.575Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1199 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN6S0S8NQKR3K8JG4JW4R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:24.561" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1914gitlab # [ 207.374176] gitaly[922]: time="2026-09-06T06:49:24.576Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1199 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN6S0S8NQKR3K8JG4JW4R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:24.561" grpc.time_ms=13.93 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1915gitlab # [ 207.434803] gitlab-workhorse[828]: time="2026-09-06T06:49:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231916gitlab # [ 207.435841] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:24 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 1251917gitlab # [ 207.460770] gitaly[922]: time="2026-09-06T06:49:24.662Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=330 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-06T06:49:54.154" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-06T06:49:24.655" grpc.time_ms=7.396 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1918gitlab # [ 207.469801] gitaly[922]: time="2026-09-06T06:49:24.673Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 duration_ms=65ns method=POST pid=922 status=200 url="http://unix/api/v4/internal/allowed"1919gitlab # [ 207.499121] gitaly[922]: time="2026-09-06T06:49:24.702Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 duration_ms=28ns method=POST pid=922 status=200 url="http://unix/api/v4/internal/pre_receive"1920gitlab # [ 207.505336] gitaly[922]: time="2026-09-06T06:49:24.707Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:24.606" grpc.time_ms=99.011 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1921gitlab # [ 207.534877] gitaly[922]: time="2026-09-06T06:49:24.738Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:24.738" grpc.time_ms=0.413 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1922gitlab # [ 207.543126] gitaly[922]: time="2026-09-06T06:49:24.741Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN6YJBX0AFKXHMVWSB08A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:24.731" grpc.time_ms=9.449 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1923gitlab # [ 207.544526] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:24 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 511924gitlab # [ 207.605494] gitaly[922]: time="2026-09-06T06:49:24.809Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:24.808" grpc.time_ms=0.404 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1925gitlab # [ 207.613255] gitaly[922]: time="2026-09-06T06:49:24.816Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN70866CNGFJE5KH7R69Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:24.805" pid=922 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1926gitlab # [ 207.614273] gitaly[922]: time="2026-09-06T06:49:24.816Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN70866CNGFJE5KH7R69Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:24.805" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1927gitlab # [ 207.615135] gitlab-workhorse[828]: time="2026-09-06T06:49:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671928gitlab # [ 207.615876] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:24 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 721929gitlab # [ 207.617121] gitaly[922]: time="2026-09-06T06:49:24.816Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN70866CNGFJE5KH7R69Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:24.805" grpc.time_ms=11.391 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1930gitlab # [ 207.716675] gitaly[922]: time="2026-09-06T06:49:24.920Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN73BD9F4FNBXG8WVA2TA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:24.912" grpc.time_ms=6.937 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1931gitlab # [ 207.718397] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:24 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 771932gitlab # [ 207.743147] gitaly[922]: time="2026-09-06T06:49:24.945Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:24.920" grpc.time_ms=25.699 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1933gitlab # [ 207.796172] gitaly[922]: time="2026-09-06T06:49:24.999Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN75WJQJP9RFTX9BPNQW1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:24.984" pid=922 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1934gitlab # [ 207.798525] gitaly[922]: time="2026-09-06T06:49:25.001Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN75WJQJP9RFTX9BPNQW1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:24.984" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1935gitlab # [ 207.802144] gitlab-workhorse[828]: time="2026-09-06T06:49:25Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091936gitlab # [ 207.802835] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:25 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 791937gitlab # [ 207.804040] gitaly[922]: time="2026-09-06T06:49:25.005Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN75WJQJP9RFTX9BPNQW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:24.984" grpc.time_ms=18.079 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1938gitlab # [ 207.897134] gitaly[922]: time="2026-09-06T06:49:25.100Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 duration_ms=111ns method=POST pid=922 status=200 url="http://unix/api/v4/internal/post_receive"1939gitlab # [ 207.898288] gitaly[922]: time="2026-09-06T06:49:25.100Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:24.988" grpc.time_ms=112.657 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1940gitlab # [ 207.929615] gitaly[922]: time="2026-09-06T06:49:25.133Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN7B1G40D4CJW8QRNF46G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:49:55.132" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:49:25.132" grpc.time_ms=0.551 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1941gitlab # [ 207.950646] gitaly[922]: time="2026-09-06T06:49:25.154Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 diskcache=c8900b57-b1af-4917-9e48-1aca0aad8322 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:24.539" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1942gitlab # To http://gitlab/root/test-flake.git1943gitlab # a48ce98..9321466 master -> master1944gitlab # [ 207.968665] gitaly[922]: time="2026-09-06T06:49:25.155Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=243 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13446 command.oublock=32 command.real_time_ms=587 command.spawn_token_fork_ms=5 command.system_time_ms=186 command.user_time_ms=57 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:24.539" grpc.time_ms=615.447 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1945gitlab # [ 207.990305] gitlab-workhorse[828]: time="2026-09-06T06:49:25Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521946gitlab # [ 207.993565] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:25 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 6921947gitlab # [ 207.996850] gitaly[922]: time="2026-09-06T06:49:25.196Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN7B1G40D4CJW8QRNF46G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-06T06:49:55.189" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:49:25.189" grpc.time_ms=7.019 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1948gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.95 seconds)1949gitlab: must succeed: git -C /tmp/test-flake rev-parse master1950gitlab # [ 208.033191] gitaly[922]: time="2026-09-06T06:49:25.236Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN7B1G40D4CJW8QRNF46G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:49:35.098" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:49:25.228" grpc.time_ms=7.605 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1951gitlab # [ 208.047920] gitaly[922]: time="2026-09-06T06:49:25.251Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN7B1G40D4CJW8QRNF46G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:49:35.115" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:49:25.245" grpc.time_ms=6.117 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1952gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.05 seconds)1953gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'1954gitlab # [ 208.092693] gitaly[922]: time="2026-09-06T06:49:25.296Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN7B1G40D4CJW8QRNF46G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-06T06:49:35.165" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:25.295" grpc.time_ms=0.2 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1955gitlab # [ 208.115111] gitaly[922]: time="2026-09-06T06:49:25.318Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=9 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN7B1G40D4CJW8QRNF46G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-06T06:49:35.173" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:49:25.304" grpc.time_ms=14.347 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1956gitlab # [ 208.142780] nixbot[2646]: INFO: ::ffff:127.0.0.1:36816 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK1957gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.07 seconds)1958gitlab # [ 208.167692] gitaly[922]: time="2026-09-06T06:49:25.371Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN7B1G40D4CJW8QRNF46G grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:25.370" grpc.time_ms=0.343 pid=922 span.kind=server system=grpc1959gitlab # [ 208.204580] gitaly[922]: time="2026-09-06T06:49:25.408Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN7B1G40D4CJW8QRNF46G grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:49:25.407" grpc.time_ms=0.39 pid=922 span.kind=server system=grpc1960gitlab # [ 208.226138] gitaly[922]: time="2026-09-06T06:49:25.429Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN7B1G40D4CJW8QRNF46G diskcache=473a15f6-ed6e-4c8f-bb2e-0c5dcf528a32 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-06T06:49:35.191" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:25.322" pid=922 ref=refs/keep-around/a48ce982af387c0061ab3edad444e5a2a945c953 remote_ip="2001:db8:1::1" revision=a48ce982af387c0061ab3edad444e5a2a945c953 span.kind=server system=grpc username=root1961gitlab # [ 208.229238] gitaly[922]: time="2026-09-06T06:49:25.430Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=77 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5415 command.oublock=8 command.real_time_ms=100 command.spawn_token_fork_ms=17 command.system_time_ms=58 command.user_time_ms=19 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN7B1G40D4CJW8QRNF46G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-06T06:49:35.191" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:49:25.322" grpc.time_ms=107.87 pid=922 ref=refs/keep-around/a48ce982af387c0061ab3edad444e5a2a945c953 remote_ip="2001:db8:1::1" revision=a48ce982af387c0061ab3edad444e5a2a945c953 span.kind=server system=grpc username=root1962gitlab # [ 208.231280] gitaly[922]: time="2026-09-06T06:49:25.434Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN7B1G40D4CJW8QRNF46G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:49:55.434" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:49:25.434" grpc.time_ms=0.377 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1963gitlab # [ 208.343599] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a48ce982af387c0061ab3edad444e5a2a945c953 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 4571964gitlab # [ 208.352076] nixbot[2646]: {"ts": "2026-09-06T06:49:25.555Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a48ce982af387c0061ab3edad444e5a2a945c953 \"HTTP/1.1 201 Created\""}1965gitlab # [ 208.372344] nixbot[2646]: {"ts": "2026-09-06T06:49:25.575Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-a48ce982af38-0"}1966gitlab # [ 208.562822] nixbot[2646]: {"ts": "2026-09-06T06:49:25.766Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-a48ce982af38-0", "argv0": "bwrap"}1967gitlab # [ 208.682741] systemd[1]: Started Nix Daemon.1968gitlab # [ 208.777314] nix-daemon[2873]: accepted connection from pid 2868, user nixbot1969gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'1970gitlab # [ 209.189379] nixbot[2646]: INFO: ::ffff:127.0.0.1:36832 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK1971gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)1972gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'1973gitlab # [ 210.236803] nixbot[2646]: INFO: ::ffff:127.0.0.1:36838 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK1974gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.04 seconds)1975gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'1976gitlab # [ 211.280804] nixbot[2646]: INFO: ::ffff:127.0.0.1:36850 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK1977gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)1978gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'1979gitlab # [ 212.328918] nixbot[2646]: INFO: ::ffff:127.0.0.1:36862 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK1980gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)1981gitlab # [ 213.245594] nix-daemon[2873]: accepted connection from pid 2898, user nixbot1982gitlab # [ 213.260588] nix-daemon[2873]: accepted connection from pid 2868, user nixbot1983gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'1984gitlab # [ 213.371766] nixbot[2646]: INFO: ::ffff:127.0.0.1:45924 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK1985gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.04 seconds)1986gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'1987gitlab # [ 214.421784] nixbot[2646]: INFO: ::ffff:127.0.0.1:45938 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK1988gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)1989gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'1990gitlab # [ 215.473841] nixbot[2646]: INFO: ::ffff:127.0.0.1:45954 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK1991gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)1992gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'1993gitlab # [ 216.521658] nixbot[2646]: INFO: ::ffff:127.0.0.1:45966 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK1994gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)1995gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'1996gitlab # [ 217.571942] nixbot[2646]: INFO: ::ffff:127.0.0.1:45980 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK1997gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)1998gitlab # [ 217.591930] nix-daemon[2873]: accepted connection from pid 2868, user nixbot1999gitlab # [ 217.695498] nix-daemon[2873]: accepted connection from pid 2934, user nixbot2000gitlab # [ 217.807877] gitaly[922]: time="2026-09-06T06:49:35.010Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNGXBBWM3DJRE4R9QD4K8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:05.008" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:49:35.009" grpc.time_ms=1.111 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2001gitlab # [ 217.980494] gitaly[922]: time="2026-09-06T06:49:35.184Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQNGXBBWM3DJRE4R9QD4K8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:49:45.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:49:35.176" grpc.time_ms=6.988 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2002gitlab # [ 218.122065] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:35 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a48ce982af387c0061ab3edad444e5a2a945c953 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 4332003gitlab # [ 218.133645] nixbot[2646]: {"ts": "2026-09-06T06:49:35.337Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a48ce982af387c0061ab3edad444e5a2a945c953 \"HTTP/1.1 201 Created\""}2004gitlab # [ 218.222398] gitaly[922]: time="2026-09-06T06:49:35.425Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNHBTV6M9K783HTW7V064 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:05.423" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:49:35.424" grpc.time_ms=1.211 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2005gitlab # [ 218.317534] gitaly[922]: time="2026-09-06T06:49:35.520Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1TQNHBTV6M9K783HTW7V064 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:49:45.118" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:49:35.508" grpc.time_ms=11.502 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2006gitlab # [ 218.381796] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:35 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a48ce982af387c0061ab3edad444e5a2a945c953 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2302007gitlab # [ 218.383647] nixbot[2646]: {"ts": "2026-09-06T06:49:35.587Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a48ce982af387c0061ab3edad444e5a2a945c953 \"HTTP/1.1 201 Created\""}2008gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2009gitlab # [ 218.626112] nixbot[2646]: INFO: ::ffff:127.0.0.1:45988 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2010gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2011gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2012gitlab # [ 219.675958] nixbot[2646]: INFO: ::ffff:127.0.0.1:45994 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2013gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2014gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2015gitlab # [ 220.726723] nixbot[2646]: INFO: ::ffff:127.0.0.1:46006 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2016gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2017gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2018gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.04 seconds)2019gitlab # [ 221.778846] nixbot[2646]: INFO: ::ffff:127.0.0.1:46014 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2020gitlab # [ 221.931822] nix-daemon[2873]: accepted connection from pid 2973, user nixbot2021gitlab # [ 222.008966] gitaly[922]: time="2026-09-06T06:49:39.212Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNN2YXXH8DSHH1JM9M9G9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:09.210" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:49:39.211" grpc.time_ms=0.692 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2022gitlab # [ 222.055487] gitaly[922]: time="2026-09-06T06:49:39.259Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQNN2YXXH8DSHH1JM9M9G9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:49:49.080" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:49:39.250" grpc.time_ms=8.04 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2023gitlab # [ 222.107329] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:39 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a48ce982af387c0061ab3edad444e5a2a945c953 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1442024gitlab # [ 222.108467] nixbot[2646]: {"ts": "2026-09-06T06:49:39.311Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a48ce982af387c0061ab3edad444e5a2a945c953 \"HTTP/1.1 201 Created\""}2025gitlab # [ 222.412992] gitaly[922]: time="2026-09-06T06:49:39.616Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQNNF60YTTF1XAM6VTY827 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:39.603" grpc.time_ms=12.63 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2026gitlab # [ 222.459767] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:39 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1052027gitlab # [ 222.516365] gitaly[922]: time="2026-09-06T06:49:39.720Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNNJM3Z94ZD6TAQ46XSR8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:39.711" pid=922 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2028gitlab # [ 222.517805] gitaly[922]: time="2026-09-06T06:49:39.720Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNNJM3Z94ZD6TAQ46XSR8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:39.711" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2029gitlab # [ 222.554465] gitaly[922]: time="2026-09-06T06:49:39.758Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNNJM3Z94ZD6TAQ46XSR8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:39.711" grpc.time_ms=46.294 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2030gitlab # [ 222.577460] gitlab-workhorse[828]: time="2026-09-06T06:49:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672031gitlab # [ 222.579142] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:39 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1122032gitlab # [ 222.634971] gitaly[922]: time="2026-09-06T06:49:39.838Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNNP70MJKD95NMYAK9DZB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:39.827" pid=922 remote_ip="2001:db8:1::1" request_sha=f9a11512f7bfb57c48e8ccd10a82eac4849d8c17 response_bytes=337 span.kind=server system=grpc2033gitlab # [ 222.636216] gitaly[922]: time="2026-09-06T06:49:39.838Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1197 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNNP70MJKD95NMYAK9DZB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:39.827" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2034gitlab # [ 222.637455] gitaly[922]: time="2026-09-06T06:49:39.839Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1197 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNNP70MJKD95NMYAK9DZB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:39.827" grpc.time_ms=12.283 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2035gitlab # [ 222.638486] gitlab-workhorse[828]: time="2026-09-06T06:49:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3372036gitlab # [ 222.639697] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:39 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 562037gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2038gitlab # [ 222.782452] gitaly[922]: time="2026-09-06T06:49:39.985Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQNNV2J52BP0X90XAFXTJ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:39.977" grpc.time_ms=7.973 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2039gitlab # [ 222.785844] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:39 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 502040gitlab # [ 222.824644] nixbot[2646]: INFO: ::ffff:127.0.0.1:46022 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2041gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2042gitlab # [ 222.859355] gitaly[922]: time="2026-09-06T06:49:40.063Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNNWQTQ79CYFKMRQ4KDRA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:40.055" pid=922 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc2043gitlab # [ 222.860796] gitaly[922]: time="2026-09-06T06:49:40.063Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNNWQTQ79CYFKMRQ4KDRA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:40.055" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2044gitlab # [ 222.861338] gitlab-workhorse[828]: time="2026-09-06T06:49:40Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672045gitlab # [ 222.862307] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:40 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 722046gitlab # [ 222.863481] gitaly[922]: time="2026-09-06T06:49:40.063Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNNWQTQ79CYFKMRQ4KDRA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:40.055" grpc.time_ms=7.813 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2047gitlab # [ 223.000707] gitaly[922]: time="2026-09-06T06:49:40.203Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQNP1ZCJPGQ580MJKNZC8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:40.196" grpc.time_ms=6.969 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2048gitlab # [ 223.003396] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:40 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 442049gitlab # [ 223.104720] gitaly[922]: time="2026-09-06T06:49:40.307Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNP4DWN6D200RXTBHMB5T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:40.293" pid=922 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2050gitlab # [ 223.141979] gitaly[922]: time="2026-09-06T06:49:40.343Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNP4DWN6D200RXTBHMB5T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:40.293" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2051gitlab # [ 223.165678] gitlab-workhorse[828]: time="2026-09-06T06:49:40Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162052gitlab # [ 223.169186] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:49:40 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 1072053gitlab # [ 223.170330] gitaly[922]: time="2026-09-06T06:49:40.344Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQNP4DWN6D200RXTBHMB5T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:49:40.293" grpc.time_ms=50.084 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2054gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2055gitlab # [ 223.872949] nixbot[2646]: INFO: ::ffff:127.0.0.1:59544 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2056gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2057gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2058gitlab # [ 224.923390] nixbot[2646]: INFO: ::ffff:127.0.0.1:59552 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2059gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2060gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2061gitlab # [ 225.971917] nixbot[2646]: INFO: ::ffff:127.0.0.1:59558 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2062gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.04 seconds)2063gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2064gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.04 seconds)2065gitlab # [ 227.015218] nixbot[2646]: INFO: ::ffff:127.0.0.1:59566 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2066gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2067gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.04 seconds)2068gitlab # [ 228.058657] nixbot[2646]: INFO: ::ffff:127.0.0.1:59570 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2069gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2070gitlab # [ 229.102738] nixbot[2646]: INFO: ::ffff:127.0.0.1:59574 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2071gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.04 seconds)2072gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2073gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.04 seconds)2074gitlab # [ 230.146802] nixbot[2646]: INFO: ::ffff:127.0.0.1:59586 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2075gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2076gitlab # [ 231.192976] nixbot[2646]: INFO: ::ffff:127.0.0.1:59602 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2077gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2078gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2079gitlab # [ 232.226274] nixbot[2646]: INFO: ::ffff:127.0.0.1:59610 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2080gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.03 seconds)2081gitlab # [ 232.970717] sidekiq-cluster[2654]: 2026-09-06T06:49:50.173Z pid=2654 tid=xdi INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2654, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>432218112}2082gitlab # [ 233.185384] sidekiq-cluster[2654]: W, [2026-09-06T06:49:50.388650 #2654] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.2083gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2084gitlab # [ 233.226360] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:49:50.429Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}2085gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2086gitlab # [ 233.270923] nixbot[2646]: INFO: ::ffff:127.0.0.1:51150 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2087gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2088gitlab # [ 234.317894] nixbot[2646]: INFO: ::ffff:127.0.0.1:51166 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2089gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.04 seconds)2090gitlab # [ 235.189203] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:49:52.391Z","message":"GitLab reliable fetch activated!"}2091gitlab # [ 235.192766] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:49:52.391Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2092gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2093gitlab # [ 235.360455] nixbot[2646]: INFO: ::ffff:127.0.0.1:51176 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2094gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.04 seconds)2095gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2096gitlab # [ 236.409185] nixbot[2646]: INFO: ::ffff:127.0.0.1:51178 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2097gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2098gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2099gitlab # [ 237.459452] nixbot[2646]: INFO: ::ffff:127.0.0.1:51190 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2100gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2101gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2102gitlab # [ 238.510251] nixbot[2646]: INFO: ::ffff:127.0.0.1:51206 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2103gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2104gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2105gitlab # [ 239.559562] nixbot[2646]: INFO: ::ffff:127.0.0.1:51210 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2106gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.04 seconds)2107gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2108gitlab # [ 240.605314] nixbot[2646]: INFO: ::ffff:127.0.0.1:51222 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2109gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2110gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2111gitlab # [ 241.656769] nixbot[2646]: INFO: ::ffff:127.0.0.1:51234 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2112gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2113gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2114gitlab # [ 242.708356] nixbot[2646]: INFO: ::ffff:127.0.0.1:51240 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2115gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2116gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2117gitlab # [ 243.759806] nixbot[2646]: INFO: ::ffff:127.0.0.1:44396 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2118gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2119gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2120gitlab # [ 244.806616] nixbot[2646]: INFO: ::ffff:127.0.0.1:44406 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2121gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2122gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2123gitlab # [ 245.857163] nixbot[2646]: INFO: ::ffff:127.0.0.1:44416 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2124gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2125gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2126gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.04 seconds)2127gitlab # [ 246.905712] nixbot[2646]: INFO: ::ffff:127.0.0.1:44418 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2128gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2129gitlab # [ 247.950630] nixbot[2646]: INFO: ::ffff:127.0.0.1:44428 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2130gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2131gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2132gitlab # [ 249.001978] nixbot[2646]: INFO: ::ffff:127.0.0.1:44434 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2133gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2134gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2135gitlab # [ 250.045425] nixbot[2646]: INFO: ::ffff:127.0.0.1:44442 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2136gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.04 seconds)2137gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2138gitlab # [ 251.094664] nixbot[2646]: INFO: ::ffff:127.0.0.1:44456 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2139gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2140gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2141gitlab # [ 252.144293] nixbot[2646]: INFO: ::ffff:127.0.0.1:44466 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2142gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2143gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2144gitlab # [ 253.194196] nixbot[2646]: INFO: ::ffff:127.0.0.1:58628 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2145gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2146gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2147gitlab # [ 254.242942] nixbot[2646]: INFO: ::ffff:127.0.0.1:58638 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2148gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.04 seconds)2149gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2150gitlab # [ 255.287976] nixbot[2646]: INFO: ::ffff:127.0.0.1:58648 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2151gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2152gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2153gitlab # [ 256.337342] nixbot[2646]: INFO: ::ffff:127.0.0.1:58656 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2154gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2155gitlab # [ 256.818731] postgres[3188]: [3188] ERROR: relation "table_without_models" does not exist2156gitlab # [ 256.822098] postgres[3188]: [3188] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2157gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2158gitlab # [ 257.385342] nixbot[2646]: INFO: ::ffff:127.0.0.1:58658 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2159gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2160gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2161gitlab # [ 258.435208] nixbot[2646]: INFO: ::ffff:127.0.0.1:58670 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2162gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2163gitlab # [ 258.460541] sidekiq-cluster[2654]: InitializerConnections Query: SET client_min_messages TO 'warning'2164gitlab # [ 258.463860] sidekiq-cluster[2654]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'2165gitlab # [ 258.466982] sidekiq-cluster[2654]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'2166gitlab # [ 258.469827] sidekiq-cluster[2654]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'2167gitlab # [ 258.473269] sidekiq-cluster[2654]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'2168gitlab # [ 258.475974] sidekiq-cluster[2654]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'2169gitlab # [ 258.478703] sidekiq-cluster[2654]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'2170gitlab # [ 258.481956] sidekiq-cluster[2654]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers2171gitlab # [ 258.486178] sidekiq-cluster[2654]: InitializerConnections Query: SET standard_conforming_strings = on2172gitlab # [ 258.488705] sidekiq-cluster[2654]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'2173gitlab # [ 258.490745] sidekiq-cluster[2654]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'2174gitlab # [ 258.493372] sidekiq-cluster[2654]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'2175gitlab # [ 258.495497] sidekiq-cluster[2654]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'2176gitlab # [ 258.497564] sidekiq-cluster[2654]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'2177gitlab # [ 258.499638] sidekiq-cluster[2654]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'2178gitlab # [ 258.502285] sidekiq-cluster[2654]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers2179gitlab # [ 259.068700] sidekiq-cluster[2654]: InitializerConnections Query: SET intervalstyle = iso_86012180gitlab # [ 259.072902] sidekiq-cluster[2654]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'2181gitlab # [ 259.075925] sidekiq-cluster[2654]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'2182gitlab # [ 259.080362] sidekiq-cluster[2654]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'2183gitlab # [ 259.083382] sidekiq-cluster[2654]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'2184gitlab # [ 259.086395] sidekiq-cluster[2654]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'2185gitlab # [ 259.089360] sidekiq-cluster[2654]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'2186gitlab # [ 259.093817] sidekiq-cluster[2654]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers2187gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2188gitlab # [ 259.487813] nixbot[2646]: INFO: ::ffff:127.0.0.1:58682 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2189gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.04 seconds)2190gitlab # [ 259.513437] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:16.716Z","message":"Booted Rails 7.2.3.1 application in production environment"}2191gitlab # [ 259.517743] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:16.721Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}2192gitlab # [ 259.521103] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:16.723Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2193gitlab # [ 259.524109] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:16.723Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2194gitlab # [ 259.527474] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:16.730Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2195gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2196gitlab # [ 260.529879] nixbot[2646]: INFO: ::ffff:127.0.0.1:58690 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2197gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2198gitlab # [ 260.866988] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:18.069Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"4a12efb9ef5cd3d958903843","created_at":"2026-09-06T06:49:17.568Z","trace_propagation_headers":{"sentry-trace":"d7ff3801120b415487476393c66522f0-b2799c60ae2a44c0","baggage":"sentry-trace_id=d7ff3801120b415487476393c66522f0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQMZ092Z6E46MAHSXVVKGT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:17.592Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-4a12efb9ef5cd3d958903843: start","job_status":"start","queue_duration_s":60.477536,"scheduling_latency_s":60.477583}2199gitlab # [ 261.035470] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:18.238Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"4a12efb9ef5cd3d958903843","created_at":"2026-09-06T06:49:17.568Z","trace_propagation_headers":{"sentry-trace":"d7ff3801120b415487476393c66522f0-b2799c60ae2a44c0","baggage":"sentry-trace_id=d7ff3801120b415487476393c66522f0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQMZ092Z6E46MAHSXVVKGT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:17.592Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-4a12efb9ef5cd3d958903843: done: 0.169005 sec","job_status":"done","queue_duration_s":60.477536,"scheduling_latency_s":60.477583,"redis_calls":23,"redis_duration_s":0.010176,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005924,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002507,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001745,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064656,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.091923694,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.169005,"completed_at":"2026-09-06T06:50:18.238Z","load_balancing_strategy":"primary","db_duration_s":0.069132,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2200gitlab # [ 261.142399] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:18.240Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"6168f7145f36ae77ec28fbed","created_at":"2026-09-06T06:49:17.599Z","trace_propagation_headers":{"sentry-trace":"d7ff3801120b415487476393c66522f0-b2799c60ae2a44c0","baggage":"sentry-trace_id=d7ff3801120b415487476393c66522f0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQMZ092Z6E46MAHSXVVKGT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:17.604Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-6168f7145f36ae77ec28fbed: start","job_status":"start","queue_duration_s":60.636002,"scheduling_latency_s":60.636024}2201gitlab # [ 261.165054] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:18.338Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"6168f7145f36ae77ec28fbed","created_at":"2026-09-06T06:49:17.599Z","trace_propagation_headers":{"sentry-trace":"d7ff3801120b415487476393c66522f0-b2799c60ae2a44c0","baggage":"sentry-trace_id=d7ff3801120b415487476393c66522f0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQMZ092Z6E46MAHSXVVKGT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:17.604Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-6168f7145f36ae77ec28fbed: done: 0.097685 sec","job_status":"done","queue_duration_s":60.636002,"scheduling_latency_s":60.636024,"redis_calls":14,"redis_duration_s":0.006138,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001248,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002981,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001909,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.073103146,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.097685,"completed_at":"2026-09-06T06:50:18.338Z","load_balancing_strategy":"primary","db_duration_s":0.029862,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2202gitlab # [ 261.201339] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:18.340Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"ce03f77cbb0ed609232ab4c0","created_at":"2026-09-06T06:49:18.252Z","trace_propagation_headers":{"sentry-trace":"d7ff3801120b415487476393c66522f0-b2799c60ae2a44c0","baggage":"sentry-trace_id=d7ff3801120b415487476393c66522f0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQMZ092Z6E46MAHSXVVKGT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:18.258Z","job_size_bytes":5,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-ce03f77cbb0ed609232ab4c0: start","job_status":"start","queue_duration_s":60.082076,"scheduling_latency_s":60.082098}2203gitlab # [ 261.302479] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:18.505Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"ce03f77cbb0ed609232ab4c0","created_at":"2026-09-06T06:49:18.252Z","trace_propagation_headers":{"sentry-trace":"d7ff3801120b415487476393c66522f0-b2799c60ae2a44c0","baggage":"sentry-trace_id=d7ff3801120b415487476393c66522f0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQMZ092Z6E46MAHSXVVKGT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:18.258Z","job_size_bytes":5,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-ce03f77cbb0ed609232ab4c0: done: 0.165381 sec","job_status":"done","queue_duration_s":60.082076,"scheduling_latency_s":60.082098,"redis_calls":12,"redis_duration_s":0.005287,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001463,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003056,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000768,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.11869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000555378,"duration_s":0.165381,"completed_at":"2026-09-06T06:50:18.505Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034478,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2204gitlab # [ 261.304354] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:18.507Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"80af5c4670d2e47f80cad761","created_at":"2026-09-06T06:49:18.279Z","trace_propagation_headers":{"sentry-trace":"d7ff3801120b415487476393c66522f0-b2799c60ae2a44c0","baggage":"sentry-trace_id=d7ff3801120b415487476393c66522f0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQMZ092Z6E46MAHSXVVKGT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:18.283Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-80af5c4670d2e47f80cad761: start","job_status":"start","queue_duration_s":60.22474,"scheduling_latency_s":60.224805}2205gitlab # [ 261.450216] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:18.653Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"80af5c4670d2e47f80cad761","created_at":"2026-09-06T06:49:18.279Z","trace_propagation_headers":{"sentry-trace":"d7ff3801120b415487476393c66522f0-b2799c60ae2a44c0","baggage":"sentry-trace_id=d7ff3801120b415487476393c66522f0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQMZ092Z6E46MAHSXVVKGT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:18.283Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-80af5c4670d2e47f80cad761: done: 0.145612 sec","job_status":"done","queue_duration_s":60.22474,"scheduling_latency_s":60.224805,"redis_calls":11,"redis_duration_s":0.00513,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001315,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002928,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000887,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.112,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.112,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.093431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000557893,"duration_s":0.145612,"completed_at":"2026-09-06T06:50:18.653Z","load_balancing_strategy":"primary","db_duration_s":0.05066,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2206gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2207gitlab # [ 261.453619] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:18.655Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"d031b2fb892d66fdecad257f","created_at":"2026-09-06T06:49:18.285Z","trace_propagation_headers":{"sentry-trace":"d7ff3801120b415487476393c66522f0-b2799c60ae2a44c0","baggage":"sentry-trace_id=d7ff3801120b415487476393c66522f0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQMZ092Z6E46MAHSXVVKGT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:18.289Z","job_size_bytes":89,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-d031b2fb892d66fdecad257f: start","job_status":"start","queue_duration_s":60.366515,"scheduling_latency_s":60.366537}2208gitlab # [ 261.530383] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:18.686Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"d031b2fb892d66fdecad257f","created_at":"2026-09-06T06:49:18.285Z","trace_propagation_headers":{"sentry-trace":"d7ff3801120b415487476393c66522f0-b2799c60ae2a44c0","baggage":"sentry-trace_id=d7ff3801120b415487476393c66522f0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQMZ092Z6E46MAHSXVVKGT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:18.289Z","job_size_bytes":89,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-d031b2fb892d66fdecad257f: done: 0.031049 sec","job_status":"done","queue_duration_s":60.366515,"scheduling_latency_s":60.366537,"redis_calls":11,"redis_duration_s":0.004566000000000001,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001224,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00253,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000812,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019032,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000643378,"duration_s":0.031049,"completed_at":"2026-09-06T06:50:18.686Z","load_balancing_strategy":"primary","db_duration_s":0.003562,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2209gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.09 seconds)2210gitlab # [ 261.551097] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:18.688Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 a48ce982af387c0061ab3edad444e5a2a945c953 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"f86867208d844fa7963bb8d6","created_at":"2026-09-06T06:49:19.868Z","trace_propagation_headers":{"sentry-trace":"8b96c35fbf854110b8275979012ed13a-8ffcd318b63441af","baggage":"sentry-trace_id=8b96c35fbf854110b8275979012ed13a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN1EB5NXYDGD9BX1XK4TZ","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:19.890Z","job_size_bytes":185,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-f86867208d844fa7963bb8d6: start","job_status":"start","queue_duration_s":58.798644,"scheduling_latency_s":58.798665}2211gitlab # [ 261.623771] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:18.704Z","message":"changes: \"0000000000000000000000000000000000000000 a48ce982af387c0061ab3edad444e5a2a945c953 refs/heads/master\\n\""}2212gitlab # [ 261.629538] nixbot[2646]: INFO: ::ffff:127.0.0.1:58698 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2213gitlab # [ 261.634723] gitaly[922]: time="2026-09-06T06:50:18.838Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=104 command.spawn_token_fork_ms=100 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:28.011" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:18.731" grpc.time_ms=106.528 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2214gitlab # [ 261.654238] gitaly[922]: time="2026-09-06T06:50:18.857Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T06:50:28.128" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:50:18.849" grpc.time_ms=8.43 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2215gitlab # [ 261.701274] gitaly[922]: time="2026-09-06T06:50:18.904Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-06T06:50:28.176" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:18.897" grpc.time_ms=7.324 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2216gitlab # [ 261.777389] gitaly[922]: time="2026-09-06T06:50:18.980Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:18.980" grpc.time_ms=0.461 pid=922 span.kind=server system=grpc2217gitlab # [ 261.822897] gitaly[922]: time="2026-09-06T06:50:19.026Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:19.025" grpc.time_ms=0.748 pid=922 span.kind=server system=grpc2218gitlab # [ 261.850102] gitaly[922]: time="2026-09-06T06:50:19.053Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ diskcache=079dcafc-4d7d-4efa-8f85-f72b7079f23a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-06T06:50:28.216" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:50:18.937" pid=922 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2219gitlab # [ 261.866385] gitaly[922]: time="2026-09-06T06:50:19.070Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=97 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5143 command.oublock=8 command.real_time_ms=109 command.spawn_token_fork_ms=0 command.system_time_ms=68 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-06T06:50:28.216" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:50:18.937" grpc.time_ms=116.89 pid=922 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2220gitlab # [ 261.897718] gitaly[922]: time="2026-09-06T06:50:19.101Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-06T06:50:29.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:50:19.100" grpc.time_ms=0.364 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2221gitlab # [ 261.943985] gitaly[922]: time="2026-09-06T06:50:19.147Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=947 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-06T06:50:29.036" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:19.127" grpc.time_ms=19.819 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2222gitlab # [ 262.041366] gitaly[922]: time="2026-09-06T06:50:19.244Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=340 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-06T06:50:49.038" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:19.238" grpc.time_ms=5.414 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2223gitlab # [ 262.127693] gitaly[922]: time="2026-09-06T06:50:19.331Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-06T06:50:29.239" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:50:19.330" grpc.time_ms=0.45 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2224gitlab # [ 262.172114] gitaly[922]: time="2026-09-06T06:50:19.375Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=342 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-06T06:50:29.275" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-06T06:50:19.366" grpc.time_ms=9.166 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2225gitlab # [ 262.207741] gitaly[922]: time="2026-09-06T06:50:19.411Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:29.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:19.399" grpc.time_ms=11.655 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2226gitlab # [ 262.231881] gitaly[922]: time="2026-09-06T06:50:19.435Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:29.031" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:19.421" grpc.time_ms=13.493 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2227gitlab # [ 262.275436] gitaly[922]: time="2026-09-06T06:50:19.478Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=963 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-06T06:50:49.256" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:19.456" grpc.time_ms=21.871 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2228gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2229gitlab # [ 262.678672] nixbot[2646]: INFO: ::ffff:127.0.0.1:58712 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2230gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.05 seconds)2231gitlab # [ 262.745830] gitaly[922]: time="2026-09-06T06:50:19.948Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-06T06:50:29.225" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:19.945" grpc.time_ms=2.721 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2232gitlab # [ 262.818358] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:20.020Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 a48ce982af387c0061ab3edad444e5a2a945c953 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"f86867208d844fa7963bb8d6","created_at":"2026-09-06T06:49:19.868Z","trace_propagation_headers":{"sentry-trace":"8b96c35fbf854110b8275979012ed13a-8ffcd318b63441af","baggage":"sentry-trace_id=8b96c35fbf854110b8275979012ed13a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN1EB5NXYDGD9BX1XK4TZ","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:19.890Z","job_size_bytes":185,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-f86867208d844fa7963bb8d6: done: 1.331595 sec","job_status":"done","queue_duration_s":58.798644,"scheduling_latency_s":58.798665,"gitaly_calls":13,"gitaly_duration_s":0.445424,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.075937,"redis_read_bytes":2103,"redis_write_bytes":21751,"redis_cache_calls":15,"redis_cache_duration_s":0.008281,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.011137,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002166,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7839,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004751,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.029601,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.020001,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.063,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.206,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.231,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.063,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.641351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000767137,"exclusive_lock_hold_duration_s":0.13316860200000002,"duration_s":1.331595,"completed_at":"2026-09-06T06:50:20.020Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.154501,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2233gitlab # [ 262.830459] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:20.023Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","a48ce982af387c0061ab3edad444e5a2a945c953 93214664af3f47b7fe6cc14cc480b997481ac1ac refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"291edffb051293f2dd467b31","created_at":"2026-09-06T06:49:25.081Z","trace_propagation_headers":{"sentry-trace":"1c86bf2fc8cc4087b5e72765d1746c66-8c5b0bd9946843c9","baggage":"sentry-trace_id=1c86bf2fc8cc4087b5e72765d1746c66,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN6QFF6G5M7FY0B45E9W7","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:25.083Z","job_size_bytes":185,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-291edffb051293f2dd467b31: start","job_status":"start","queue_duration_s":54.940006,"scheduling_latency_s":54.940047}2234gitlab # [ 262.858327] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:20.042Z","message":"changes: \"a48ce982af387c0061ab3edad444e5a2a945c953 93214664af3f47b7fe6cc14cc480b997481ac1ac refs/heads/master\\n\""}2235gitlab # [ 262.863769] gitaly[922]: time="2026-09-06T06:50:20.067Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:30.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:20.061" grpc.time_ms=5.972 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2236gitlab # [ 262.882235] gitaly[922]: time="2026-09-06T06:50:20.080Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-06T06:50:30.022" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:50:20.073" grpc.time_ms=7.029 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2237gitlab # [ 262.948580] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:20.085Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"b7ae14f9f21d582566398182","created_at":"2026-09-06T06:50:20.083Z","trace_propagation_headers":{"sentry-trace":"1c86bf2fc8cc4087b5e72765d1746c66-741482f6f4e841cc","baggage":"sentry-trace_id=1c86bf2fc8cc4087b5e72765d1746c66,sentry-release=Unknown"},"correlation_id":"01M1TQN6QFF6G5M7FY0B45E9W7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"51561f8d943322a0bd2ef780","job_size_bytes":46,"pid":2654,"job_status":"deduplicated","message":"ProjectCacheWorker JID-b7ae14f9f21d582566398182: deduplicated: until executing","deduplication.type":"until executing"}2238gitlab # [ 262.949765] gitaly[922]: time="2026-09-06T06:50:20.104Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-06T06:50:30.006" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:20.097" grpc.time_ms=6.72 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2239gitlab # [ 262.950870] gitaly[922]: time="2026-09-06T06:50:20.120Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-06T06:50:50.010" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:20.110" grpc.time_ms=9.724 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2240gitlab # [ 263.018237] gitaly[922]: time="2026-09-06T06:50:20.134Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=346 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-06T06:50:30.040" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-06T06:50:20.130" grpc.time_ms=3.879 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2241gitlab # [ 263.019718] gitaly[922]: time="2026-09-06T06:50:20.150Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:30.051" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:20.141" grpc.time_ms=8.983 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2242gitlab # [ 263.020836] gitaly[922]: time="2026-09-06T06:50:20.223Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-06T06:50:30.131" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:20.221" grpc.time_ms=1.457 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2243gitlab # [ 263.045113] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:20.248Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","a48ce982af387c0061ab3edad444e5a2a945c953 93214664af3f47b7fe6cc14cc480b997481ac1ac refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"291edffb051293f2dd467b31","created_at":"2026-09-06T06:49:25.081Z","trace_propagation_headers":{"sentry-trace":"1c86bf2fc8cc4087b5e72765d1746c66-8c5b0bd9946843c9","baggage":"sentry-trace_id=1c86bf2fc8cc4087b5e72765d1746c66,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN6QFF6G5M7FY0B45E9W7","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:49:25.083Z","job_size_bytes":185,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-291edffb051293f2dd467b31: done: 0.22464 sec","job_status":"done","queue_duration_s":54.940006,"scheduling_latency_s":54.940047,"gitaly_calls":7,"gitaly_duration_s":0.063128,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.029608,"redis_read_bytes":500,"redis_write_bytes":11942,"redis_cache_calls":9,"redis_cache_duration_s":0.003456,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.00139,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5719,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003933,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.01118,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.009649,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.02,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.02,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.115743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000729981,"exclusive_lock_hold_duration_s":0.017426796,"duration_s":0.22464,"completed_at":"2026-09-06T06:50:20.248Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027329,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2244gitlab # [ 263.117101] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:20.250Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"8e30c0864732f77f74332f52","created_at":"2026-09-06T06:49:25.438Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-bd7ddcbd8c044fe2","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:25.443Z","job_size_bytes":65,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-8e30c0864732f77f74332f52: start","job_status":"start","queue_duration_s":54.806459,"scheduling_latency_s":54.806484}2245gitlab # [ 263.130255] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:20.310Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"8e30c0864732f77f74332f52","created_at":"2026-09-06T06:49:25.438Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-bd7ddcbd8c044fe2","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:25.443Z","job_size_bytes":65,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-8e30c0864732f77f74332f52: done: 0.060183 sec","job_status":"done","queue_duration_s":54.806459,"scheduling_latency_s":54.806484,"redis_calls":16,"redis_duration_s":0.003532,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001774,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001343,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000415,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000362057,"duration_s":0.060183,"completed_at":"2026-09-06T06:50:20.310Z","load_balancing_strategy":"primary","db_duration_s":0.012083,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2246gitlab # [ 263.217166] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:20.311Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"3986b56ba9542a426847e520","created_at":"2026-09-06T06:49:25.444Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-bd7ddcbd8c044fe2","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:25.447Z","job_size_bytes":65,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-3986b56ba9542a426847e520: start","job_status":"start","queue_duration_s":54.863981,"scheduling_latency_s":54.864002}2247gitlab # [ 263.289477] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:20.379Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"3986b56ba9542a426847e520","created_at":"2026-09-06T06:49:25.444Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-bd7ddcbd8c044fe2","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:25.447Z","job_size_bytes":65,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-3986b56ba9542a426847e520: done: 0.068085 sec","job_status":"done","queue_duration_s":54.863981,"scheduling_latency_s":54.864002,"redis_calls":21,"redis_duration_s":0.004445,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.00189,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001315,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00124,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034753,"duration_s":0.068085,"completed_at":"2026-09-06T06:50:20.379Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016636,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2248gitlab # [ 263.300348] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:20.381Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"abcb056e32da96bd600a9d54","created_at":"2026-09-06T06:49:25.525Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-bd7ddcbd8c044fe2","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:25.531Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-abcb056e32da96bd600a9d54: start","job_status":"start","queue_duration_s":54.849684,"scheduling_latency_s":54.849704}2249gitlab # [ 263.324001] gitaly[922]: time="2026-09-06T06:50:20.505Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN7B1G40D4CJW8QRNF46G grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:20.504" grpc.time_ms=0.374 pid=922 span.kind=server system=grpc2250gitlab # [ 263.431701] gitaly[922]: time="2026-09-06T06:50:20.635Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN7B1G40D4CJW8QRNF46G grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:20.634" grpc.time_ms=1.133 pid=922 span.kind=server system=grpc2251gitlab # [ 263.488486] gitaly[922]: time="2026-09-06T06:50:20.691Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQN7B1G40D4CJW8QRNF46G grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:20.691" grpc.time_ms=0.38 pid=922 span.kind=server system=grpc2252gitlab # [ 263.512687] gitaly[922]: time="2026-09-06T06:50:20.716Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN7B1G40D4CJW8QRNF46G diskcache=472c15e1-d006-4715-a160-479240ed068f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:50:50.378" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:20.479" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2253gitlab # [ 263.514324] gitaly[922]: time="2026-09-06T06:50:20.716Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=133 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7505 command.oublock=0 command.real_time_ms=231 command.spawn_token_fork_ms=0 command.system_time_ms=97 command.user_time_ms=36 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN7B1G40D4CJW8QRNF46G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:50:50.378" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:20.479" grpc.time_ms=237.187 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2254gitlab # [ 263.612715] gitaly[922]: time="2026-09-06T06:50:20.816Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN7B1G40D4CJW8QRNF46G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-06T06:50:50.714" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:20.815" grpc.time_ms=0.986 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2255gitlab # [ 263.644904] gitaly[922]: time="2026-09-06T06:50:20.848Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN7B1G40D4CJW8QRNF46G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:50.747" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:20.847" grpc.time_ms=0.59 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2256gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2257gitlab # [ 263.654741] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:20.858Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"abcb056e32da96bd600a9d54","created_at":"2026-09-06T06:49:25.525Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-bd7ddcbd8c044fe2","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:25.531Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2654,"job_status":"rescheduled","message":"PipelineProcessWorker JID-abcb056e32da96bd600a9d54: rescheduled"}2258gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.04 seconds)2259gitlab # [ 263.662646] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:20.866Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"abcb056e32da96bd600a9d54","created_at":"2026-09-06T06:49:25.525Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-bd7ddcbd8c044fe2","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T06:49:25.531Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-abcb056e32da96bd600a9d54: done: 0.484573 sec","job_status":"done","queue_duration_s":54.849684,"scheduling_latency_s":54.849704,"gitaly_calls":3,"gitaly_duration_s":0.246329,"redis_calls":121,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.033986999999999996,"redis_read_bytes":336,"redis_write_bytes":29500,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00102,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001356,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":41,"redis_feature_flag_duration_s":0.012528,"redis_feature_flag_read_bytes":168,"redis_feature_flag_write_bytes":6785,"redis_queues_calls":27,"redis_queues_duration_s":0.005719,"redis_queues_read_bytes":39,"redis_queues_write_bytes":15583,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.007703,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000482,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001007,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003152,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":53,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":53,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":36,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.013,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.016,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.022,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.160314,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.436431726,"duration_s":0.484573,"completed_at":"2026-09-06T06:50:20.865Z","load_balancing_strategy":"primary","db_duration_s":0.056029,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2260gitlab # [ 263.749614] gitaly[922]: time="2026-09-06T06:50:20.907Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-06T12:50:20.904" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:50:20.904" grpc.time_ms=2.377 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2261gitlab # [ 263.751284] nixbot[2646]: INFO: ::ffff:127.0.0.1:37458 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2262gitlab # [ 263.752607] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:20.867Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"51561f8d943322a0bd2ef780","created_at":"2026-09-06T06:50:18.862Z","trace_propagation_headers":{"sentry-trace":"8b96c35fbf854110b8275979012ed13a-f7518f9635fa4bc7","baggage":"sentry-trace_id=8b96c35fbf854110b8275979012ed13a,sentry-release=Unknown"},"correlation_id":"01M1TQN1EB5NXYDGD9BX1XK4TZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:18.880Z","job_size_bytes":46,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-51561f8d943322a0bd2ef780: start","job_status":"start","queue_duration_s":1.987363,"scheduling_latency_s":1.987385}2263gitlab # [ 263.753804] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:20.940Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"51561f8d943322a0bd2ef780","created_at":"2026-09-06T06:50:18.862Z","trace_propagation_headers":{"sentry-trace":"8b96c35fbf854110b8275979012ed13a-f7518f9635fa4bc7","baggage":"sentry-trace_id=8b96c35fbf854110b8275979012ed13a,sentry-release=Unknown"},"correlation_id":"01M1TQN1EB5NXYDGD9BX1XK4TZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:18.880Z","job_size_bytes":46,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-51561f8d943322a0bd2ef780: done: 0.072754 sec","job_status":"done","queue_duration_s":1.987363,"scheduling_latency_s":1.987385,"gitaly_calls":2,"gitaly_duration_s":0.012852,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.008088,"redis_read_bytes":69,"redis_write_bytes":4882,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001541,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000493,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2115,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001968,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002987,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001099,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000376864,"duration_s":0.072754,"completed_at":"2026-09-06T06:50:20.940Z","load_balancing_strategy":"primary","db_duration_s":0.011581,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2264gitlab # [ 263.837356] gitaly[922]: time="2026-09-06T06:50:20.919Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-06T06:50:50.812" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:20.913" grpc.time_ms=6.512 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2265gitlab # [ 263.910382] gitaly[922]: time="2026-09-06T06:50:20.990Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ diskcache=084f8549-19cf-4e98-a7ec-f0f9c1eb2484 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-06T12:50:20.964" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:20.965" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2266gitlab # [ 263.912342] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:20.942Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"f981cc107e44d9b4d3a875f1","created_at":"2026-09-06T06:50:18.890Z","trace_propagation_headers":{"sentry-trace":"8b96c35fbf854110b8275979012ed13a-f7518f9635fa4bc7","baggage":"sentry-trace_id=8b96c35fbf854110b8275979012ed13a,sentry-release=Unknown"},"correlation_id":"01M1TQN1EB5NXYDGD9BX1XK4TZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:18.893Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-f981cc107e44d9b4d3a875f1: start","job_status":"start","queue_duration_s":2.048584,"scheduling_latency_s":2.048605}2267gitlab # [ 263.913367] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:21.016Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"f981cc107e44d9b4d3a875f1","created_at":"2026-09-06T06:50:18.890Z","trace_propagation_headers":{"sentry-trace":"8b96c35fbf854110b8275979012ed13a-f7518f9635fa4bc7","baggage":"sentry-trace_id=8b96c35fbf854110b8275979012ed13a,sentry-release=Unknown"},"correlation_id":"01M1TQN1EB5NXYDGD9BX1XK4TZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:18.893Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-f981cc107e44d9b4d3a875f1: done: 0.074534 sec","job_status":"done","queue_duration_s":2.048584,"scheduling_latency_s":2.048605,"gitaly_calls":1,"gitaly_duration_s":0.027602,"redis_calls":15,"redis_duration_s":0.0034779999999999998,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000471,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001303,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000677,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001027,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.013,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.052351904,"duration_s":0.074534,"completed_at":"2026-09-06T06:50:21.016Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014241,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2268gitlab # [ 263.985483] gitaly[922]: time="2026-09-06T06:50:20.990Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1283 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-06T12:50:20.964" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:20.965" grpc.time_ms=25.141 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2269gitlab # [ 263.986989] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:21.018Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"09a85dd529a1662036f31ce8","created_at":"2026-09-06T06:50:19.091Z","trace_propagation_headers":{"sentry-trace":"8b96c35fbf854110b8275979012ed13a-f7518f9635fa4bc7","baggage":"sentry-trace_id=8b96c35fbf854110b8275979012ed13a,sentry-release=Unknown"},"correlation_id":"01M1TQN1EB5NXYDGD9BX1XK4TZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:19.094Z","job_size_bytes":23,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-09a85dd529a1662036f31ce8: start","job_status":"start","queue_duration_s":1.92327,"scheduling_latency_s":1.92329}2270gitlab # [ 264.073211] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:21.056Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"09a85dd529a1662036f31ce8","created_at":"2026-09-06T06:50:19.091Z","trace_propagation_headers":{"sentry-trace":"8b96c35fbf854110b8275979012ed13a-f7518f9635fa4bc7","baggage":"sentry-trace_id=8b96c35fbf854110b8275979012ed13a,sentry-release=Unknown"},"correlation_id":"01M1TQN1EB5NXYDGD9BX1XK4TZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:19.094Z","job_size_bytes":23,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-09a85dd529a1662036f31ce8: done: 0.03883 sec","job_status":"done","queue_duration_s":1.92327,"scheduling_latency_s":1.92329,"gitaly_calls":1,"gitaly_duration_s":0.008932,"redis_calls":16,"redis_duration_s":0.004903,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000443,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001515,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002015,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00093,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020915,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03883,"completed_at":"2026-09-06T06:50:21.056Z","load_balancing_strategy":"primary","db_duration_s":0.001994,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2271gitlab # [ 264.081116] gitaly[922]: time="2026-09-06T06:50:21.048Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-06T06:50:51.041" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:21.041" grpc.time_ms=6.498 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2272gitlab # [ 264.101959] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:21.058Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"4ff8baca6a3de7a1b3467e86","created_at":"2026-09-06T06:50:19.753Z","trace_propagation_headers":{"sentry-trace":"8b96c35fbf854110b8275979012ed13a-f7518f9635fa4bc7","baggage":"sentry-trace_id=8b96c35fbf854110b8275979012ed13a,sentry-release=Unknown"},"correlation_id":"01M1TQN1EB5NXYDGD9BX1XK4TZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e7af7ef296e641af1f1949322eeb87a7e89bbd01d9e840e2ae8337e2f35a743f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:19.758Z","job_size_bytes":467,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-4ff8baca6a3de7a1b3467e86: start","job_status":"start","queue_duration_s":1.300812,"scheduling_latency_s":1.300842}2273gitlab # [ 264.174195] gitaly[922]: time="2026-09-06T06:50:21.144Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:51.043" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:21.143" grpc.time_ms=0.814 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2274gitlab # [ 264.175755] gitaly[922]: time="2026-09-06T06:50:21.262Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-06T06:50:31.096" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:21.146" grpc.time_ms=9.62 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2275gitlab # [ 264.176350] gitaly[922]: time="2026-09-06T06:50:21.353Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-06T06:50:51.252" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:21.353" grpc.time_ms=0.685 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2276gitlab # [ 264.244975] gitaly[922]: time="2026-09-06T06:50:21.410Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=17 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-06T06:50:51.307" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:21.408" grpc.time_ms=2.517 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2277gitlab # [ 264.348871] gitaly[922]: time="2026-09-06T06:50:21.552Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:31.154" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:21.545" grpc.time_ms=7.153 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2278gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2279gitlab # [ 264.768492] nixbot[2646]: INFO: ::ffff:127.0.0.1:37460 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2280gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.06 seconds)2281gitlab # [ 264.888270] gitaly[922]: time="2026-09-06T06:50:22.090Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-06T06:50:52.069" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:22.069" grpc.time_ms=21.011 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2282gitlab # [ 264.955640] gitaly[922]: time="2026-09-06T06:50:22.159Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN1EB5NXYDGD9BX1XK4TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-06T06:50:52.147" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:22.147" grpc.time_ms=11.277 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2283gitlab # [ 264.981189] sidekiq-cluster[2654]: {"severity":"WARN","time":"2026-09-06T06:50:22.183Z","class":"CreatePipelineWorker","correlation_id":"01M1TQN1EB5NXYDGD9BX1XK4TZ","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"a48ce982af387c0061ab3edad444e5a2a945c953","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"a48ce982af387c0061ab3edad444e5a2a945c953","ref":"refs/heads/master"},"retry":0}2284gitlab # [ 264.998491] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:22.201Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"4ff8baca6a3de7a1b3467e86","created_at":"2026-09-06T06:50:19.753Z","trace_propagation_headers":{"sentry-trace":"8b96c35fbf854110b8275979012ed13a-f7518f9635fa4bc7","baggage":"sentry-trace_id=8b96c35fbf854110b8275979012ed13a,sentry-release=Unknown"},"correlation_id":"01M1TQN1EB5NXYDGD9BX1XK4TZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e7af7ef296e641af1f1949322eeb87a7e89bbd01d9e840e2ae8337e2f35a743f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:19.758Z","job_size_bytes":467,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-4ff8baca6a3de7a1b3467e86: done: 1.142687 sec","job_status":"done","queue_duration_s":1.300812,"scheduling_latency_s":1.300842,"gitaly_calls":7,"gitaly_duration_s":0.356839,"redis_calls":51,"redis_duration_s":0.029056000000000002,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.002567,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.007087,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001932,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004622,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.012848,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.747899,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000546718,"duration_s":1.142687,"completed_at":"2026-09-06T06:50:22.201Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.054859,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2285gitlab # [ 265.007498] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:22.204Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"35ae2429-8e32-4e29-9c81-b9a6d81dfac2\"}"],"class":"WebHookWorker","jid":"cadcc426fc7479b3c7c46e41","created_at":"2026-09-06T06:50:19.915Z","trace_propagation_headers":{"sentry-trace":"8b96c35fbf854110b8275979012ed13a-f7518f9635fa4bc7","baggage":"sentry-trace_id=8b96c35fbf854110b8275979012ed13a,sentry-release=Unknown"},"correlation_id":"01M1TQN1EB5NXYDGD9BX1XK4TZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6717cb8257ba7f0b5d25fb3b646526a765566fc9439ee3ae45a136f4830d231b","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:19.921Z","job_size_bytes":1751,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-cadcc426fc7479b3c7c46e41: start","job_status":"start","queue_duration_s":2.282393,"scheduling_latency_s":2.282416}2286gitlab # [ 265.109859] nixbot[2646]: INFO: ::ffff:127.0.0.1:37462 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2287gitlab # [ 265.127209] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:22.330Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"35ae2429-8e32-4e29-9c81-b9a6d81dfac2\"}"],"class":"WebHookWorker","jid":"cadcc426fc7479b3c7c46e41","created_at":"2026-09-06T06:50:19.915Z","trace_propagation_headers":{"sentry-trace":"8b96c35fbf854110b8275979012ed13a-f7518f9635fa4bc7","baggage":"sentry-trace_id=8b96c35fbf854110b8275979012ed13a,sentry-release=Unknown"},"correlation_id":"01M1TQN1EB5NXYDGD9BX1XK4TZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6717cb8257ba7f0b5d25fb3b646526a765566fc9439ee3ae45a136f4830d231b","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:19.921Z","job_size_bytes":1751,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-cadcc426fc7479b3c7c46e41: done: 0.126172 sec","job_status":"done","queue_duration_s":2.282393,"scheduling_latency_s":2.282416,"redis_calls":19,"redis_duration_s":0.006231,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00135,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000317,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003007,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001557,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.03550786499999958,"cpu_s":0.072673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000655111,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.126172,"completed_at":"2026-09-06T06:50:22.330Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003903,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2288gitlab # [ 265.205530] gitaly[922]: time="2026-09-06T06:50:22.409Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQPZ7ZH3715NDDF459CPJ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:22.395" grpc.time_ms=13.165 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2289gitlab # [ 265.208355] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:22 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 732290gitlab # [ 265.210286] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:22.411Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"44af85d5f7444cf4df46a52d","created_at":"2026-09-06T06:50:20.090Z","trace_propagation_headers":{"sentry-trace":"1c86bf2fc8cc4087b5e72765d1746c66-741482f6f4e841cc","baggage":"sentry-trace_id=1c86bf2fc8cc4087b5e72765d1746c66,sentry-release=Unknown"},"correlation_id":"01M1TQN6QFF6G5M7FY0B45E9W7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"f981cc107e44d9b4d3a875f1","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.091Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-44af85d5f7444cf4df46a52d: start","job_status":"start","queue_duration_s":2.318938,"scheduling_latency_s":2.319041}2291gitlab # [ 265.267584] gitaly[922]: time="2026-09-06T06:50:22.471Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 diskcache=6bf5f879-3035-4459-99a1-716dd647208a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-06T12:50:22.435" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:22.436" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2292gitlab # [ 265.268929] gitaly[922]: time="2026-09-06T06:50:22.471Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=317 command.oublock=0 command.real_time_ms=27 command.spawn_token_fork_ms=22 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-06T12:50:22.435" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:22.436" grpc.time_ms=34.892 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2293gitlab # [ 265.332788] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:22.535Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"44af85d5f7444cf4df46a52d","created_at":"2026-09-06T06:50:20.090Z","trace_propagation_headers":{"sentry-trace":"1c86bf2fc8cc4087b5e72765d1746c66-741482f6f4e841cc","baggage":"sentry-trace_id=1c86bf2fc8cc4087b5e72765d1746c66,sentry-release=Unknown"},"correlation_id":"01M1TQN6QFF6G5M7FY0B45E9W7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"f981cc107e44d9b4d3a875f1","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.091Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-44af85d5f7444cf4df46a52d: done: 0.12502 sec","job_status":"done","queue_duration_s":2.318938,"scheduling_latency_s":2.319041,"gitaly_calls":1,"gitaly_duration_s":0.073724,"redis_calls":12,"redis_duration_s":0.005030000000000001,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002011,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001182,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001837,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.01,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.01,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.095381116,"duration_s":0.12502,"completed_at":"2026-09-06T06:50:22.535Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009082,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2294gitlab # [ 265.336637] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:22.538Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"a519cac88738507967e05bbd","created_at":"2026-09-06T06:50:20.195Z","trace_propagation_headers":{"sentry-trace":"1c86bf2fc8cc4087b5e72765d1746c66-741482f6f4e841cc","baggage":"sentry-trace_id=1c86bf2fc8cc4087b5e72765d1746c66,sentry-release=Unknown"},"correlation_id":"01M1TQN6QFF6G5M7FY0B45E9W7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9d2b44fb793e4ea6369d2ac7400f575e065e6e4012012db36e85f6c3580b54dd","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.197Z","job_size_bytes":467,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-a519cac88738507967e05bbd: start","job_status":"start","queue_duration_s":2.340431,"scheduling_latency_s":2.340471}2295gitlab # [ 265.364528] gitaly[922]: time="2026-09-06T06:50:22.564Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:52.463" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:22.563" grpc.time_ms=1.014 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2296gitlab # [ 265.435253] gitaly[922]: time="2026-09-06T06:50:22.572Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-06T06:50:32.176" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:22.566" grpc.time_ms=5.997 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2297gitlab # [ 265.436718] gitaly[922]: time="2026-09-06T06:50:22.597Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-06T06:50:52.495" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:22.596" grpc.time_ms=0.769 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2298gitlab # [ 265.437336] gitaly[922]: time="2026-09-06T06:50:22.601Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=49 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-06T06:50:52.499" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:22.599" grpc.time_ms=2.113 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2299gitlab # [ 265.505944] gitaly[922]: time="2026-09-06T06:50:22.707Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:32.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:22.701" grpc.time_ms=5.885 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2300gitlab # [ 265.572553] gitaly[922]: time="2026-09-06T06:50:22.776Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZABNHC0VR0F7AYQ4ZYV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:22.761" pid=922 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2301gitlab # [ 265.574581] gitaly[922]: time="2026-09-06T06:50:22.776Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZABNHC0VR0F7AYQ4ZYV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:22.761" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2302gitlab # [ 265.610196] gitaly[922]: time="2026-09-06T06:50:22.776Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZABNHC0VR0F7AYQ4ZYV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:22.761" grpc.time_ms=14.612 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2303gitlab # [ 265.611994] gitlab-workhorse[828]: time="2026-09-06T06:50:22Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672304gitlab # [ 265.636632] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:22 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 4022305gitlab # [ 265.673746] nixbot[2646]: {"ts": "2026-09-06T06:50:22.877Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2306gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2307gitlab # [ 265.771852] gitaly[922]: time="2026-09-06T06:50:22.975Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZSQP0XT9NH4E8S40MSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:52.072" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:22.973" grpc.time_ms=1.143 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2308gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.06 seconds)2309gitlab # [ 265.824138] gitaly[922]: time="2026-09-06T06:50:23.026Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-06T06:50:53.012" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:23.012" grpc.time_ms=12.622 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2310gitlab # [ 265.833952] nixbot[2646]: INFO: ::ffff:127.0.0.1:37472 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2311gitlab # [ 265.860130] gitaly[922]: time="2026-09-06T06:50:23.063Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=26 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQN6QFF6G5M7FY0B45E9W7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-06T06:50:53.028" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:23.029" grpc.time_ms=34.582 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2312gitlab # [ 265.871340] sidekiq-cluster[2654]: {"severity":"WARN","time":"2026-09-06T06:50:23.074Z","class":"CreatePipelineWorker","correlation_id":"01M1TQN6QFF6G5M7FY0B45E9W7","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"a48ce982af387c0061ab3edad444e5a2a945c953","after":"93214664af3f47b7fe6cc14cc480b997481ac1ac","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"93214664af3f47b7fe6cc14cc480b997481ac1ac","ref":"refs/heads/master"},"retry":0}2313gitlab # [ 265.876053] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.079Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"a519cac88738507967e05bbd","created_at":"2026-09-06T06:50:20.195Z","trace_propagation_headers":{"sentry-trace":"1c86bf2fc8cc4087b5e72765d1746c66-741482f6f4e841cc","baggage":"sentry-trace_id=1c86bf2fc8cc4087b5e72765d1746c66,sentry-release=Unknown"},"correlation_id":"01M1TQN6QFF6G5M7FY0B45E9W7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9d2b44fb793e4ea6369d2ac7400f575e065e6e4012012db36e85f6c3580b54dd","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.197Z","job_size_bytes":467,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-a519cac88738507967e05bbd: done: 0.541173 sec","job_status":"done","queue_duration_s":2.340431,"scheduling_latency_s":2.340471,"gitaly_calls":7,"gitaly_duration_s":0.157608,"redis_calls":33,"redis_duration_s":0.004832,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000638,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00124,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002092,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000862,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.435319,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.541173,"completed_at":"2026-09-06T06:50:23.079Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017124,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2314gitlab # [ 265.897082] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.081Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"5765b388-3db9-4030-93f4-f6d8300f3ab5\"}"],"class":"WebHookWorker","jid":"062e0a35e873cd842bc9d4b2","created_at":"2026-09-06T06:50:20.209Z","trace_propagation_headers":{"sentry-trace":"1c86bf2fc8cc4087b5e72765d1746c66-741482f6f4e841cc","baggage":"sentry-trace_id=1c86bf2fc8cc4087b5e72765d1746c66,sentry-release=Unknown"},"correlation_id":"01M1TQN6QFF6G5M7FY0B45E9W7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c6d7f91372de8d7ba9bd8d6b180a6daddbbd8d0aa48ca3e8df96f4fc4ccd7ccd","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.211Z","job_size_bytes":1749,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-062e0a35e873cd842bc9d4b2: start","job_status":"start","queue_duration_s":2.869614,"scheduling_latency_s":2.869638}2315gitlab # [ 265.971477] nixbot[2646]: INFO: ::ffff:127.0.0.1:37480 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2316gitlab # [ 265.972420] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.175Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"5765b388-3db9-4030-93f4-f6d8300f3ab5\"}"],"class":"WebHookWorker","jid":"062e0a35e873cd842bc9d4b2","created_at":"2026-09-06T06:50:20.209Z","trace_propagation_headers":{"sentry-trace":"1c86bf2fc8cc4087b5e72765d1746c66-741482f6f4e841cc","baggage":"sentry-trace_id=1c86bf2fc8cc4087b5e72765d1746c66,sentry-release=Unknown"},"correlation_id":"01M1TQN6QFF6G5M7FY0B45E9W7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c6d7f91372de8d7ba9bd8d6b180a6daddbbd8d0aa48ca3e8df96f4fc4ccd7ccd","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.211Z","job_size_bytes":1749,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-062e0a35e873cd842bc9d4b2: done: 0.094459 sec","job_status":"done","queue_duration_s":2.869614,"scheduling_latency_s":2.869638,"redis_calls":14,"redis_duration_s":0.004739,"redis_read_bytes":26,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.000286,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00247,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001983,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.005450134000000162,"cpu_s":0.078098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.094459,"completed_at":"2026-09-06T06:50:23.175Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001656,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2317gitlab # [ 266.051756] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.178Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"cab04e625db0ae8aefb4a7ae","created_at":"2026-09-06T06:50:20.466Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.470Z","job_size_bytes":23,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-cab04e625db0ae8aefb4a7ae: start","job_status":"start","queue_duration_s":2.708508,"scheduling_latency_s":2.708533}2318gitlab # [ 266.052910] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.239Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"cab04e625db0ae8aefb4a7ae","created_at":"2026-09-06T06:50:20.466Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.470Z","job_size_bytes":23,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-cab04e625db0ae8aefb4a7ae: done: 0.060518 sec","job_status":"done","queue_duration_s":2.708508,"scheduling_latency_s":2.708533,"redis_calls":10,"redis_duration_s":0.002386,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000515,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001398,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000473,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000396698,"duration_s":0.060518,"completed_at":"2026-09-06T06:50:23.239Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011281,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2319gitlab # [ 266.096087] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.241Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"9fe5a2e327a4acf18c3659de","created_at":"2026-09-06T06:50:20.721Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.725Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-9fe5a2e327a4acf18c3659de: start","job_status":"start","queue_duration_s":2.515483,"scheduling_latency_s":2.515504}2320gitlab # [ 266.172297] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.268Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"9fe5a2e327a4acf18c3659de","created_at":"2026-09-06T06:50:20.721Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.725Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-9fe5a2e327a4acf18c3659de: done: 0.027067 sec","job_status":"done","queue_duration_s":2.515483,"scheduling_latency_s":2.515504,"redis_calls":10,"redis_duration_s":0.002525,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000758,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001291,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000476,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000361777,"duration_s":0.027067,"completed_at":"2026-09-06T06:50:23.268Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003912,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2321gitlab # [ 266.257624] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.269Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"7de3ebe294c2612836c6a43b","created_at":"2026-09-06T06:50:20.735Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.741Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-7de3ebe294c2612836c6a43b: start","job_status":"start","queue_duration_s":2.527608,"scheduling_latency_s":2.527628}2322gitlab # [ 266.258997] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.296Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"7de3ebe294c2612836c6a43b","created_at":"2026-09-06T06:50:20.735Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.741Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-7de3ebe294c2612836c6a43b: done: 0.027099 sec","job_status":"done","queue_duration_s":2.527608,"scheduling_latency_s":2.527628,"redis_calls":10,"redis_duration_s":0.002145,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000412,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001281,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000452,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035647,"duration_s":0.027099,"completed_at":"2026-09-06T06:50:23.296Z","load_balancing_strategy":"primary","db_duration_s":0.004068,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2323gitlab # [ 266.328189] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.298Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"e27e996adc4c57ab04490d82","created_at":"2026-09-06T06:50:20.754Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.758Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e27e996adc4c57ab04490d82: start","job_status":"start","queue_duration_s":2.539858,"scheduling_latency_s":2.539887}2324gitlab # [ 266.329413] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.327Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"e27e996adc4c57ab04490d82","created_at":"2026-09-06T06:50:20.754Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.758Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e27e996adc4c57ab04490d82: done: 0.029605 sec","job_status":"done","queue_duration_s":2.539858,"scheduling_latency_s":2.539887,"redis_calls":13,"redis_duration_s":0.002736,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000409,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001283,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000639,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000405,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000372952,"duration_s":0.029605,"completed_at":"2026-09-06T06:50:23.327Z","load_balancing_strategy":"primary","db_duration_s":0.004031,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2325gitlab # [ 266.445314] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.329Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c985019eef10909d1c5ea2fc","created_at":"2026-09-06T06:50:20.758Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.762Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c985019eef10909d1c5ea2fc: start","job_status":"start","queue_duration_s":2.566366,"scheduling_latency_s":2.566385}2326gitlab # [ 266.446813] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.355Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c985019eef10909d1c5ea2fc","created_at":"2026-09-06T06:50:20.758Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.762Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c985019eef10909d1c5ea2fc: done: 0.026022 sec","job_status":"done","queue_duration_s":2.566366,"scheduling_latency_s":2.566385,"redis_calls":10,"redis_duration_s":0.002164,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00041,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001304,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00045,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000385524,"duration_s":0.026022,"completed_at":"2026-09-06T06:50:23.355Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003552,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2327gitlab # [ 266.529615] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.356Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"4ad5388277cb920803f799cc","created_at":"2026-09-06T06:50:20.763Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.768Z","job_size_bytes":19,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-4ad5388277cb920803f799cc: start","job_status":"start","queue_duration_s":2.588511,"scheduling_latency_s":2.588531}2328gitlab # [ 266.530685] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.380Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"4ad5388277cb920803f799cc","created_at":"2026-09-06T06:50:20.763Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.768Z","job_size_bytes":19,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-4ad5388277cb920803f799cc: done: 0.024059 sec","job_status":"done","queue_duration_s":2.588511,"scheduling_latency_s":2.588531,"redis_calls":11,"redis_duration_s":0.002346,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000399,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001505,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000442,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015135,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000341943,"duration_s":0.024059,"completed_at":"2026-09-06T06:50:23.380Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002786,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2329gitlab # [ 266.606074] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.382Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"38331cef6102c6784be44867","created_at":"2026-09-06T06:50:20.770Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.774Z","job_size_bytes":66,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-38331cef6102c6784be44867: start","job_status":"start","queue_duration_s":2.607843,"scheduling_latency_s":2.607863}2330gitlab # [ 266.607379] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.513Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"38331cef6102c6784be44867","created_at":"2026-09-06T06:50:20.770Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.774Z","job_size_bytes":66,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-38331cef6102c6784be44867: done: 0.131023 sec","job_status":"done","queue_duration_s":2.607843,"scheduling_latency_s":2.607863,"redis_calls":10,"redis_duration_s":0.0025050000000000003,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000591,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001492,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000422,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.105,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.102,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019244,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000415696,"duration_s":0.131023,"completed_at":"2026-09-06T06:50:23.512Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.10533,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2331gitlab # [ 266.683309] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.514Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"6a2dd0fd83b91c17790e1c33","created_at":"2026-09-06T06:50:20.775Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.778Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-6a2dd0fd83b91c17790e1c33: start","job_status":"start","queue_duration_s":2.735581,"scheduling_latency_s":2.735602}2332gitlab # [ 266.692702] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.546Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"6a2dd0fd83b91c17790e1c33","created_at":"2026-09-06T06:50:20.775Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.778Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-6a2dd0fd83b91c17790e1c33: done: 0.031559 sec","job_status":"done","queue_duration_s":2.735581,"scheduling_latency_s":2.735602,"redis_calls":10,"redis_duration_s":0.002339,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000462,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001343,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000534,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000347809,"duration_s":0.031559,"completed_at":"2026-09-06T06:50:23.545Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004257,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2333gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2334gitlab # [ 266.784313] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.547Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"e20c8b37d6a8a53f1c83b782","created_at":"2026-09-06T06:50:20.784Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.788Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-e20c8b37d6a8a53f1c83b782: start","job_status":"start","queue_duration_s":2.758988,"scheduling_latency_s":2.75901}2335gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.03 seconds)2336gitlab # [ 266.852431] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.576Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"e20c8b37d6a8a53f1c83b782","created_at":"2026-09-06T06:50:20.784Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.788Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-e20c8b37d6a8a53f1c83b782: done: 0.02922 sec","job_status":"done","queue_duration_s":2.758988,"scheduling_latency_s":2.75901,"redis_calls":10,"redis_duration_s":0.002164,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000406,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001346,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000412,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000389714,"duration_s":0.02922,"completed_at":"2026-09-06T06:50:23.576Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006886,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2337gitlab # [ 266.855267] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.577Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"5c86df8c571f33cfe751f63e","created_at":"2026-09-06T06:50:20.789Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.792Z","job_size_bytes":6,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-5c86df8c571f33cfe751f63e: start","job_status":"start","queue_duration_s":2.785274,"scheduling_latency_s":2.785294}2338gitlab # [ 266.923091] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.597Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"5c86df8c571f33cfe751f63e","created_at":"2026-09-06T06:50:20.789Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.792Z","job_size_bytes":6,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-5c86df8c571f33cfe751f63e: done: 0.019835 sec","job_status":"done","queue_duration_s":2.785274,"scheduling_latency_s":2.785294,"redis_calls":10,"redis_duration_s":0.002114,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000435,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001273,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000406,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000381892,"duration_s":0.019835,"completed_at":"2026-09-06T06:50:23.597Z","load_balancing_strategy":"primary","db_duration_s":0.001648,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2339gitlab # [ 267.007313] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.599Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"9f5e1e6546222138a4251ada","created_at":"2026-09-06T06:50:20.793Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.797Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-9f5e1e6546222138a4251ada: start","job_status":"start","queue_duration_s":2.802038,"scheduling_latency_s":2.802058}2340gitlab # [ 267.008707] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.626Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"9f5e1e6546222138a4251ada","created_at":"2026-09-06T06:50:20.793Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.797Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-9f5e1e6546222138a4251ada: done: 0.027864 sec","job_status":"done","queue_duration_s":2.802038,"scheduling_latency_s":2.802058,"redis_calls":10,"redis_duration_s":0.0021130000000000003,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000455,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001244,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000414,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017732,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033887,"duration_s":0.027864,"completed_at":"2026-09-06T06:50:23.626Z","load_balancing_strategy":"primary","db_duration_s":0.004761,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2341gitlab # [ 267.080330] nixbot[2646]: INFO: ::ffff:127.0.0.1:37482 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2342gitlab # [ 267.081448] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.628Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"67f45554efd018d9d5de5871","created_at":"2026-09-06T06:50:20.801Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.805Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-67f45554efd018d9d5de5871: start","job_status":"start","queue_duration_s":2.822633,"scheduling_latency_s":2.822654}2343gitlab # [ 267.082271] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.675Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"67f45554efd018d9d5de5871","created_at":"2026-09-06T06:50:20.801Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.805Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-67f45554efd018d9d5de5871: done: 0.046767 sec","job_status":"done","queue_duration_s":2.822633,"scheduling_latency_s":2.822654,"redis_calls":14,"redis_duration_s":0.003397,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00041,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001624,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001363,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000344736,"duration_s":0.046767,"completed_at":"2026-09-06T06:50:23.675Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00933,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2344gitlab # [ 267.182286] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.676Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"25d1c6242215ea8e42226df9","created_at":"2026-09-06T06:50:20.858Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.859Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-25d1c6242215ea8e42226df9: start","job_status":"start","queue_duration_s":2.816497,"scheduling_latency_s":2.816517}2345gitlab # [ 267.183685] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.697Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"25d1c6242215ea8e42226df9","created_at":"2026-09-06T06:50:20.858Z","trace_propagation_headers":{"sentry-trace":"8544b7be8e614bebb0c992e2ac21f364-f6549c6055c445e0","baggage":"sentry-trace_id=8544b7be8e614bebb0c992e2ac21f364,sentry-release=Unknown"},"correlation_id":"01M1TQN7B1G40D4CJW8QRNF46G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.859Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-25d1c6242215ea8e42226df9: done: 0.021283 sec","job_status":"done","queue_duration_s":2.816497,"scheduling_latency_s":2.816517,"redis_calls":8,"redis_duration_s":0.0017729999999999998,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001377,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000396,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021283,"completed_at":"2026-09-06T06:50:23.697Z","load_balancing_strategy":"primary","db_duration_s":0.002905,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2346gitlab # [ 267.266110] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.699Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"34a2e2295ef5cf4cfdb1b376","created_at":"2026-09-06T06:50:20.927Z","trace_propagation_headers":{"sentry-trace":"8b96c35fbf854110b8275979012ed13a-b1fe8960e0554563","baggage":"sentry-trace_id=8b96c35fbf854110b8275979012ed13a,sentry-release=Unknown"},"correlation_id":"01M1TQN1EB5NXYDGD9BX1XK4TZ","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.931Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-34a2e2295ef5cf4cfdb1b376: start","job_status":"start","queue_duration_s":2.76789,"scheduling_latency_s":2.767911}2347gitlab # [ 267.267412] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.734Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"34a2e2295ef5cf4cfdb1b376","created_at":"2026-09-06T06:50:20.927Z","trace_propagation_headers":{"sentry-trace":"8b96c35fbf854110b8275979012ed13a-b1fe8960e0554563","baggage":"sentry-trace_id=8b96c35fbf854110b8275979012ed13a,sentry-release=Unknown"},"correlation_id":"01M1TQN1EB5NXYDGD9BX1XK4TZ","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:20.931Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-34a2e2295ef5cf4cfdb1b376: done: 0.035588 sec","job_status":"done","queue_duration_s":2.76789,"scheduling_latency_s":2.767911,"redis_calls":19,"redis_duration_s":0.004131,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000872,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000637,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001937,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000685,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006342146999999999,"duration_s":0.035588,"completed_at":"2026-09-06T06:50:23.734Z","load_balancing_strategy":"primary","db_duration_s":0.005283,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2348gitlab # [ 267.344994] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.736Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","cadcc426fc7479b3c7c46e41"],"class":"WebHooks::LogExecutionWorker","jid":"abd9a04f75cb9b237dc5255b","created_at":"2026-09-06T06:50:22.316Z","trace_propagation_headers":{"sentry-trace":"8b96c35fbf854110b8275979012ed13a-ea2a0a0815aa4a54","baggage":"sentry-trace_id=8b96c35fbf854110b8275979012ed13a,sentry-release=Unknown"},"correlation_id":"01M1TQN1EB5NXYDGD9BX1XK4TZ","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:74b32aa8efb5e4ba0e1da68bec8c69637020ad3fb6d037f8a77a71f33ae37902","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:22.322Z","job_size_bytes":2593,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-abd9a04f75cb9b237dc5255b: start","job_status":"start","queue_duration_s":1.414136,"scheduling_latency_s":1.414157}2349gitlab # [ 267.346280] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.769Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","cadcc426fc7479b3c7c46e41"],"class":"WebHooks::LogExecutionWorker","jid":"abd9a04f75cb9b237dc5255b","created_at":"2026-09-06T06:50:22.316Z","trace_propagation_headers":{"sentry-trace":"8b96c35fbf854110b8275979012ed13a-ea2a0a0815aa4a54","baggage":"sentry-trace_id=8b96c35fbf854110b8275979012ed13a,sentry-release=Unknown"},"correlation_id":"01M1TQN1EB5NXYDGD9BX1XK4TZ","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:74b32aa8efb5e4ba0e1da68bec8c69637020ad3fb6d037f8a77a71f33ae37902","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:22.322Z","job_size_bytes":2593,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-abd9a04f75cb9b237dc5255b: done: 0.033799 sec","job_status":"done","queue_duration_s":1.414136,"scheduling_latency_s":1.414157,"redis_calls":10,"redis_duration_s":0.002104,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000402,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001295,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000407,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000342501,"duration_s":0.033799,"completed_at":"2026-09-06T06:50:23.769Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005581,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2350gitlab # [ 267.422466] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.771Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","062e0a35e873cd842bc9d4b2"],"class":"WebHooks::LogExecutionWorker","jid":"c4924f91ae2e0d6c0bceb78e","created_at":"2026-09-06T06:50:23.166Z","trace_propagation_headers":{"sentry-trace":"1c86bf2fc8cc4087b5e72765d1746c66-1557fca21ebf4a55","baggage":"sentry-trace_id=1c86bf2fc8cc4087b5e72765d1746c66,sentry-release=Unknown"},"correlation_id":"01M1TQN6QFF6G5M7FY0B45E9W7","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:eb2235def4a0788c6e5f25b5b12172dbf8f0e20679f41a6f37ead28528debe53","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.168Z","job_size_bytes":2592,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-c4924f91ae2e0d6c0bceb78e: start","job_status":"start","queue_duration_s":0.603147,"scheduling_latency_s":0.603168}2351gitlab # [ 267.502111] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.795Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","062e0a35e873cd842bc9d4b2"],"class":"WebHooks::LogExecutionWorker","jid":"c4924f91ae2e0d6c0bceb78e","created_at":"2026-09-06T06:50:23.166Z","trace_propagation_headers":{"sentry-trace":"1c86bf2fc8cc4087b5e72765d1746c66-1557fca21ebf4a55","baggage":"sentry-trace_id=1c86bf2fc8cc4087b5e72765d1746c66,sentry-release=Unknown"},"correlation_id":"01M1TQN6QFF6G5M7FY0B45E9W7","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:eb2235def4a0788c6e5f25b5b12172dbf8f0e20679f41a6f37ead28528debe53","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.168Z","job_size_bytes":2592,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-c4924f91ae2e0d6c0bceb78e: done: 0.02374 sec","job_status":"done","queue_duration_s":0.603147,"scheduling_latency_s":0.603168,"redis_calls":7,"redis_duration_s":0.001544,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001119,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000425,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02374,"completed_at":"2026-09-06T06:50:23.795Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003158,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2352gitlab # [ 267.571169] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.796Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"0f8dd41ce6056644f7a28f89","created_at":"2026-09-06T06:50:23.723Z","trace_propagation_headers":{"sentry-trace":"8b96c35fbf854110b8275979012ed13a-28ce58d5d7884c29","baggage":"sentry-trace_id=8b96c35fbf854110b8275979012ed13a,sentry-release=Unknown"},"correlation_id":"01M1TQN1EB5NXYDGD9BX1XK4TZ","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.727Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-0f8dd41ce6056644f7a28f89: start","job_status":"start","queue_duration_s":0.068568,"scheduling_latency_s":0.068589}2353gitlab # [ 267.572443] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:23.859Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"0f8dd41ce6056644f7a28f89","created_at":"2026-09-06T06:50:23.723Z","trace_propagation_headers":{"sentry-trace":"8b96c35fbf854110b8275979012ed13a-28ce58d5d7884c29","baggage":"sentry-trace_id=8b96c35fbf854110b8275979012ed13a,sentry-release=Unknown"},"correlation_id":"01M1TQN1EB5NXYDGD9BX1XK4TZ","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:23.727Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-0f8dd41ce6056644f7a28f89: done: 0.063245 sec","job_status":"done","queue_duration_s":0.068568,"scheduling_latency_s":0.068589,"redis_calls":11,"redis_duration_s":0.0024200000000000003,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0004,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001551,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000469,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000395861,"duration_s":0.063245,"completed_at":"2026-09-06T06:50:23.859Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015534,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2354gitlab # [ 267.679388] gitaly[922]: time="2026-09-06T06:50:24.881Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=1817 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQPZSQP0XT9NH4E8S40MSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:33.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:23.063" grpc.time_ms=1818.183 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2355gitlab # [ 267.681691] gitaly[922]: time="2026-09-06T06:50:24.884Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ02M6FSGVAT0AFW5QAG7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:24.878" grpc.time_ms=6.263 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2356gitlab # [ 267.684979] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:24 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 16962357gitlab # [ 267.721114] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:24.922Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"5285ff574215f42dfdc7705a","created_at":"2026-09-06T06:50:24.914Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-5d49c23c3ccd4ddd","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:24.919Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5285ff574215f42dfdc7705a: start","job_status":"start","queue_duration_s":0.003611,"scheduling_latency_s":0.003645}2358gitlab # [ 267.740787] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a48ce982af387c0061ab3edad444e5a2a945c953 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 20402359gitlab # [ 267.743562] gitlab-workhorse[828]: time="2026-09-06T06:50:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672360gitlab # [ 267.744641] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:24 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 582361gitlab # [ 267.745814] gitaly[922]: time="2026-09-06T06:50:24.945Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ1QQVDD2A2W3VJYS5AN2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:24.935" pid=922 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2362gitlab # [ 267.746983] nixbot[2646]: {"ts": "2026-09-06T06:50:24.947Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a48ce982af387c0061ab3edad444e5a2a945c953 \"HTTP/1.1 201 Created\""}2363gitlab # [ 267.748244] gitaly[922]: time="2026-09-06T06:50:24.945Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ1QQVDD2A2W3VJYS5AN2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:24.935" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2364gitlab # [ 267.749291] gitaly[922]: time="2026-09-06T06:50:24.946Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ1QQVDD2A2W3VJYS5AN2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:24.935" grpc.time_ms=10.178 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2365gitlab # [ 267.802985] gitaly[922]: time="2026-09-06T06:50:25.006Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ1SP0SZRYVK8ZY6ZYRHM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:55.004" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:25.005" grpc.time_ms=0.768 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2366gitlab # [ 267.826307] gitaly[922]: time="2026-09-06T06:50:25.026Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQPZSQP0XT9NH4E8S40MSX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:25.025" grpc.time_ms=0.505 pid=922 span.kind=server system=grpc2367gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2368gitlab # [ 267.841681] gitaly[922]: time="2026-09-06T06:50:25.045Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ1SP0SZRYVK8ZY6ZYRHM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:35.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:25.039" grpc.time_ms=5.75 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2369gitlab # [ 267.886973] gitaly[922]: time="2026-09-06T06:50:25.090Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQPZSQP0XT9NH4E8S40MSX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:25.089" grpc.time_ms=0.804 pid=922 span.kind=server system=grpc2370gitlab # [ 267.906329] nixbot[2646]: INFO: ::ffff:127.0.0.1:37490 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2371gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 0.04 seconds)2372gitlab # [ 267.919099] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a48ce982af387c0061ab3edad444e5a2a945c953 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1712373gitlab # [ 267.920819] nixbot[2646]: {"ts": "2026-09-06T06:50:25.124Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a48ce982af387c0061ab3edad444e5a2a945c953 \"HTTP/1.1 201 Created\""}2374gitlab # [ 267.922134] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:25 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 762375gitlab # [ 267.922931] gitaly[922]: time="2026-09-06T06:50:25.125Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ1WRSZ9AXTB64W5QAATT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:25.111" grpc.time_ms=12.287 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2376gitlab # [ 267.949528] gitaly[922]: time="2026-09-06T06:50:25.153Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQPZSQP0XT9NH4E8S40MSX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:25.152" grpc.time_ms=0.735 pid=922 span.kind=server system=grpc2377gitlab # [ 267.976107] gitaly[922]: time="2026-09-06T06:50:25.179Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZSQP0XT9NH4E8S40MSX diskcache=7ce7c94f-3d03-4a58-b89d-eaa11862470a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:50:54.894" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:24.995" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2378gitlab # [ 267.991697] gitaly[922]: time="2026-09-06T06:50:25.195Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=105 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7025 command.oublock=0 command.real_time_ms=175 command.spawn_token_fork_ms=1 command.system_time_ms=78 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZSQP0XT9NH4E8S40MSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:50:54.894" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:24.995" grpc.time_ms=184.414 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2379gitlab # [ 267.994939] gitaly[922]: time="2026-09-06T06:50:25.198Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ1Z644J11R7A161SSB7R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:25.178" pid=922 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2380gitlab # [ 267.996088] gitaly[922]: time="2026-09-06T06:50:25.198Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=6 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ1Z644J11R7A161SSB7R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:25.178" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2381gitlab # [ 267.998745] gitaly[922]: time="2026-09-06T06:50:25.199Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=6 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ1Z644J11R7A161SSB7R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:25.178" grpc.time_ms=20.405 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2382gitlab # [ 268.001957] gitlab-workhorse[828]: time="2026-09-06T06:50:25Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672383gitlab # [ 268.005049] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:25 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 732384gitlab # [ 268.015049] gitaly[922]: time="2026-09-06T06:50:25.218Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ1ZDK99C49CMZHRTP3X1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:55.216" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:25.217" grpc.time_ms=0.876 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2385gitlab # [ 268.034892] gitaly[922]: time="2026-09-06T06:50:25.238Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQPZSQP0XT9NH4E8S40MSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-06T06:50:55.137" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:25.237" grpc.time_ms=0.751 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2386gitlab # [ 268.103391] gitaly[922]: time="2026-09-06T06:50:25.255Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ1ZDK99C49CMZHRTP3X1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:35.189" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:25.249" grpc.time_ms=5.971 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2387gitlab # [ 268.105281] nixbot[2646]: {"ts": "2026-09-06T06:50:25.290Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a48ce982af387c0061ab3edad444e5a2a945c953 \"HTTP/1.1 201 Created\""}2388gitlab # [ 268.106203] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a48ce982af387c0061ab3edad444e5a2a945c953 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1562389gitlab # [ 268.173903] gitaly[922]: time="2026-09-06T06:50:25.377Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZSQP0XT9NH4E8S40MSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:55.276" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:25.376" grpc.time_ms=0.815 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2390gitlab # [ 268.185709] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.388Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"dee402304d588efd05728d80","created_at":"2026-09-06T06:50:25.385Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"5285ff574215f42dfdc7705a","job_size_bytes":3,"pid":2654,"job_status":"deduplicated","message":"PipelineProcessWorker JID-dee402304d588efd05728d80: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2391gitlab # [ 268.188139] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.391Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"5285ff574215f42dfdc7705a","created_at":"2026-09-06T06:50:24.914Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-5d49c23c3ccd4ddd","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:24.919Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2654,"job_status":"rescheduled","message":"PipelineProcessWorker JID-5285ff574215f42dfdc7705a: rescheduled"}2392gitlab # [ 268.194835] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.398Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"5285ff574215f42dfdc7705a","created_at":"2026-09-06T06:50:24.914Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-5d49c23c3ccd4ddd","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:24.919Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5285ff574215f42dfdc7705a: done: 0.475224 sec","job_status":"done","queue_duration_s":0.003611,"scheduling_latency_s":0.003645,"gitaly_calls":3,"gitaly_duration_s":0.305592,"redis_calls":69,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.025903,"redis_read_bytes":226,"redis_write_bytes":18465,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000807,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001257,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003936,"redis_queues_read_bytes":24,"redis_queues_write_bytes":12311,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.00855,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000233,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.006814,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.003499,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.008,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.02,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.099467,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.420151164,"duration_s":0.475224,"completed_at":"2026-09-06T06:50:25.397Z","load_balancing_strategy":"primary","db_duration_s":0.037267,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2393gitlab # [ 268.287192] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.400Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"867b6316ca85453abfc24f57","created_at":"2026-09-06T06:50:24.988Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:24.990Z","job_size_bytes":23,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-867b6316ca85453abfc24f57: start","job_status":"start","queue_duration_s":0.409779,"scheduling_latency_s":0.40981}2394gitlab # [ 268.288355] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.436Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"867b6316ca85453abfc24f57","created_at":"2026-09-06T06:50:24.988Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:24.990Z","job_size_bytes":23,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-867b6316ca85453abfc24f57: done: 0.035862 sec","job_status":"done","queue_duration_s":0.409779,"scheduling_latency_s":0.40981,"redis_calls":7,"redis_duration_s":0.001634,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001182,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000452,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025528,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035862,"completed_at":"2026-09-06T06:50:25.436Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005835,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2395gitlab # [ 268.364181] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.437Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"d263cca76f9997f8987d2217","created_at":"2026-09-06T06:50:25.185Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.187Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-d263cca76f9997f8987d2217: start","job_status":"start","queue_duration_s":0.250042,"scheduling_latency_s":0.250063}2396gitlab # [ 268.369128] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.460Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"d263cca76f9997f8987d2217","created_at":"2026-09-06T06:50:25.185Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.187Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-d263cca76f9997f8987d2217: done: 0.023004 sec","job_status":"done","queue_duration_s":0.250042,"scheduling_latency_s":0.250063,"redis_calls":7,"redis_duration_s":0.001739,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001283,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000456,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023004,"completed_at":"2026-09-06T06:50:25.460Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003812,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2397gitlab # [ 268.457872] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.462Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"aba7903a4a338de50aefa05c","created_at":"2026-09-06T06:50:25.195Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.197Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-aba7903a4a338de50aefa05c: start","job_status":"start","queue_duration_s":0.265178,"scheduling_latency_s":0.265199}2398gitlab # [ 268.527627] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.484Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"aba7903a4a338de50aefa05c","created_at":"2026-09-06T06:50:25.195Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.197Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-aba7903a4a338de50aefa05c: done: 0.022359 sec","job_status":"done","queue_duration_s":0.265178,"scheduling_latency_s":0.265199,"redis_calls":7,"redis_duration_s":0.001588,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001161,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000427,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022359,"completed_at":"2026-09-06T06:50:25.484Z","load_balancing_strategy":"primary","db_duration_s":0.003559,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2399gitlab # [ 268.529233] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.486Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"e6c9033aaef0c9a261ba64ee","created_at":"2026-09-06T06:50:25.213Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.214Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e6c9033aaef0c9a261ba64ee: start","job_status":"start","queue_duration_s":0.271484,"scheduling_latency_s":0.271505}2400gitlab # [ 268.598352] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.512Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"e6c9033aaef0c9a261ba64ee","created_at":"2026-09-06T06:50:25.213Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.214Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e6c9033aaef0c9a261ba64ee: done: 0.026058 sec","job_status":"done","queue_duration_s":0.271484,"scheduling_latency_s":0.271505,"redis_calls":10,"redis_duration_s":0.002179,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001074,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000645,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00046,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017602,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026058,"completed_at":"2026-09-06T06:50:25.512Z","load_balancing_strategy":"primary","db_duration_s":0.00411,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2401gitlab # [ 268.668946] gitaly[922]: time="2026-09-06T06:50:25.665Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ2653CXP203X8NCDRF1Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:55.663" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:25.664" grpc.time_ms=0.657 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2402gitlab # [ 268.670240] nixbot[2646]: {"ts": "2026-09-06T06:50:25.869Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/93214664af3f47b7fe6cc14cc480b997481ac1ac \"HTTP/1.1 201 Created\""}2403gitlab # [ 268.671043] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.513Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"832144a229ef386160891da3","created_at":"2026-09-06T06:50:25.215Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.216Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-832144a229ef386160891da3: start","job_status":"start","queue_duration_s":0.296828,"scheduling_latency_s":0.296848}2404gitlab # [ 268.671956] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.538Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"832144a229ef386160891da3","created_at":"2026-09-06T06:50:25.215Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.216Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-832144a229ef386160891da3: done: 0.024435 sec","job_status":"done","queue_duration_s":0.296828,"scheduling_latency_s":0.296848,"redis_calls":7,"redis_duration_s":0.0016679999999999998,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001218,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00045,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024435,"completed_at":"2026-09-06T06:50:25.538Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003506,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2405gitlab # [ 268.740744] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 5182406gitlab # [ 268.742197] gitaly[922]: time="2026-09-06T06:50:25.679Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ2653CXP203X8NCDRF1Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-06T06:50:55.673" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:25.673" grpc.time_ms=6.161 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2407gitlab # [ 268.810138] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.539Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"bf9026af6d13605b6e46d7a4","created_at":"2026-09-06T06:50:25.217Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.219Z","job_size_bytes":19,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-bf9026af6d13605b6e46d7a4: start","job_status":"start","queue_duration_s":0.320192,"scheduling_latency_s":0.320218}2408gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac'2409gitlab # [ 268.811530] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.561Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"bf9026af6d13605b6e46d7a4","created_at":"2026-09-06T06:50:25.217Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.219Z","job_size_bytes":19,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-bf9026af6d13605b6e46d7a4: done: 0.022075 sec","job_status":"done","queue_duration_s":0.320192,"scheduling_latency_s":0.320218,"redis_calls":8,"redis_duration_s":0.0022329999999999997,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00178,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000453,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022075,"completed_at":"2026-09-06T06:50:25.561Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002672,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2410gitlab # [ 268.886451] nixbot[2646]: {"ts": "2026-09-06T06:50:25.878Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-93214664af3f-5"}2411gitlab # [ 268.887363] nixbot[2646]: {"ts": "2026-09-06T06:50:25.975Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-93214664af3f-5", "argv0": "bwrap"}2412gitlab # [ 268.888450] gitaly[922]: time="2026-09-06T06:50:25.692Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ2653CXP203X8NCDRF1Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:35.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:25.686" grpc.time_ms=6.159 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2413gitlab # [ 268.889438] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.563Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"127bb39c3061b7b0c37f04f7","created_at":"2026-09-06T06:50:25.220Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.221Z","job_size_bytes":66,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-127bb39c3061b7b0c37f04f7: start","job_status":"start","queue_duration_s":0.342018,"scheduling_latency_s":0.34204}2414gitlab # [ 268.963129] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.584Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"127bb39c3061b7b0c37f04f7","created_at":"2026-09-06T06:50:25.220Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.221Z","job_size_bytes":66,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-127bb39c3061b7b0c37f04f7: done: 0.020633 sec","job_status":"done","queue_duration_s":0.342018,"scheduling_latency_s":0.34204,"redis_calls":7,"redis_duration_s":0.00168,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001111,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000569,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020633,"completed_at":"2026-09-06T06:50:25.584Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002441,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2415gitlab # [ 269.039318] gitaly[922]: time="2026-09-06T06:50:25.709Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ2653CXP203X8NCDRF1Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-06T06:50:35.028" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:50:25.709" grpc.time_ms=0.21 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2416gitlab # [ 269.040767] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.585Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"b3cdd8a25c81d8112cfc7af4","created_at":"2026-09-06T06:50:25.221Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.223Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-b3cdd8a25c81d8112cfc7af4: start","job_status":"start","queue_duration_s":0.362278,"scheduling_latency_s":0.362299}2417gitlab # [ 269.041910] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.607Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"b3cdd8a25c81d8112cfc7af4","created_at":"2026-09-06T06:50:25.221Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.223Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-b3cdd8a25c81d8112cfc7af4: done: 0.022503 sec","job_status":"done","queue_duration_s":0.362278,"scheduling_latency_s":0.362299,"redis_calls":7,"redis_duration_s":0.001503,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001083,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00042,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022503,"completed_at":"2026-09-06T06:50:25.607Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004168,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2418gitlab # [ 269.113097] gitaly[922]: time="2026-09-06T06:50:25.719Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=620 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ2653CXP203X8NCDRF1Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-06T06:50:35.032" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:25.712" grpc.time_ms=6.509 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2419gitlab # [ 269.113995] gitaly[922]: time="2026-09-06T06:50:25.732Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQPZSQP0XT9NH4E8S40MSX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:25.732" grpc.time_ms=0.384 pid=922 span.kind=server system=grpc2420gitlab # [ 269.184284] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.609Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"fe5a70c1a6aec2cb6e0fd75b","created_at":"2026-09-06T06:50:25.223Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.225Z","job_size_bytes":6,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-fe5a70c1a6aec2cb6e0fd75b: start","job_status":"start","queue_duration_s":0.384419,"scheduling_latency_s":0.384439}2421gitlab # [ 269.186162] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.623Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"fe5a70c1a6aec2cb6e0fd75b","created_at":"2026-09-06T06:50:25.223Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.225Z","job_size_bytes":6,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-fe5a70c1a6aec2cb6e0fd75b: done: 0.013777 sec","job_status":"done","queue_duration_s":0.384419,"scheduling_latency_s":0.384439,"redis_calls":7,"redis_duration_s":0.0014520000000000002,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001048,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000404,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013777,"completed_at":"2026-09-06T06:50:25.623Z","load_balancing_strategy":"primary","db_duration_s":0.000339,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2422gitlab # [ 269.259250] gitaly[922]: time="2026-09-06T06:50:25.753Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ2653CXP203X8NCDRF1Z grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:25.753" grpc.time_ms=0.311 pid=922 span.kind=server system=grpc2423gitlab # [ 269.260685] gitaly[922]: time="2026-09-06T06:50:25.756Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQPZSQP0XT9NH4E8S40MSX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:25.756" grpc.time_ms=0.637 pid=922 span.kind=server system=grpc2424gitlab # [ 269.261346] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.624Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"dc71a43dac6a3dc6dfefef38","created_at":"2026-09-06T06:50:25.225Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.227Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-dc71a43dac6a3dc6dfefef38: start","job_status":"start","queue_duration_s":0.397118,"scheduling_latency_s":0.397138}2425gitlab # [ 269.262980] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.645Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"dc71a43dac6a3dc6dfefef38","created_at":"2026-09-06T06:50:25.225Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.227Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-dc71a43dac6a3dc6dfefef38: done: 0.020452 sec","job_status":"done","queue_duration_s":0.397118,"scheduling_latency_s":0.397138,"redis_calls":7,"redis_duration_s":0.001679,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001271,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000408,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013451,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020452,"completed_at":"2026-09-06T06:50:25.644Z","load_balancing_strategy":"primary","db_duration_s":0.002825,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2426gitlab # [ 269.348127] gitaly[922]: time="2026-09-06T06:50:25.777Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ2653CXP203X8NCDRF1Z grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:25.777" grpc.time_ms=0.288 pid=922 span.kind=server system=grpc2427gitlab # [ 269.349279] gitaly[922]: time="2026-09-06T06:50:25.779Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQPZSQP0XT9NH4E8S40MSX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:25.779" grpc.time_ms=0.213 pid=922 span.kind=server system=grpc2428gitlab # [ 269.358163] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.646Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"82b59cff3029d7d2a40e3702","created_at":"2026-09-06T06:50:25.391Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.393Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-82b59cff3029d7d2a40e3702: start","job_status":"start","queue_duration_s":0.253092,"scheduling_latency_s":0.253113}2429gitlab # [ 269.383054] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.881Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"82b59cff3029d7d2a40e3702","created_at":"2026-09-06T06:50:25.391Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-b5670874b16b4d0c","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.393Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-82b59cff3029d7d2a40e3702: done: 0.235116 sec","job_status":"done","queue_duration_s":0.253092,"scheduling_latency_s":0.253113,"gitaly_calls":3,"gitaly_duration_s":0.096378,"redis_calls":63,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.01348,"redis_read_bytes":143,"redis_write_bytes":16715,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000507,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000841,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":20,"redis_queues_duration_s":0.003224,"redis_queues_read_bytes":23,"redis_queues_write_bytes":11221,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.004636,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00023,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000622,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002913,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.006,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.102068,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.205720838,"duration_s":0.235116,"completed_at":"2026-09-06T06:50:25.881Z","load_balancing_strategy":"primary","db_duration_s":0.0274,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2430gitlab # [ 269.468381] gitaly[922]: time="2026-09-06T06:50:25.785Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZSQP0XT9NH4E8S40MSX forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:50:55.605" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:25.706" operations="[repack_refs]" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2431gitlab # [ 269.478880] gitaly[922]: time="2026-09-06T06:50:25.786Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZSQP0XT9NH4E8S40MSX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:50:55.605" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:25.706" pid=922 remote_ip="2001:db8:1::1" repository_info="{false {6 704 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-09-06 06:49:17.512175268 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2432gitlab # [ 269.549131] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.883Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2b3d8a852980e84f90dbd20e","created_at":"2026-09-06T06:50:25.699Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-0e6752ac05794f18","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.701Z","job_size_bytes":23,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2b3d8a852980e84f90dbd20e: start","job_status":"start","queue_duration_s":0.181978,"scheduling_latency_s":0.182}2433gitlab # [ 269.550416] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.917Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2b3d8a852980e84f90dbd20e","created_at":"2026-09-06T06:50:25.699Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-0e6752ac05794f18","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.701Z","job_size_bytes":23,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2b3d8a852980e84f90dbd20e: done: 0.033878 sec","job_status":"done","queue_duration_s":0.181978,"scheduling_latency_s":0.182,"redis_calls":7,"redis_duration_s":0.001712,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001254,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000458,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033878,"completed_at":"2026-09-06T06:50:25.917Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006115,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2434gitlab # [ 269.631178] gitaly[922]: time="2026-09-06T06:50:25.791Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ2653CXP203X8NCDRF1Z diskcache=58a8d396-bd1c-41f2-962b-ce184c2c1f48 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-06T06:50:35.040" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:50:25.721" pid=922 ref=refs/keep-around/93214664af3f47b7fe6cc14cc480b997481ac1ac remote_ip="2001:db8:1::1" revision=93214664af3f47b7fe6cc14cc480b997481ac1ac span.kind=server system=grpc username=root2435gitlab # [ 269.632417] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.918Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e73c00d80c39fa0798865cb7","created_at":"2026-09-06T06:50:25.800Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-0e6752ac05794f18","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.803Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e73c00d80c39fa0798865cb7: start","job_status":"start","queue_duration_s":0.115269,"scheduling_latency_s":0.115291}2436gitlab # [ 269.633236] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.946Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e73c00d80c39fa0798865cb7","created_at":"2026-09-06T06:50:25.800Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-0e6752ac05794f18","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.803Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e73c00d80c39fa0798865cb7: done: 0.027572 sec","job_status":"done","queue_duration_s":0.115269,"scheduling_latency_s":0.115291,"redis_calls":7,"redis_duration_s":0.0017659999999999998,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001298,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000468,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027572,"completed_at":"2026-09-06T06:50:25.946Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2437gitlab # [ 269.710114] gitaly[922]: time="2026-09-06T06:50:25.791Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=54 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5226 command.oublock=8 command.real_time_ms=62 command.spawn_token_fork_ms=1 command.system_time_ms=37 command.user_time_ms=17 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ2653CXP203X8NCDRF1Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-06T06:50:35.040" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-06T06:50:25.721" grpc.time_ms=70.066 pid=922 ref=refs/keep-around/93214664af3f47b7fe6cc14cc480b997481ac1ac remote_ip="2001:db8:1::1" revision=93214664af3f47b7fe6cc14cc480b997481ac1ac span.kind=server system=grpc username=root2438gitlab # [ 269.778357] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.947Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"91cc6db5e96cc9b48ea4b0ee","created_at":"2026-09-06T06:50:25.798Z","trace_propagation_headers":{"sentry-trace":"062421cf94cc4d05be655a856cb40021-104bf04471174e91","baggage":"sentry-trace_id=062421cf94cc4d05be655a856cb40021,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQQ2653CXP203X8NCDRF1Z","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.804Z","job_size_bytes":65,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-91cc6db5e96cc9b48ea4b0ee: start","job_status":"start","queue_duration_s":0.14359,"scheduling_latency_s":0.143615}2439gitlab # [ 269.779853] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.973Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"91cc6db5e96cc9b48ea4b0ee","created_at":"2026-09-06T06:50:25.798Z","trace_propagation_headers":{"sentry-trace":"062421cf94cc4d05be655a856cb40021-104bf04471174e91","baggage":"sentry-trace_id=062421cf94cc4d05be655a856cb40021,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQQ2653CXP203X8NCDRF1Z","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.804Z","job_size_bytes":65,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-91cc6db5e96cc9b48ea4b0ee: done: 0.025744 sec","job_status":"done","queue_duration_s":0.14359,"scheduling_latency_s":0.143615,"redis_calls":7,"redis_duration_s":0.001933,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001497,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000436,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025744,"completed_at":"2026-09-06T06:50:25.973Z","load_balancing_strategy":"primary","db_duration_s":0.003654,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2440gitlab # [ 269.849389] gitaly[922]: time="2026-09-06T06:50:25.793Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZSQP0XT9NH4E8S40MSX diskcache=6d184b42-a52c-4fb1-b383-9f0ab23777b3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:50:55.605" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:25.706" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2441gitlab # [ 269.850052] gitaly[922]: time="2026-09-06T06:50:25.793Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=74 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7368 command.oublock=0 command.real_time_ms=80 command.spawn_token_fork_ms=2 command.system_time_ms=43 command.user_time_ms=31 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZSQP0XT9NH4E8S40MSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:50:55.605" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:25.706" grpc.time_ms=87.002 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2442gitlab # [ 269.850870] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:25.975Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"c6321b420c3d9bd818527bf9","created_at":"2026-09-06T06:50:25.805Z","trace_propagation_headers":{"sentry-trace":"062421cf94cc4d05be655a856cb40021-104bf04471174e91","baggage":"sentry-trace_id=062421cf94cc4d05be655a856cb40021,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQQ2653CXP203X8NCDRF1Z","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.810Z","job_size_bytes":65,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-c6321b420c3d9bd818527bf9: start","job_status":"start","queue_duration_s":0.164823,"scheduling_latency_s":0.164852}2443gitlab # [ 269.919187] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:26.018Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"c6321b420c3d9bd818527bf9","created_at":"2026-09-06T06:50:25.805Z","trace_propagation_headers":{"sentry-trace":"062421cf94cc4d05be655a856cb40021-104bf04471174e91","baggage":"sentry-trace_id=062421cf94cc4d05be655a856cb40021,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQQ2653CXP203X8NCDRF1Z","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.810Z","job_size_bytes":65,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-c6321b420c3d9bd818527bf9: done: 0.043487 sec","job_status":"done","queue_duration_s":0.164823,"scheduling_latency_s":0.164852,"redis_calls":10,"redis_duration_s":0.004321,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003024,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001297,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043487,"completed_at":"2026-09-06T06:50:26.018Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010038,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2444gitlab # [ 270.000290] gitaly[922]: time="2026-09-06T06:50:25.797Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ2653CXP203X8NCDRF1Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:55.096" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:25.797" grpc.time_ms=0.298 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2445gitlab # [ 270.001740] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:26.020Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6f314f0305348db89f7480c5","created_at":"2026-09-06T06:50:25.812Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-0e6752ac05794f18","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.814Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6f314f0305348db89f7480c5: start","job_status":"start","queue_duration_s":0.20519,"scheduling_latency_s":0.205211}2446gitlab # [ 270.002785] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:26.042Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6f314f0305348db89f7480c5","created_at":"2026-09-06T06:50:25.812Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-0e6752ac05794f18","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.814Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6f314f0305348db89f7480c5: done: 0.022273 sec","job_status":"done","queue_duration_s":0.20519,"scheduling_latency_s":0.205211,"redis_calls":7,"redis_duration_s":0.00157,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00113,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00044,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022273,"completed_at":"2026-09-06T06:50:26.042Z","load_balancing_strategy":"primary","db_duration_s":0.003731,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2447gitlab # [ 270.084713] gitaly[922]: time="2026-09-06T06:50:25.807Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZSQP0XT9NH4E8S40MSX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:50:55.605" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:25.706" pid=922 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2448gitlab # [ 270.086487] gitaly[922]: time="2026-09-06T06:50:25.807Z" level=info msg="optimized repository" clean_stale_data_time=19.817602ms clean_work_trees_time="101.13µs" commit_graph_time="7.822µs" correlation_id=01M1TQPZSQP0XT9NH4E8S40MSX gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="8.38µs" pid=922 prune_time="8.102µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="8.66µs" storage_name=default system=housekeeping total_time=20.195304ms2449gitlab # [ 270.088337] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:26.043Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"939487086408ac4a8ed5f8e2","created_at":"2026-09-06T06:50:25.821Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-0e6752ac05794f18","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.822Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-939487086408ac4a8ed5f8e2: start","job_status":"start","queue_duration_s":0.221262,"scheduling_latency_s":0.221283}2450gitlab # [ 270.110380] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:26.067Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"939487086408ac4a8ed5f8e2","created_at":"2026-09-06T06:50:25.821Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-0e6752ac05794f18","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.822Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-939487086408ac4a8ed5f8e2: done: 0.024264 sec","job_status":"done","queue_duration_s":0.221262,"scheduling_latency_s":0.221283,"redis_calls":10,"redis_duration_s":0.002419,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001173,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000774,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000472,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024264,"completed_at":"2026-09-06T06:50:26.067Z","load_balancing_strategy":"primary","db_duration_s":0.003569,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2451gitlab # [ 270.191233] gitaly[922]: time="2026-09-06T06:50:25.808Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZSQP0XT9NH4E8S40MSX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:50:55.605" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:25.706" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2452gitlab # [ 270.192753] gitaly[922]: time="2026-09-06T06:50:25.843Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQPZSQP0XT9NH4E8S40MSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-06T06:50:55.742" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:25.843" grpc.time_ms=0.711 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2453gitlab # [ 270.211510] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:26.069Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"506673e96986f26016208ccf","created_at":"2026-09-06T06:50:25.822Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-0e6752ac05794f18","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.824Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-506673e96986f26016208ccf: start","job_status":"start","queue_duration_s":0.245056,"scheduling_latency_s":0.245078}2454gitlab # [ 270.288473] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:26.092Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"506673e96986f26016208ccf","created_at":"2026-09-06T06:50:25.822Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-0e6752ac05794f18","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.824Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-506673e96986f26016208ccf: done: 0.023518 sec","job_status":"done","queue_duration_s":0.245056,"scheduling_latency_s":0.245078,"redis_calls":7,"redis_duration_s":0.002893,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002406,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000487,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014556,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023518,"completed_at":"2026-09-06T06:50:26.092Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003108,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2455gitlab # [ 270.359611] gitaly[922]: time="2026-09-06T06:50:25.870Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQPZSQP0XT9NH4E8S40MSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:55.769" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:25.869" grpc.time_ms=0.592 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2456gitlab # [ 270.361137] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:26.094Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"4bc5ad66478c6926031b5f95","created_at":"2026-09-06T06:50:25.824Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-0e6752ac05794f18","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.827Z","job_size_bytes":19,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-4bc5ad66478c6926031b5f95: start","job_status":"start","queue_duration_s":0.267501,"scheduling_latency_s":0.267528}2457gitlab # [ 270.361853] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:26.116Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"4bc5ad66478c6926031b5f95","created_at":"2026-09-06T06:50:25.824Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-0e6752ac05794f18","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.827Z","job_size_bytes":19,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-4bc5ad66478c6926031b5f95: done: 0.022013 sec","job_status":"done","queue_duration_s":0.267501,"scheduling_latency_s":0.267528,"redis_calls":8,"redis_duration_s":0.0017720000000000001,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001366,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000406,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022013,"completed_at":"2026-09-06T06:50:26.116Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003126,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2458gitlab # [ 270.458569] gitaly[922]: time="2026-09-06T06:50:26.250Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ2653CXP203X8NCDRF1Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-06T06:50:56.149" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:26.250" grpc.time_ms=0.716 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2459gitlab # [ 270.460124] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:26.118Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"1fe4f05244dd0292a7652faf","created_at":"2026-09-06T06:50:25.828Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-0e6752ac05794f18","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.829Z","job_size_bytes":66,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-1fe4f05244dd0292a7652faf: start","job_status":"start","queue_duration_s":0.288294,"scheduling_latency_s":0.288324}2460gitlab # [ 270.460900] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:26.138Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"1fe4f05244dd0292a7652faf","created_at":"2026-09-06T06:50:25.828Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-0e6752ac05794f18","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.829Z","job_size_bytes":66,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-1fe4f05244dd0292a7652faf: done: 0.020606 sec","job_status":"done","queue_duration_s":0.288294,"scheduling_latency_s":0.288324,"redis_calls":7,"redis_duration_s":0.001563,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00116,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000403,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020606,"completed_at":"2026-09-06T06:50:26.138Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004165,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2461gitlab # [ 270.530268] gitaly[922]: time="2026-09-06T06:50:26.279Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ2653CXP203X8NCDRF1Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:56.178" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:26.278" grpc.time_ms=0.598 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2462gitlab # [ 270.604521] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:26.140Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"9f2cee2a432794ceaa6268ea","created_at":"2026-09-06T06:50:25.830Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-0e6752ac05794f18","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.831Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-9f2cee2a432794ceaa6268ea: start","job_status":"start","queue_duration_s":0.308503,"scheduling_latency_s":0.308536}2463gitlab # [ 270.605785] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:26.161Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"9f2cee2a432794ceaa6268ea","created_at":"2026-09-06T06:50:25.830Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-0e6752ac05794f18","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.831Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-9f2cee2a432794ceaa6268ea: done: 0.021076 sec","job_status":"done","queue_duration_s":0.308503,"scheduling_latency_s":0.308536,"redis_calls":7,"redis_duration_s":0.001529,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001081,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000448,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013349,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021076,"completed_at":"2026-09-06T06:50:26.161Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003966,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2464gitlab # [ 270.673923] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:26.162Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"8ec7c14f139e4f706145ee0b","created_at":"2026-09-06T06:50:25.832Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-0e6752ac05794f18","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.833Z","job_size_bytes":6,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-8ec7c14f139e4f706145ee0b: start","job_status":"start","queue_duration_s":0.329148,"scheduling_latency_s":0.329169}2465gitlab # [ 270.675125] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:26.175Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"8ec7c14f139e4f706145ee0b","created_at":"2026-09-06T06:50:25.832Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-0e6752ac05794f18","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.833Z","job_size_bytes":6,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-8ec7c14f139e4f706145ee0b: done: 0.013083 sec","job_status":"done","queue_duration_s":0.329148,"scheduling_latency_s":0.329169,"redis_calls":7,"redis_duration_s":0.001583,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001125,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000458,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013083,"completed_at":"2026-09-06T06:50:26.175Z","load_balancing_strategy":"primary","db_duration_s":0.000513,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2466gitlab # [ 270.750228] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:26.177Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a6601925717077eaff288ccb","created_at":"2026-09-06T06:50:25.833Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-0e6752ac05794f18","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.835Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a6601925717077eaff288ccb: start","job_status":"start","queue_duration_s":0.342012,"scheduling_latency_s":0.342032}2467gitlab # [ 270.751398] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:26.196Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a6601925717077eaff288ccb","created_at":"2026-09-06T06:50:25.833Z","trace_propagation_headers":{"sentry-trace":"2f8b110f51214da4943b5783ef8bbe4e-0e6752ac05794f18","baggage":"sentry-trace_id=2f8b110f51214da4943b5783ef8bbe4e,sentry-release=Unknown"},"correlation_id":"01M1TQPZSQP0XT9NH4E8S40MSX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.835Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a6601925717077eaff288ccb: done: 0.018977 sec","job_status":"done","queue_duration_s":0.342012,"scheduling_latency_s":0.342032,"redis_calls":7,"redis_duration_s":0.001501,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001052,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000449,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018977,"completed_at":"2026-09-06T06:50:26.196Z","load_balancing_strategy":"primary","db_duration_s":0.002872,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2468gitlab # [ 270.833168] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:26.197Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"ed98790bda546a10f22b093a","created_at":"2026-09-06T06:50:25.851Z","trace_propagation_headers":{"sentry-trace":"062421cf94cc4d05be655a856cb40021-104bf04471174e91","baggage":"sentry-trace_id=062421cf94cc4d05be655a856cb40021,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQQ2653CXP203X8NCDRF1Z","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.856Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ed98790bda546a10f22b093a: start","job_status":"start","queue_duration_s":0.340645,"scheduling_latency_s":0.340665}2469gitlab # [ 270.834374] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:26.288Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"ed98790bda546a10f22b093a","created_at":"2026-09-06T06:50:25.851Z","trace_propagation_headers":{"sentry-trace":"062421cf94cc4d05be655a856cb40021-104bf04471174e91","baggage":"sentry-trace_id=062421cf94cc4d05be655a856cb40021,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQQ2653CXP203X8NCDRF1Z","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:25.856Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ed98790bda546a10f22b093a: done: 0.090922 sec","job_status":"done","queue_duration_s":0.340645,"scheduling_latency_s":0.340665,"gitaly_calls":2,"gitaly_duration_s":0.005856,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.006514,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000964,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00119,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000261,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001542,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000229,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000423,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064527,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.066896212,"duration_s":0.090922,"completed_at":"2026-09-06T06:50:26.288Z","load_balancing_strategy":"primary","db_duration_s":0.019567,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2470gitlab # [ 270.921055] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:26.289Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"ee4bbca15a970954c98567bc","created_at":"2026-09-06T06:50:26.238Z","trace_propagation_headers":{"sentry-trace":"062421cf94cc4d05be655a856cb40021-8d006ca8b2ea4c03","baggage":"sentry-trace_id=062421cf94cc4d05be655a856cb40021,sentry-release=Unknown"},"correlation_id":"01M1TQQ2653CXP203X8NCDRF1Z","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:26.240Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-ee4bbca15a970954c98567bc: start","job_status":"start","queue_duration_s":0.049779,"scheduling_latency_s":0.049801}2471gitlab # [ 270.932965] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:26.315Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"ee4bbca15a970954c98567bc","created_at":"2026-09-06T06:50:26.238Z","trace_propagation_headers":{"sentry-trace":"062421cf94cc4d05be655a856cb40021-8d006ca8b2ea4c03","baggage":"sentry-trace_id=062421cf94cc4d05be655a856cb40021,sentry-release=Unknown"},"correlation_id":"01M1TQQ2653CXP203X8NCDRF1Z","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:26.240Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-ee4bbca15a970954c98567bc: done: 0.02606 sec","job_status":"done","queue_duration_s":0.049779,"scheduling_latency_s":0.049801,"redis_calls":7,"redis_duration_s":0.0015689999999999999,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001161,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000408,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02606,"completed_at":"2026-09-06T06:50:26.315Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003612,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2472gitlab # [ 271.082744] nixbot[2646]: INFO: ::ffff:127.0.0.1:37506 - "GET /api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 200 OK2473gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=93214664af3f47b7fe6cc14cc480b997481ac1ac', in 2.21 seconds)2474(finished: subtest: push delivers the webhook, in 64.04 seconds)2475subtest: eval and build post commit statuses2476gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/93214664af3f47b7fe6cc14cc480b997481ac1ac/statuses2477gitlab # [ 271.144903] nix-daemon[2873]: accepted connection from pid 3542, user nixbot2478gitlab # [ 271.193732] gitaly[922]: time="2026-09-06T06:50:28.396Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ53FVTSPQKVV304M9KXX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:58.093" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:28.395" grpc.time_ms=1.204 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2479gitlab # [ 271.229110] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:28 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/93214664af3f47b7fe6cc14cc480b997481ac1ac/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 952480gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/93214664af3f47b7fe6cc14cc480b997481ac1ac/statuses, in 0.13 seconds)2481gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/93214664af3f47b7fe6cc14cc480b997481ac1ac/statuses2482gitlab # [ 272.369479] gitaly[922]: time="2026-09-06T06:50:29.572Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ67JGAKM4WACJ8XTFAZ7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:50:59.069" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:29.570" grpc.time_ms=1.036 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2483gitlab # [ 272.398970] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/93214664af3f47b7fe6cc14cc480b997481ac1ac/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1112484gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/93214664af3f47b7fe6cc14cc480b997481ac1ac/statuses, in 0.18 seconds)2485gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/93214664af3f47b7fe6cc14cc480b997481ac1ac/statuses2486gitlab # [ 273.538593] gitaly[922]: time="2026-09-06T06:50:30.741Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ7CEYR8GH3XA64VVATXH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:51:00.239" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:30.740" grpc.time_ms=1.08 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2487gitlab # [ 273.627971] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:30 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/93214664af3f47b7fe6cc14cc480b997481ac1ac/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1592488gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/93214664af3f47b7fe6cc14cc480b997481ac1ac/statuses, in 0.22 seconds)2489gitlab # [ 274.312839] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:31.515Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"fddc51c414758531a2c9e86e","created_at":"2026-09-06T06:50:31.491Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f170e2d166fb954594e067418e57b235","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:31.510Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-fddc51c414758531a2c9e86e: start","job_status":"start","queue_duration_s":0.004371,"scheduling_latency_s":0.004437}2490gitlab # [ 274.457888] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:31.660Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"fddc51c414758531a2c9e86e","created_at":"2026-09-06T06:50:31.491Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f170e2d166fb954594e067418e57b235","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:31.510Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-fddc51c414758531a2c9e86e: done: 0.145922 sec","job_status":"done","queue_duration_s":0.004371,"scheduling_latency_s":0.004437,"redis_calls":11,"redis_duration_s":0.020142,"redis_read_bytes":9,"redis_write_bytes":1386,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.007264,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007389,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005489,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.145922,"completed_at":"2026-09-06T06:50:31.660Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003834,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2491gitlab # [ 274.565442] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:31.768Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"9522e5d417320c8b213feddb","created_at":"2026-09-06T06:50:31.585Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d852c9a2881277b9f6f389f41ef6b3e","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:31.609Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-9522e5d417320c8b213feddb: start","job_status":"start","queue_duration_s":0.15871,"scheduling_latency_s":0.158773}2492gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/93214664af3f47b7fe6cc14cc480b997481ac1ac/statuses2493gitlab # [ 274.666799] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:31.869Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"9522e5d417320c8b213feddb","created_at":"2026-09-06T06:50:31.585Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d852c9a2881277b9f6f389f41ef6b3e","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:31.609Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-9522e5d417320c8b213feddb: done: 0.101432 sec","job_status":"done","queue_duration_s":0.15871,"scheduling_latency_s":0.158773,"redis_calls":11,"redis_duration_s":0.022665,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001864,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.015653,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.001127,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004021,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002960711,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.101432,"completed_at":"2026-09-06T06:50:31.869Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001102,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2494gitlab # [ 274.734778] gitaly[922]: time="2026-09-06T06:50:31.937Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ8JHY85YX15SAN9W19ZH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:51:01.635" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:31.936" grpc.time_ms=0.888 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2495gitlab # [ 274.767632] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:31 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/93214664af3f47b7fe6cc14cc480b997481ac1ac/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 802496gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/93214664af3f47b7fe6cc14cc480b997481ac1ac/statuses, in 0.14 seconds)2497gitlab # [ 274.786280] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:31.989Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"93739116c6d7a90944d28bf7","created_at":"2026-09-06T06:50:31.632Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"02b348c213b25427459cd3d4bfeb3180","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:31.765Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-93739116c6d7a90944d28bf7: start","job_status":"start","queue_duration_s":0.223857,"scheduling_latency_s":0.223893}2498gitlab # [ 274.885207] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:32.088Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"93739116c6d7a90944d28bf7","created_at":"2026-09-06T06:50:31.632Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"02b348c213b25427459cd3d4bfeb3180","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:31.765Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-93739116c6d7a90944d28bf7: done: 0.098923 sec","job_status":"done","queue_duration_s":0.223857,"scheduling_latency_s":0.223893,"redis_calls":11,"redis_duration_s":0.018972,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00379,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008128,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.007054,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000922743,"exclusive_lock_hold_duration_s":0.010328966,"duration_s":0.098923,"completed_at":"2026-09-06T06:50:32.088Z","load_balancing_strategy":"primary","db_duration_s":0.008489,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2499gitlab # [ 274.974135] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:32.177Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"3490d32a891d2846545376fb","created_at":"2026-09-06T06:50:31.800Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6fd6c3d1e23c18254d0a0a8e5d69df21","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T06:50:31.825Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-3490d32a891d2846545376fb: start","job_status":"start","queue_duration_s":0.352053,"scheduling_latency_s":0.352108}2500gitlab # [ 275.035614] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:32.239Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2501gitlab # [ 275.059872] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:32.262Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"3490d32a891d2846545376fb","created_at":"2026-09-06T06:50:31.800Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6fd6c3d1e23c18254d0a0a8e5d69df21","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-06T06:50:31.825Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-3490d32a891d2846545376fb: done: 0.085717 sec","job_status":"done","queue_duration_s":0.352053,"scheduling_latency_s":0.352108,"redis_calls":9,"redis_duration_s":0.012704,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004727,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004529,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003448,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.085717,"completed_at":"2026-09-06T06:50:32.262Z","load_balancing_strategy":"primary","db_duration_s":0.003581,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2502gitlab # [ 275.140495] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:32.343Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"4b8cc0e5f1c2d5b8c7fcee0e","created_at":"2026-09-06T06:50:31.851Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4e40c76375261a0a36673c42f399241","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:31.986Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-4b8cc0e5f1c2d5b8c7fcee0e: start","job_status":"start","queue_duration_s":0.356491,"scheduling_latency_s":0.356555}2503gitlab # [ 275.239882] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:32.442Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"4b8cc0e5f1c2d5b8c7fcee0e","created_at":"2026-09-06T06:50:31.851Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4e40c76375261a0a36673c42f399241","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:31.986Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-4b8cc0e5f1c2d5b8c7fcee0e: done: 0.099449 sec","job_status":"done","queue_duration_s":0.356491,"scheduling_latency_s":0.356555,"redis_calls":10,"redis_duration_s":0.013343,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003644,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007476,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002223,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001601321,"duration_s":0.099449,"completed_at":"2026-09-06T06:50:32.442Z","load_balancing_strategy":"primary","db_duration_s":0.030825,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2504gitlab # [ 275.337213] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:32.539Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c6fee9f3ac68d485df7e209a","created_at":"2026-09-06T06:50:32.042Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"60082867873855182b954b58f41055a8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.058Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c6fee9f3ac68d485df7e209a: start","job_status":"start","queue_duration_s":0.48055,"scheduling_latency_s":0.480612}2505gitlab # [ 275.379454] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:32.582Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2506gitlab # [ 275.402799] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:32.605Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c6fee9f3ac68d485df7e209a","created_at":"2026-09-06T06:50:32.042Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"60082867873855182b954b58f41055a8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.058Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c6fee9f3ac68d485df7e209a: done: 0.066257 sec","job_status":"done","queue_duration_s":0.48055,"scheduling_latency_s":0.480612,"redis_calls":9,"redis_duration_s":0.014582999999999999,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00241,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009411,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002762,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.066257,"completed_at":"2026-09-06T06:50:32.605Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002119,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2507gitlab # [ 275.406674] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:32.609Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a33bd8a59e06c2669af165bc","created_at":"2026-09-06T06:50:32.070Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0215dd121fdc45b059a020f800a7742d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T06:50:32.081Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a33bd8a59e06c2669af165bc: start","job_status":"start","queue_duration_s":0.527791,"scheduling_latency_s":0.527843}2508gitlab # [ 275.497772] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:32.701Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2509gitlab # [ 275.506678] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:32.709Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a33bd8a59e06c2669af165bc","created_at":"2026-09-06T06:50:32.070Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0215dd121fdc45b059a020f800a7742d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-06T06:50:32.081Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a33bd8a59e06c2669af165bc: done: 0.100395 sec","job_status":"done","queue_duration_s":0.527791,"scheduling_latency_s":0.527843,"redis_calls":9,"redis_duration_s":0.00649,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001913,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003044,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001533,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.07,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.07,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.100395,"completed_at":"2026-09-06T06:50:32.709Z","load_balancing_strategy":"primary","db_duration_s":0.069519,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2510gitlab # [ 275.555970] nix-daemon[2873]: accepted connection from pid 3580, user nixbot2511gitlab # [ 275.572271] nix-daemon[2873]: accepted connection from pid 3542, user nixbot2512gitlab # [ 275.576264] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:32.778Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"3b80d2e887aa1f7c7d298fe1","created_at":"2026-09-06T06:50:32.174Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b45c4e59a2d5aa38b515316a26f83787","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.209Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-3b80d2e887aa1f7c7d298fe1: start","job_status":"start","queue_duration_s":0.56925,"scheduling_latency_s":0.569301}2513gitlab # [ 275.634278] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:32.837Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"3b80d2e887aa1f7c7d298fe1","created_at":"2026-09-06T06:50:32.174Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b45c4e59a2d5aa38b515316a26f83787","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.209Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-3b80d2e887aa1f7c7d298fe1: done: 0.05927 sec","job_status":"done","queue_duration_s":0.56925,"scheduling_latency_s":0.569301,"redis_calls":11,"redis_duration_s":0.010872,"redis_read_bytes":9,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001958,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004727,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004187,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001119975,"exclusive_lock_hold_duration_s":0.015063088,"duration_s":0.05927,"completed_at":"2026-09-06T06:50:32.837Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2514gitlab # [ 275.670376] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:32.840Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"5bb037b461bf33797e034a2e","created_at":"2026-09-06T06:50:32.230Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0bb4da8bd5cfbd85c6c2bc962ab97d96","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.250Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-5bb037b461bf33797e034a2e: start","job_status":"start","queue_duration_s":0.589846,"scheduling_latency_s":0.58987}2515gitlab # [ 275.741560] gitaly[922]: time="2026-09-06T06:50:32.944Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ9G2RMJX8DSP1K5ES0SG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:51:02.443" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:32.944" grpc.time_ms=0.565 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2516gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/93214664af3f47b7fe6cc14cc480b997481ac1ac/statuses2517gitlab # [ 275.747285] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:32.948Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"5bb037b461bf33797e034a2e","created_at":"2026-09-06T06:50:32.230Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0bb4da8bd5cfbd85c6c2bc962ab97d96","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.250Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-5bb037b461bf33797e034a2e: done: 0.107959 sec","job_status":"done","queue_duration_s":0.589846,"scheduling_latency_s":0.58987,"redis_calls":11,"redis_duration_s":0.010959,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002638,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004126,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004195,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074491,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002994235,"exclusive_lock_hold_duration_s":0.004323734,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.107959,"completed_at":"2026-09-06T06:50:32.948Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002965,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2518gitlab # [ 275.819450] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:32.952Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"11dad4931ef027be5dd8ede1","created_at":"2026-09-06T06:50:32.337Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6af28e00bc631f55a3d28bb8e504be63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.373Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-11dad4931ef027be5dd8ede1: start","job_status":"start","queue_duration_s":0.578702,"scheduling_latency_s":0.578732}2519gitlab # [ 275.820846] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:32.997Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"11dad4931ef027be5dd8ede1","created_at":"2026-09-06T06:50:32.337Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6af28e00bc631f55a3d28bb8e504be63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.373Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-11dad4931ef027be5dd8ede1: done: 0.045485 sec","job_status":"done","queue_duration_s":0.578702,"scheduling_latency_s":0.578732,"redis_calls":20,"redis_duration_s":0.015001,"redis_read_bytes":23,"redis_write_bytes":4317,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.006723,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1065,"redis_queues_calls":4,"redis_queues_duration_s":0.001661,"redis_queues_read_bytes":6,"redis_queues_write_bytes":2022,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.005743,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":1004,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01893,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001927899,"duration_s":0.045485,"completed_at":"2026-09-06T06:50:32.997Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004222,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2520gitlab # [ 275.887553] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.000Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"b478ec2fe348d4b3a23a09df","created_at":"2026-09-06T06:50:32.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b84b56e4dd443838aaef833f4714ff59","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.420Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-b478ec2fe348d4b3a23a09df: start","job_status":"start","queue_duration_s":0.579345,"scheduling_latency_s":0.579366}2521gitlab # [ 275.888735] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.023Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2522gitlab # [ 275.895152] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.039Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"b478ec2fe348d4b3a23a09df","created_at":"2026-09-06T06:50:32.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b84b56e4dd443838aaef833f4714ff59","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.420Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-b478ec2fe348d4b3a23a09df: done: 0.038956 sec","job_status":"done","queue_duration_s":0.579345,"scheduling_latency_s":0.579366,"redis_calls":9,"redis_duration_s":0.004024,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00048,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001138,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002406,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038956,"completed_at":"2026-09-06T06:50:33.038Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004703,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2523gitlab # [ 275.967247] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.040Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"118206043e6f617c69ff0f77","created_at":"2026-09-06T06:50:32.444Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"01ba14740faa270861b4ceff935c34d6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.548Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-118206043e6f617c69ff0f77: start","job_status":"start","queue_duration_s":0.492275,"scheduling_latency_s":0.492296}2524gitlab # [ 275.981484] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.184Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"118206043e6f617c69ff0f77","created_at":"2026-09-06T06:50:32.444Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"01ba14740faa270861b4ceff935c34d6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.548Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-118206043e6f617c69ff0f77: done: 0.144471 sec","job_status":"done","queue_duration_s":0.492275,"scheduling_latency_s":0.492296,"redis_calls":11,"redis_duration_s":0.019733999999999998,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000469,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001948,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.017317,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.067,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.067,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000793956,"exclusive_lock_hold_duration_s":0.038040868,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.144471,"completed_at":"2026-09-06T06:50:33.184Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.071865,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2525gitlab # [ 276.056142] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.192Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"a694863139bd958931c03e86","created_at":"2026-09-06T06:50:32.570Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a14703e6019655dfcc7097edf5bbd346","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.594Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-a694863139bd958931c03e86: start","job_status":"start","queue_duration_s":0.597613,"scheduling_latency_s":0.597637}2526gitlab # [ 276.057405] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.238Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"a694863139bd958931c03e86","created_at":"2026-09-06T06:50:32.570Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a14703e6019655dfcc7097edf5bbd346","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.594Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-a694863139bd958931c03e86: done: 0.046658 sec","job_status":"done","queue_duration_s":0.597613,"scheduling_latency_s":0.597637,"redis_calls":18,"redis_duration_s":0.006683,"redis_read_bytes":20,"redis_write_bytes":4698,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.0033,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000306,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002317,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00076,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02032,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.046658,"completed_at":"2026-09-06T06:50:33.238Z","load_balancing_strategy":"primary","db_duration_s":0.005371,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2527gitlab # [ 276.135329] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.241Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Releases::PublishEventWorker","jid":"2ea09116cbabdd0169577d38","created_at":"2026-09-06T06:50:32.699Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bf7b9a797d5562cdabf482503d78ae85","meta.root_caller_id":"Cronjob","meta.feature_category":"release_orchestration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9f5dbd6b3e0f8a09b95f6e4bc38c93c1137695f37704af6aead7c9933a73fb55","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.711Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Releases::PublishEventWorker JID-2ea09116cbabdd0169577d38: start","job_status":"start","queue_duration_s":0.530057,"scheduling_latency_s":0.530085}2528gitlab # [ 276.136880] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.288Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Releases::PublishEventWorker","jid":"2ea09116cbabdd0169577d38","created_at":"2026-09-06T06:50:32.699Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bf7b9a797d5562cdabf482503d78ae85","meta.root_caller_id":"Cronjob","meta.feature_category":"release_orchestration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9f5dbd6b3e0f8a09b95f6e4bc38c93c1137695f37704af6aead7c9933a73fb55","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.711Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Releases::PublishEventWorker JID-2ea09116cbabdd0169577d38: done: 0.04654 sec","job_status":"done","queue_duration_s":0.530057,"scheduling_latency_s":0.530085,"redis_calls":10,"redis_duration_s":0.017938000000000003,"redis_read_bytes":9,"redis_write_bytes":1039,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000428,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.016899,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000611,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000742273,"duration_s":0.04654,"completed_at":"2026-09-06T06:50:33.287Z","load_balancing_strategy":"primary","db_duration_s":0.008294,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2529gitlab # [ 276.204346] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.289Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerExpirationPolicyWorker","jid":"a7ea60f5a9b478c71d839ee2","created_at":"2026-09-06T06:50:32.786Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"35c4cfd6a2c127313433870d7bf37f17","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ba5eeda814b310e5e806d97a55d657076d1f5f4bfe3538607468cb1befa65b3c","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.801Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicyWorker JID-a7ea60f5a9b478c71d839ee2: start","job_status":"start","queue_duration_s":0.488057,"scheduling_latency_s":0.488078}2530gitlab # [ 276.217414] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.329Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerExpirationPolicyWorker","jid":"a7ea60f5a9b478c71d839ee2","created_at":"2026-09-06T06:50:32.786Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"35c4cfd6a2c127313433870d7bf37f17","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ba5eeda814b310e5e806d97a55d657076d1f5f4bfe3538607468cb1befa65b3c","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.801Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicyWorker JID-a7ea60f5a9b478c71d839ee2: done: 0.04029 sec","job_status":"done","queue_duration_s":0.488057,"scheduling_latency_s":0.488078,"redis_calls":21,"redis_duration_s":0.004816,"redis_read_bytes":24,"redis_write_bytes":5391,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000943,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":724,"redis_queues_calls":2,"redis_queues_duration_s":0.000305,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3279,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002328,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":782,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.00124,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":606,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.007416026,"extra.container_expiration_policy_worker.cleanup_required_count":0,"extra.container_expiration_policy_worker.cleanup_unfinished_count":0,"extra.container_expiration_policy_worker.cleanup_total_count":0,"duration_s":0.04029,"completed_at":"2026-09-06T06:50:33.329Z","load_balancing_strategy":"primary","db_duration_s":0.005333,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2531gitlab # [ 276.317254] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.331Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"ba62be4f2195803dadee3359","created_at":"2026-09-06T06:50:32.816Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9d14ee8fd8bf43edae2cb7490d3ec5b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.826Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-ba62be4f2195803dadee3359: start","job_status":"start","queue_duration_s":0.504725,"scheduling_latency_s":0.504747}2532gitlab # [ 276.318074] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.352Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"ba62be4f2195803dadee3359","created_at":"2026-09-06T06:50:32.816Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9d14ee8fd8bf43edae2cb7490d3ec5b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.826Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-ba62be4f2195803dadee3359: done: 0.020877 sec","job_status":"done","queue_duration_s":0.504725,"scheduling_latency_s":0.504747,"redis_calls":9,"redis_duration_s":0.002138,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000615,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001105,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012171,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020877,"completed_at":"2026-09-06T06:50:33.352Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002851,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2533gitlab # [ 276.389680] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.353Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"cf04dd1f3d68f704b7c9eeb3","created_at":"2026-09-06T06:50:32.835Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6518d87f953d06d1d1a9b4a6db30c20","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.843Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-cf04dd1f3d68f704b7c9eeb3: start","job_status":"start","queue_duration_s":0.509717,"scheduling_latency_s":0.509738}2534gitlab # [ 276.391157] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.381Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"cf04dd1f3d68f704b7c9eeb3","created_at":"2026-09-06T06:50:32.835Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6518d87f953d06d1d1a9b4a6db30c20","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.843Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-cf04dd1f3d68f704b7c9eeb3: done: 0.028159 sec","job_status":"done","queue_duration_s":0.509717,"scheduling_latency_s":0.509738,"redis_calls":10,"redis_duration_s":0.0021680000000000002,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000445,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001275,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000448,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000352838,"extra.pages_deactivate_expired_deployments_cron_worker.deactivate_expired_pages_deployments":{"deactivated_deployments":0,"duration":0.001763632},"duration_s":0.028159,"completed_at":"2026-09-06T06:50:33.381Z","load_balancing_strategy":"primary","db_duration_s":0.006665,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2535gitlab # [ 276.466301] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.383Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"6dc9c8074152f34734a1f6d2","created_at":"2026-09-06T06:50:32.851Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.923Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-6dc9c8074152f34734a1f6d2: start","job_status":"start","queue_duration_s":0.459054,"scheduling_latency_s":0.459073}2536gitlab # [ 276.534488] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.470Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"6dc9c8074152f34734a1f6d2","created_at":"2026-09-06T06:50:32.851Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.923Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-6dc9c8074152f34734a1f6d2: done: 0.087342 sec","job_status":"done","queue_duration_s":0.459054,"scheduling_latency_s":0.459073,"redis_calls":70,"redis_duration_s":0.01489,"redis_read_bytes":118,"redis_write_bytes":42580,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002023,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000746,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.011519,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000602,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.071899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.087342,"completed_at":"2026-09-06T06:50:33.470Z","load_balancing_strategy":"primary","db_duration_s":0.001685,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2537gitlab # [ 276.541959] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.471Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"7fa5e74e1669bb7343e71ea5","created_at":"2026-09-06T06:50:32.938Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ad0b88a318ebf6d8e3ba7c352d72a28","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.962Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-7fa5e74e1669bb7343e71ea5: start","job_status":"start","queue_duration_s":0.508984,"scheduling_latency_s":0.50901}2538gitlab # [ 276.615432] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.490Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"7fa5e74e1669bb7343e71ea5","created_at":"2026-09-06T06:50:32.938Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ad0b88a318ebf6d8e3ba7c352d72a28","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.962Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-7fa5e74e1669bb7343e71ea5: done: 0.019088 sec","job_status":"done","queue_duration_s":0.508984,"scheduling_latency_s":0.50901,"redis_calls":10,"redis_duration_s":0.00214,"redis_read_bytes":9,"redis_write_bytes":1179,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000449,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001255,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000436,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":238,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000355352,"duration_s":0.019088,"completed_at":"2026-09-06T06:50:33.490Z","load_balancing_strategy":"primary","db_duration_s":0.000504,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2539gitlab # [ 276.685918] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.492Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"7a34766eb9cc0b45518a094a","created_at":"2026-09-06T06:50:32.965Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-44e77d2be8db4a98","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"6af28e00bc631f55a3d28bb8e504be63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.974Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-7a34766eb9cc0b45518a094a: start","job_status":"start","queue_duration_s":0.51805,"scheduling_latency_s":0.518069}2540gitlab # [ 276.687319] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.509Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"7a34766eb9cc0b45518a094a","created_at":"2026-09-06T06:50:32.965Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-44e77d2be8db4a98","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"6af28e00bc631f55a3d28bb8e504be63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.974Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-7a34766eb9cc0b45518a094a: done: 0.017368 sec","job_status":"done","queue_duration_s":0.51805,"scheduling_latency_s":0.518069,"redis_calls":10,"redis_duration_s":0.002178,"redis_read_bytes":9,"redis_write_bytes":1117,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000477,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001267,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000434,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":222,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035228,"duration_s":0.017368,"completed_at":"2026-09-06T06:50:33.509Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000879,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2541gitlab # [ 276.766248] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.510Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"ea25f71eda7b2f59b67dce13","created_at":"2026-09-06T06:50:32.974Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08ca00102372d427bf76115cb1cd5b1c","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.984Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-ea25f71eda7b2f59b67dce13: start","job_status":"start","queue_duration_s":0.526372,"scheduling_latency_s":0.526392}2542gitlab # [ 276.767827] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.531Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"ea25f71eda7b2f59b67dce13","created_at":"2026-09-06T06:50:32.974Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08ca00102372d427bf76115cb1cd5b1c","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.984Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-ea25f71eda7b2f59b67dce13: done: 0.020195 sec","job_status":"done","queue_duration_s":0.526372,"scheduling_latency_s":0.526392,"redis_calls":13,"redis_duration_s":0.002806,"redis_read_bytes":10,"redis_write_bytes":1343,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000438,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00129,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001078,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":368,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000374908,"extra.packages_cleanup_delete_orphaned_dependencies_worker.last_processed_packages_dependency_id":0,"extra.packages_cleanup_delete_orphaned_dependencies_worker.deleted_rows_count":0,"duration_s":0.020195,"completed_at":"2026-09-06T06:50:33.531Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002302,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2543gitlab # [ 276.841094] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.532Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"5cfeac4787b9a23b2deb7fe0","created_at":"2026-09-06T06:50:32.975Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-44e77d2be8db4a98","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"6af28e00bc631f55a3d28bb8e504be63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.985Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-5cfeac4787b9a23b2deb7fe0: start","job_status":"start","queue_duration_s":0.546854,"scheduling_latency_s":0.546874}2544gitlab # [ 276.842491] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.549Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"5cfeac4787b9a23b2deb7fe0","created_at":"2026-09-06T06:50:32.975Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-44e77d2be8db4a98","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"6af28e00bc631f55a3d28bb8e504be63","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:32.985Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-5cfeac4787b9a23b2deb7fe0: done: 0.017129 sec","job_status":"done","queue_duration_s":0.546854,"scheduling_latency_s":0.546874,"redis_calls":10,"redis_duration_s":0.002208,"redis_read_bytes":9,"redis_write_bytes":1133,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000408,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001304,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000496,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000342781,"duration_s":0.017129,"completed_at":"2026-09-06T06:50:33.549Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000741,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2545gitlab # [ 276.911336] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.550Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e3670ec0a51e2dde87cc474b","created_at":"2026-09-06T06:50:32.992Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a5b3f6ce3a5511eccad046a6e44c251b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.003Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e3670ec0a51e2dde87cc474b: start","job_status":"start","queue_duration_s":0.546914,"scheduling_latency_s":0.546933}2546gitlab # [ 276.917782] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.582Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e3670ec0a51e2dde87cc474b","created_at":"2026-09-06T06:50:32.992Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a5b3f6ce3a5511eccad046a6e44c251b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.003Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e3670ec0a51e2dde87cc474b: done: 0.031518 sec","job_status":"done","queue_duration_s":0.546914,"scheduling_latency_s":0.546933,"redis_calls":13,"redis_duration_s":0.002915,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000795,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001186,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000443632,"exclusive_lock_hold_duration_s":0.013028472,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.031518,"completed_at":"2026-09-06T06:50:33.582Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007731,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2547gitlab # [ 276.992410] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.583Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"2ee96a175055b9d3f693472c","created_at":"2026-09-06T06:50:33.008Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90dfab8239535602c16095be4e7f53fa","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.018Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-2ee96a175055b9d3f693472c: start","job_status":"start","queue_duration_s":0.564976,"scheduling_latency_s":0.564996}2548gitlab # [ 277.070502] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.605Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"2ee96a175055b9d3f693472c","created_at":"2026-09-06T06:50:33.008Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90dfab8239535602c16095be4e7f53fa","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.018Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-2ee96a175055b9d3f693472c: done: 0.022077 sec","job_status":"done","queue_duration_s":0.564976,"scheduling_latency_s":0.564996,"redis_calls":9,"redis_duration_s":0.002216,"redis_read_bytes":7,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000652,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00109,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022077,"completed_at":"2026-09-06T06:50:33.605Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00212,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2549gitlab # [ 277.075418] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.607Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1ea51fd8aa50d53c041a50e7","created_at":"2026-09-06T06:50:33.021Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80df2f954fe07089e1d22dafc028f070","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.029Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1ea51fd8aa50d53c041a50e7: start","job_status":"start","queue_duration_s":0.577364,"scheduling_latency_s":0.577385}2550gitlab # [ 277.154993] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.617Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2551gitlab # [ 277.156182] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.622Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1ea51fd8aa50d53c041a50e7","created_at":"2026-09-06T06:50:33.021Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80df2f954fe07089e1d22dafc028f070","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.029Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1ea51fd8aa50d53c041a50e7: done: 0.015294 sec","job_status":"done","queue_duration_s":0.577364,"scheduling_latency_s":0.577385,"redis_calls":9,"redis_duration_s":0.0018739999999999998,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000405,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001068,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000401,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015294,"completed_at":"2026-09-06T06:50:33.622Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000358,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2552gitlab # [ 277.169404] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.623Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"89ea21887b348ca32fa0ba83","created_at":"2026-09-06T06:50:33.032Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6eeaa16f4b4f193e8ececec4b60a476","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T06:50:33.043Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-89ea21887b348ca32fa0ba83: start","job_status":"start","queue_duration_s":0.580354,"scheduling_latency_s":0.580375}2553gitlab # [ 277.253095] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.646Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"89ea21887b348ca32fa0ba83","created_at":"2026-09-06T06:50:33.032Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6eeaa16f4b4f193e8ececec4b60a476","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-06T06:50:33.043Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-89ea21887b348ca32fa0ba83: done: 0.022239 sec","job_status":"done","queue_duration_s":0.580354,"scheduling_latency_s":0.580375,"redis_calls":9,"redis_duration_s":0.00197,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00046,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001104,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000406,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022239,"completed_at":"2026-09-06T06:50:33.646Z","load_balancing_strategy":"primary","db_duration_s":0.002351,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2554gitlab # [ 277.255198] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.647Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"bacd1a89c0f7d9ebd9eb28ce","created_at":"2026-09-06T06:50:33.060Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"067426aad892ed94ee2aace4e0094732","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.065Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-bacd1a89c0f7d9ebd9eb28ce: start","job_status":"start","queue_duration_s":0.581938,"scheduling_latency_s":0.581958}2555gitlab # [ 277.323098] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.664Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"bacd1a89c0f7d9ebd9eb28ce","created_at":"2026-09-06T06:50:33.060Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"067426aad892ed94ee2aace4e0094732","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.065Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-bacd1a89c0f7d9ebd9eb28ce: done: 0.017357 sec","job_status":"done","queue_duration_s":0.581938,"scheduling_latency_s":0.581958,"redis_calls":10,"redis_duration_s":0.002055,"redis_read_bytes":9,"redis_write_bytes":1087,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000397,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001252,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000406,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000351441,"duration_s":0.017357,"completed_at":"2026-09-06T06:50:33.664Z","load_balancing_strategy":"primary","db_duration_s":0.000352,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2556gitlab # [ 277.397566] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.666Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"562a24557092c5933f7639cf","created_at":"2026-09-06T06:50:33.068Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a33d9810388f55eae0e95795aa36cce5","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.073Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-562a24557092c5933f7639cf: start","job_status":"start","queue_duration_s":0.593237,"scheduling_latency_s":0.593274}2557gitlab # [ 277.398842] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.692Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"562a24557092c5933f7639cf","created_at":"2026-09-06T06:50:33.068Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a33d9810388f55eae0e95795aa36cce5","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.073Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-562a24557092c5933f7639cf: done: 0.026541 sec","job_status":"done","queue_duration_s":0.593237,"scheduling_latency_s":0.593274,"redis_calls":12,"redis_duration_s":0.002722,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000429,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001352,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.005741232,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.026541,"completed_at":"2026-09-06T06:50:33.692Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002222,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2558gitlab # [ 277.479069] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.694Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"f4582a2cbabbb987b548879f","created_at":"2026-09-06T06:50:33.104Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3b03ec0c2b97a4789e4ac3d54c7321f","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.111Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-f4582a2cbabbb987b548879f: start","job_status":"start","queue_duration_s":0.583148,"scheduling_latency_s":0.583168}2559gitlab # [ 277.480297] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.711Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"f4582a2cbabbb987b548879f","created_at":"2026-09-06T06:50:33.104Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3b03ec0c2b97a4789e4ac3d54c7321f","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.111Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-f4582a2cbabbb987b548879f: done: 0.017377 sec","job_status":"done","queue_duration_s":0.583148,"scheduling_latency_s":0.583168,"redis_calls":10,"redis_duration_s":0.0020740000000000003,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000403,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001262,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000409,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000346692,"duration_s":0.017377,"completed_at":"2026-09-06T06:50:33.711Z","load_balancing_strategy":"primary","db_duration_s":0.001124,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2560gitlab # [ 277.560174] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:33.713Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"9498236630c7517c954e12ba","created_at":"2026-09-06T06:50:33.114Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0b531a4f6b8d331782d4d6396cb8cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.120Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-9498236630c7517c954e12ba: start","job_status":"start","queue_duration_s":0.592767,"scheduling_latency_s":0.592786}2561gitlab # [ 277.561467] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.117Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"9498236630c7517c954e12ba","created_at":"2026-09-06T06:50:33.114Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0b531a4f6b8d331782d4d6396cb8cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.120Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-9498236630c7517c954e12ba: done: 0.404362 sec","job_status":"done","queue_duration_s":0.592767,"scheduling_latency_s":0.592786,"redis_calls":564,"redis_duration_s":0.116449,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00043,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001109,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.11491,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.330602,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.404362,"completed_at":"2026-09-06T06:50:34.117Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0004,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2562gitlab # [ 277.600313] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.118Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"3faa269f6cce42f68d4062bf","created_at":"2026-09-06T06:50:33.134Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4e6e07c53eeec9193d686f649edd068","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.147Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-3faa269f6cce42f68d4062bf: start","job_status":"start","queue_duration_s":0.971471,"scheduling_latency_s":0.971497}2563gitlab # [ 277.684846] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.143Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"3faa269f6cce42f68d4062bf","created_at":"2026-09-06T06:50:33.134Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4e6e07c53eeec9193d686f649edd068","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.147Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-3faa269f6cce42f68d4062bf: done: 0.024634 sec","job_status":"done","queue_duration_s":0.971471,"scheduling_latency_s":0.971497,"redis_calls":9,"redis_duration_s":0.002117,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000418,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001246,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000453,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.024634,"completed_at":"2026-09-06T06:50:34.143Z","load_balancing_strategy":"primary","db_duration_s":0.005807,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2564gitlab # [ 277.688398] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.144Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"4a2b32cec072c0a03a771902","created_at":"2026-09-06T06:50:33.152Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"470dae78bee35cf1f9b0f20f0c6d335f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.160Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-4a2b32cec072c0a03a771902: start","job_status":"start","queue_duration_s":0.984065,"scheduling_latency_s":0.984085}2565gitlab # [ 277.768370] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.160Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"4a2b32cec072c0a03a771902","created_at":"2026-09-06T06:50:33.152Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"470dae78bee35cf1f9b0f20f0c6d335f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.160Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-4a2b32cec072c0a03a771902: done: 0.015867 sec","job_status":"done","queue_duration_s":0.984065,"scheduling_latency_s":0.984085,"redis_calls":9,"redis_duration_s":0.001947,"redis_read_bytes":7,"redis_write_bytes":1192,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000422,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001109,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000416,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00989,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015867,"completed_at":"2026-09-06T06:50:34.160Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000407,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2566gitlab # [ 277.777177] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.161Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"ddfb527328727b78ba7c9006","created_at":"2026-09-06T06:50:33.175Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd08973644213c42f7e0e01cea5f84f6","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.190Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-ddfb527328727b78ba7c9006: start","job_status":"start","queue_duration_s":0.971813,"scheduling_latency_s":0.971833}2567gitlab # [ 277.849273] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.178Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"ddfb527328727b78ba7c9006","created_at":"2026-09-06T06:50:33.175Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd08973644213c42f7e0e01cea5f84f6","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.190Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-ddfb527328727b78ba7c9006: done: 0.016639 sec","job_status":"done","queue_duration_s":0.971813,"scheduling_latency_s":0.971833,"redis_calls":11,"redis_duration_s":0.002783,"redis_read_bytes":8,"redis_write_bytes":1094,"redis_cache_calls":2,"redis_cache_duration_s":0.00046,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000522,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001404,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000397,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016639,"completed_at":"2026-09-06T06:50:34.178Z","load_balancing_strategy":"primary","db_duration_s":0.000377,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2568gitlab # [ 277.920077] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.179Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"351dc559738f112d76bc4f69","created_at":"2026-09-06T06:50:33.204Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12c0fd8135aaf898eaa01890850d2a16","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.214Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-351dc559738f112d76bc4f69: start","job_status":"start","queue_duration_s":0.965565,"scheduling_latency_s":0.965586}2569gitlab # [ 277.921207] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.339Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"351dc559738f112d76bc4f69","created_at":"2026-09-06T06:50:33.204Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12c0fd8135aaf898eaa01890850d2a16","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.214Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-351dc559738f112d76bc4f69: done: 0.15919 sec","job_status":"done","queue_duration_s":0.965565,"scheduling_latency_s":0.965586,"redis_calls":13,"redis_duration_s":0.003239,"redis_read_bytes":11,"redis_write_bytes":1567,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001097,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0011,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.121205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000441676,"exclusive_lock_hold_duration_s":0.139623332,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.15919,"completed_at":"2026-09-06T06:50:34.339Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.045011,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2570gitlab # [ 278.003288] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.340Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a22c76bafa4d9aa41be25e0c","created_at":"2026-09-06T06:50:33.213Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c9a0d1853fff460a","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a14703e6019655dfcc7097edf5bbd346","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.230Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a22c76bafa4d9aa41be25e0c: start","job_status":"start","queue_duration_s":1.10955,"scheduling_latency_s":1.109572}2571gitlab # [ 278.004816] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.354Z","message":"No existing merge request to be cleaned up."}2572gitlab # [ 278.005951] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.362Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a22c76bafa4d9aa41be25e0c","created_at":"2026-09-06T06:50:33.213Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c9a0d1853fff460a","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a14703e6019655dfcc7097edf5bbd346","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.230Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a22c76bafa4d9aa41be25e0c: done: 0.022435 sec","job_status":"done","queue_duration_s":1.10955,"scheduling_latency_s":1.109572,"redis_calls":12,"redis_duration_s":0.0028640000000000002,"redis_read_bytes":10,"redis_write_bytes":1323,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000504,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00136,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014173,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022435,"completed_at":"2026-09-06T06:50:34.362Z","load_balancing_strategy":"primary","db_duration_s":0.002772,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2573gitlab # [ 278.038068] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.364Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e767c95bdda41e2b2d385c0e","created_at":"2026-09-06T06:50:33.213Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c9a0d1853fff460a","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a14703e6019655dfcc7097edf5bbd346","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.230Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e767c95bdda41e2b2d385c0e: start","job_status":"start","queue_duration_s":1.133272,"scheduling_latency_s":1.133293}2574gitlab # [ 278.113752] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.373Z","message":"No existing merge request to be cleaned up."}2575gitlab # [ 278.115249] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.383Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e767c95bdda41e2b2d385c0e","created_at":"2026-09-06T06:50:33.213Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c9a0d1853fff460a","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a14703e6019655dfcc7097edf5bbd346","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.230Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e767c95bdda41e2b2d385c0e: done: 0.018754 sec","job_status":"done","queue_duration_s":1.133272,"scheduling_latency_s":1.133293,"redis_calls":10,"redis_duration_s":0.0024720000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001559,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018754,"completed_at":"2026-09-06T06:50:34.382Z","load_balancing_strategy":"primary","db_duration_s":0.001955,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2576gitlab # [ 278.120218] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.384Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cebb50489a98c9956b6d9b0f","created_at":"2026-09-06T06:50:33.213Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c9a0d1853fff460a","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a14703e6019655dfcc7097edf5bbd346","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.230Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cebb50489a98c9956b6d9b0f: start","job_status":"start","queue_duration_s":1.15349,"scheduling_latency_s":1.153517}2577gitlab # [ 278.190094] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.394Z","message":"No existing merge request to be cleaned up."}2578gitlab # [ 278.191207] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.400Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cebb50489a98c9956b6d9b0f","created_at":"2026-09-06T06:50:33.213Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c9a0d1853fff460a","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a14703e6019655dfcc7097edf5bbd346","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.230Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cebb50489a98c9956b6d9b0f: done: 0.016505 sec","job_status":"done","queue_duration_s":1.15349,"scheduling_latency_s":1.153517,"redis_calls":10,"redis_duration_s":0.002339,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001035,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001304,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016505,"completed_at":"2026-09-06T06:50:34.400Z","load_balancing_strategy":"primary","db_duration_s":0.001501,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2579gitlab # [ 278.201817] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.402Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"40754818132a59d235ac977a","created_at":"2026-09-06T06:50:33.213Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c9a0d1853fff460a","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a14703e6019655dfcc7097edf5bbd346","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.230Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-40754818132a59d235ac977a: start","job_status":"start","queue_duration_s":1.171263,"scheduling_latency_s":1.171283}2580gitlab # [ 278.277083] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.411Z","message":"No existing merge request to be cleaned up."}2581gitlab # [ 278.278171] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.418Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"40754818132a59d235ac977a","created_at":"2026-09-06T06:50:33.213Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c9a0d1853fff460a","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a14703e6019655dfcc7097edf5bbd346","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.230Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-40754818132a59d235ac977a: done: 0.016537 sec","job_status":"done","queue_duration_s":1.171263,"scheduling_latency_s":1.171283,"redis_calls":10,"redis_duration_s":0.002437,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001016,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001421,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016537,"completed_at":"2026-09-06T06:50:34.418Z","load_balancing_strategy":"primary","db_duration_s":0.001474,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2582gitlab # [ 278.283218] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.420Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"9bbae46fb416927072c25e8d","created_at":"2026-09-06T06:50:33.223Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b5a65e555e2c873b0ab539422a74f32","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.240Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-9bbae46fb416927072c25e8d: start","job_status":"start","queue_duration_s":1.180088,"scheduling_latency_s":1.180112}2583gitlab # [ 278.353542] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.432Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2584gitlab # [ 278.355246] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.438Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"9bbae46fb416927072c25e8d","created_at":"2026-09-06T06:50:33.223Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b5a65e555e2c873b0ab539422a74f32","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.240Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-9bbae46fb416927072c25e8d: done: 0.01856 sec","job_status":"done","queue_duration_s":1.180088,"scheduling_latency_s":1.180112,"redis_calls":9,"redis_duration_s":0.002244,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00046,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001241,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000543,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01856,"completed_at":"2026-09-06T06:50:34.438Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00041,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2585gitlab # [ 278.378558] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.440Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"2a5ff47e9e691dc9a9e6de1f","created_at":"2026-09-06T06:50:33.264Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d7c9bbb7745d5f1f311ea32e4fd92e6","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.273Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-2a5ff47e9e691dc9a9e6de1f: start","job_status":"start","queue_duration_s":1.166821,"scheduling_latency_s":1.166846}2586gitlab # [ 278.401705] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.459Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"2a5ff47e9e691dc9a9e6de1f","created_at":"2026-09-06T06:50:33.264Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-25f89b1f28294552","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d7c9bbb7745d5f1f311ea32e4fd92e6","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.273Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-2a5ff47e9e691dc9a9e6de1f: done: 0.018882 sec","job_status":"done","queue_duration_s":1.166821,"scheduling_latency_s":1.166846,"redis_calls":9,"redis_duration_s":0.002095,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000472,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001121,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000502,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018882,"completed_at":"2026-09-06T06:50:34.459Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001769,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2587gitlab # [ 278.480142] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.460Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"4f51766fea41bdc449f3d18c","created_at":"2026-09-06T06:50:33.311Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-ca37d816effd40bc","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"35c4cfd6a2c127313433870d7bf37f17","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.317Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-4f51766fea41bdc449f3d18c: start","job_status":"start","queue_duration_s":1.143009,"scheduling_latency_s":1.143029}2588gitlab # [ 278.487489] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.487Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"4f51766fea41bdc449f3d18c","created_at":"2026-09-06T06:50:33.311Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-ca37d816effd40bc","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"35c4cfd6a2c127313433870d7bf37f17","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.317Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-4f51766fea41bdc449f3d18c: done: 0.027026 sec","job_status":"done","queue_duration_s":1.143009,"scheduling_latency_s":1.143029,"redis_calls":13,"redis_duration_s":0.002817,"redis_read_bytes":12,"redis_write_bytes":1785,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00043,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":365,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001036,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":559,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001351,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":861,"db_count":5,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000428267,"duration_s":0.027026,"completed_at":"2026-09-06T06:50:34.487Z","load_balancing_strategy":"primary","db_duration_s":0.002886,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2589gitlab # [ 278.582463] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"46101bbb656159d284cbf216","created_at":"2026-09-06T06:50:33.311Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-ca37d816effd40bc","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"35c4cfd6a2c127313433870d7bf37f17","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.317Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-46101bbb656159d284cbf216: start","job_status":"start","queue_duration_s":1.171385,"scheduling_latency_s":1.171405}2590gitlab # [ 278.583977] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"46101bbb656159d284cbf216","created_at":"2026-09-06T06:50:33.311Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-ca37d816effd40bc","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"35c4cfd6a2c127313433870d7bf37f17","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.317Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-46101bbb656159d284cbf216: done: 0.021237 sec","job_status":"done","queue_duration_s":1.171385,"scheduling_latency_s":1.171405,"redis_calls":10,"redis_duration_s":0.002146,"redis_read_bytes":8,"redis_write_bytes":1310,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000826,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":449,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00132,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":861,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021237,"completed_at":"2026-09-06T06:50:34.510Z","load_balancing_strategy":"primary","db_duration_s":0.002477,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2591gitlab # [ 278.669975] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"f46d34a534dd6551a2ac0238","created_at":"2026-09-06T06:50:33.311Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-ca37d816effd40bc","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"35c4cfd6a2c127313433870d7bf37f17","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.317Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-f46d34a534dd6551a2ac0238: start","job_status":"start","queue_duration_s":1.193864,"scheduling_latency_s":1.193885}2592gitlab # [ 278.671710] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"f46d34a534dd6551a2ac0238","created_at":"2026-09-06T06:50:33.311Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-ca37d816effd40bc","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"35c4cfd6a2c127313433870d7bf37f17","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.317Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-f46d34a534dd6551a2ac0238: done: 0.021622 sec","job_status":"done","queue_duration_s":1.193864,"scheduling_latency_s":1.193885,"redis_calls":10,"redis_duration_s":0.002198,"redis_read_bytes":8,"redis_write_bytes":1310,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":449,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001299,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":861,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021622,"completed_at":"2026-09-06T06:50:34.532Z","load_balancing_strategy":"primary","db_duration_s":0.002909,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2593gitlab # [ 278.741169] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"350a36d800eb5d980aba7fb0","created_at":"2026-09-06T06:50:33.311Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-ca37d816effd40bc","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"35c4cfd6a2c127313433870d7bf37f17","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.317Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-350a36d800eb5d980aba7fb0: start","job_status":"start","queue_duration_s":1.216795,"scheduling_latency_s":1.216815}2594gitlab # [ 278.742282] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.555Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"350a36d800eb5d980aba7fb0","created_at":"2026-09-06T06:50:33.311Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-ca37d816effd40bc","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"35c4cfd6a2c127313433870d7bf37f17","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.317Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-350a36d800eb5d980aba7fb0: done: 0.02121 sec","job_status":"done","queue_duration_s":1.216795,"scheduling_latency_s":1.216815,"redis_calls":10,"redis_duration_s":0.002204,"redis_read_bytes":8,"redis_write_bytes":1310,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000881,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":449,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001323,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":861,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02121,"completed_at":"2026-09-06T06:50:34.555Z","load_balancing_strategy":"primary","db_duration_s":0.00251,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2595gitlab # [ 278.814933] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.556Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0e4548d0ce912d983ac9c6c","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0e4548d0ce912d983ac9c6c: start","job_status":"start","queue_duration_s":1.093915,"scheduling_latency_s":1.093981}2596gitlab # [ 278.819511] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0e4548d0ce912d983ac9c6c","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0e4548d0ce912d983ac9c6c: done: 0.01932 sec","job_status":"done","queue_duration_s":1.093915,"scheduling_latency_s":1.093981,"redis_calls":15,"redis_duration_s":0.003193,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000458,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000859,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001876,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01932,"completed_at":"2026-09-06T06:50:34.576Z","load_balancing_strategy":"primary","db_duration_s":0.000353,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2597gitlab # [ 278.888053] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.577Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4338df12e71fc597519cee4b","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4338df12e71fc597519cee4b: start","job_status":"start","queue_duration_s":1.114515,"scheduling_latency_s":1.114535}2598gitlab # [ 278.902139] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4338df12e71fc597519cee4b","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4338df12e71fc597519cee4b: done: 0.014925 sec","job_status":"done","queue_duration_s":1.114515,"scheduling_latency_s":1.114535,"redis_calls":13,"redis_duration_s":0.002807,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000908,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014925,"completed_at":"2026-09-06T06:50:34.592Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2599gitlab # [ 279.027145] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"617d991a154f7d656e62edcf","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-617d991a154f7d656e62edcf: start","job_status":"start","queue_duration_s":1.130901,"scheduling_latency_s":1.130922}2600gitlab # [ 279.028849] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"617d991a154f7d656e62edcf","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-617d991a154f7d656e62edcf: done: 0.015045 sec","job_status":"done","queue_duration_s":1.130901,"scheduling_latency_s":1.130922,"redis_calls":13,"redis_duration_s":0.0029300000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015045,"completed_at":"2026-09-06T06:50:34.608Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2601gitlab # [ 279.098160] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.610Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06bd703c88a3e7d1b9e2ff92","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06bd703c88a3e7d1b9e2ff92: start","job_status":"start","queue_duration_s":1.147274,"scheduling_latency_s":1.147294}2602gitlab # [ 279.099744] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06bd703c88a3e7d1b9e2ff92","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06bd703c88a3e7d1b9e2ff92: done: 0.014979 sec","job_status":"done","queue_duration_s":1.147274,"scheduling_latency_s":1.147294,"redis_calls":13,"redis_duration_s":0.002861,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000874,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014979,"completed_at":"2026-09-06T06:50:34.625Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2603gitlab # [ 279.178180] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f81d87d9c1c61aa28163b3df","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f81d87d9c1c61aa28163b3df: start","job_status":"start","queue_duration_s":1.163515,"scheduling_latency_s":1.163536}2604gitlab # [ 279.179458] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f81d87d9c1c61aa28163b3df","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f81d87d9c1c61aa28163b3df: done: 0.014935 sec","job_status":"done","queue_duration_s":1.163515,"scheduling_latency_s":1.163536,"redis_calls":13,"redis_duration_s":0.002853,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000863,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00199,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014935,"completed_at":"2026-09-06T06:50:34.641Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2605gitlab # [ 279.205087] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f47c74521e90f7b0cdb7180f","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f47c74521e90f7b0cdb7180f: start","job_status":"start","queue_duration_s":1.179746,"scheduling_latency_s":1.179766}2606gitlab # [ 279.276348] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f47c74521e90f7b0cdb7180f","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f47c74521e90f7b0cdb7180f: done: 0.014901 sec","job_status":"done","queue_duration_s":1.179746,"scheduling_latency_s":1.179766,"redis_calls":13,"redis_duration_s":0.002689,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000857,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001832,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014901,"completed_at":"2026-09-06T06:50:34.657Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2607gitlab # [ 279.285301] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8d1b7ad3ab981f2bb763226","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8d1b7ad3ab981f2bb763226: start","job_status":"start","queue_duration_s":1.195923,"scheduling_latency_s":1.195985}2608gitlab # [ 279.359378] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.675Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8d1b7ad3ab981f2bb763226","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8d1b7ad3ab981f2bb763226: done: 0.017014 sec","job_status":"done","queue_duration_s":1.195923,"scheduling_latency_s":1.195985,"redis_calls":13,"redis_duration_s":0.002989,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017014,"completed_at":"2026-09-06T06:50:34.675Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2609gitlab # [ 279.365349] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.677Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8281a05a737ca15dce98ef8","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8281a05a737ca15dce98ef8: start","job_status":"start","queue_duration_s":1.214436,"scheduling_latency_s":1.214462}2610gitlab # [ 279.447338] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.693Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8281a05a737ca15dce98ef8","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8281a05a737ca15dce98ef8: done: 0.016041 sec","job_status":"done","queue_duration_s":1.214436,"scheduling_latency_s":1.214462,"redis_calls":13,"redis_duration_s":0.002931,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010465,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016041,"completed_at":"2026-09-06T06:50:34.693Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2611gitlab # [ 279.449148] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6a26547bfaf6c403b736f09","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6a26547bfaf6c403b736f09: start","job_status":"start","queue_duration_s":1.232319,"scheduling_latency_s":1.232342}2612gitlab # [ 279.523975] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6a26547bfaf6c403b736f09","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6a26547bfaf6c403b736f09: done: 0.068801 sec","job_status":"done","queue_duration_s":1.232319,"scheduling_latency_s":1.232342,"redis_calls":13,"redis_duration_s":0.002745,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001856,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.068801,"completed_at":"2026-09-06T06:50:34.763Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2613gitlab # [ 279.526127] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a0d4d313d08d89a4b7829ad","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a0d4d313d08d89a4b7829ad: start","job_status":"start","queue_duration_s":1.302744,"scheduling_latency_s":1.302768}2614gitlab # [ 279.601363] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a0d4d313d08d89a4b7829ad","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a0d4d313d08d89a4b7829ad: done: 0.018742 sec","job_status":"done","queue_duration_s":1.302744,"scheduling_latency_s":1.302768,"redis_calls":13,"redis_duration_s":0.003065,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001016,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002049,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018742,"completed_at":"2026-09-06T06:50:34.784Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2615gitlab # [ 279.605928] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2baf36529c951bf64c600850","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2baf36529c951bf64c600850: start","job_status":"start","queue_duration_s":1.322896,"scheduling_latency_s":1.322922}2616gitlab # [ 279.625515] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2baf36529c951bf64c600850","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2baf36529c951bf64c600850: done: 0.015218 sec","job_status":"done","queue_duration_s":1.322896,"scheduling_latency_s":1.322922,"redis_calls":13,"redis_duration_s":0.002809,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000857,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015218,"completed_at":"2026-09-06T06:50:34.800Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2617gitlab # [ 279.708183] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0dc026d7c186d5d60dc18ef7","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0dc026d7c186d5d60dc18ef7: start","job_status":"start","queue_duration_s":1.339829,"scheduling_latency_s":1.339849}2618gitlab # [ 279.709797] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0dc026d7c186d5d60dc18ef7","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0dc026d7c186d5d60dc18ef7: done: 0.015008 sec","job_status":"done","queue_duration_s":1.339829,"scheduling_latency_s":1.339849,"redis_calls":13,"redis_duration_s":0.002731,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000864,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001867,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015008,"completed_at":"2026-09-06T06:50:34.817Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2619gitlab # [ 279.778237] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.819Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"201e05ba43fd89b3be03b8a7","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-201e05ba43fd89b3be03b8a7: start","job_status":"start","queue_duration_s":1.356131,"scheduling_latency_s":1.356151}2620gitlab # [ 279.786176] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"201e05ba43fd89b3be03b8a7","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-201e05ba43fd89b3be03b8a7: done: 0.015044 sec","job_status":"done","queue_duration_s":1.356131,"scheduling_latency_s":1.356151,"redis_calls":13,"redis_duration_s":0.0027949999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000856,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015044,"completed_at":"2026-09-06T06:50:34.834Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2621gitlab # [ 279.865859] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fb75906f346ac1b2c424781","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fb75906f346ac1b2c424781: start","job_status":"start","queue_duration_s":1.372708,"scheduling_latency_s":1.372728}2622gitlab # [ 279.867357] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fb75906f346ac1b2c424781","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fb75906f346ac1b2c424781: done: 0.01501 sec","job_status":"done","queue_duration_s":1.372708,"scheduling_latency_s":1.372728,"redis_calls":13,"redis_duration_s":0.003028,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000879,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002149,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01501,"completed_at":"2026-09-06T06:50:34.850Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2623gitlab # [ 279.951319] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c0b5bc24ec6f3e261718edb","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c0b5bc24ec6f3e261718edb: start","job_status":"start","queue_duration_s":1.389004,"scheduling_latency_s":1.389025}2624gitlab # [ 279.952959] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c0b5bc24ec6f3e261718edb","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c0b5bc24ec6f3e261718edb: done: 0.014963 sec","job_status":"done","queue_duration_s":1.389004,"scheduling_latency_s":1.389025,"redis_calls":13,"redis_duration_s":0.0027210000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001832,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014963,"completed_at":"2026-09-06T06:50:34.866Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2625gitlab # [ 280.022137] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.868Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ff191cec05668b6f02ed70b","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ff191cec05668b6f02ed70b: start","job_status":"start","queue_duration_s":1.405239,"scheduling_latency_s":1.405259}2626gitlab # [ 280.027454] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.883Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ff191cec05668b6f02ed70b","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ff191cec05668b6f02ed70b: done: 0.015448 sec","job_status":"done","queue_duration_s":1.405239,"scheduling_latency_s":1.405259,"redis_calls":13,"redis_duration_s":0.002761,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015448,"completed_at":"2026-09-06T06:50:34.883Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2627gitlab # [ 280.108965] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.884Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6d79e6d11fd10a6b8049a13","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6d79e6d11fd10a6b8049a13: start","job_status":"start","queue_duration_s":1.421982,"scheduling_latency_s":1.422001}2628gitlab # [ 280.110163] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.900Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6d79e6d11fd10a6b8049a13","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6d79e6d11fd10a6b8049a13: done: 0.016 sec","job_status":"done","queue_duration_s":1.421982,"scheduling_latency_s":1.422001,"redis_calls":13,"redis_duration_s":0.003905,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00304,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016,"completed_at":"2026-09-06T06:50:34.900Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2629gitlab # [ 280.182199] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b72ff5289007ddbba216c1e","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b72ff5289007ddbba216c1e: start","job_status":"start","queue_duration_s":1.439258,"scheduling_latency_s":1.439277}2630gitlab # [ 280.188122] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b72ff5289007ddbba216c1e","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b72ff5289007ddbba216c1e: done: 0.015031 sec","job_status":"done","queue_duration_s":1.439258,"scheduling_latency_s":1.439277,"redis_calls":13,"redis_duration_s":0.002715,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001861,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015031,"completed_at":"2026-09-06T06:50:34.917Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2631gitlab # [ 280.262197] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fa01603c189f2804ffc95d2","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fa01603c189f2804ffc95d2: start","job_status":"start","queue_duration_s":1.455531,"scheduling_latency_s":1.455551}2632gitlab # [ 280.268125] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.933Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fa01603c189f2804ffc95d2","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fa01603c189f2804ffc95d2: done: 0.015318 sec","job_status":"done","queue_duration_s":1.455531,"scheduling_latency_s":1.455551,"redis_calls":13,"redis_duration_s":0.002683,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000868,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001815,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015318,"completed_at":"2026-09-06T06:50:34.933Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2633gitlab # [ 280.354093] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.935Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de373f09e394fefb48b69f31","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de373f09e394fefb48b69f31: start","job_status":"start","queue_duration_s":1.472166,"scheduling_latency_s":1.472186}2634gitlab # [ 280.355472] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de373f09e394fefb48b69f31","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de373f09e394fefb48b69f31: done: 0.014905 sec","job_status":"done","queue_duration_s":1.472166,"scheduling_latency_s":1.472186,"redis_calls":13,"redis_duration_s":0.002726,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014905,"completed_at":"2026-09-06T06:50:34.949Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2635gitlab # [ 280.437338] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aca24a0d09282391764ead8a","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aca24a0d09282391764ead8a: start","job_status":"start","queue_duration_s":1.488335,"scheduling_latency_s":1.488356}2636gitlab # [ 280.439409] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.966Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aca24a0d09282391764ead8a","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aca24a0d09282391764ead8a: done: 0.014964 sec","job_status":"done","queue_duration_s":1.488335,"scheduling_latency_s":1.488356,"redis_calls":13,"redis_duration_s":0.002712,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001858,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014964,"completed_at":"2026-09-06T06:50:34.966Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2637gitlab # [ 280.493850] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7117bcd67d56793dfdea9ba","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7117bcd67d56793dfdea9ba: start","job_status":"start","queue_duration_s":1.504831,"scheduling_latency_s":1.504851}2638gitlab # [ 280.570457] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.983Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7117bcd67d56793dfdea9ba","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7117bcd67d56793dfdea9ba: done: 0.015507 sec","job_status":"done","queue_duration_s":1.504831,"scheduling_latency_s":1.504851,"redis_calls":13,"redis_duration_s":0.003118,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000821,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002297,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015507,"completed_at":"2026-09-06T06:50:34.983Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2639gitlab # [ 280.574206] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a1e279f47a3578f0439ee81","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a1e279f47a3578f0439ee81: start","job_status":"start","queue_duration_s":1.521597,"scheduling_latency_s":1.521616}2640gitlab # [ 280.644467] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:34.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a1e279f47a3578f0439ee81","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a1e279f47a3578f0439ee81: done: 0.015209 sec","job_status":"done","queue_duration_s":1.521597,"scheduling_latency_s":1.521616,"redis_calls":13,"redis_duration_s":0.0028799999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000846,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002034,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015209,"completed_at":"2026-09-06T06:50:34.999Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2641gitlab # [ 280.655150] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b0687bd5b1040cf6cdcdcf5","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b0687bd5b1040cf6cdcdcf5: start","job_status":"start","queue_duration_s":1.538551,"scheduling_latency_s":1.538571}2642gitlab # [ 280.675455] gitlab-workhorse[828]: time="2026-09-06T06:50:37Z" level=error correlation_id=01M1TQQ9G2RMJX8DSP1K5ES0SG duration_ms=5001 error="badgateway: failed to receive response: context canceled" method=POST uri="/api/v4/projects/root%2Ftest-flake/statuses/93214664af3f47b7fe6cc14cc480b997481ac1ac"2643gitlab # [ 280.746276] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:37 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 499 24 "" "python-httpx/0.28.1" 50022644gitlab # [ 280.747141] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b0687bd5b1040cf6cdcdcf5","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b0687bd5b1040cf6cdcdcf5: done: 0.015055 sec","job_status":"done","queue_duration_s":1.538551,"scheduling_latency_s":1.538571,"redis_calls":13,"redis_duration_s":0.00268,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000888,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001792,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015055,"completed_at":"2026-09-06T06:50:35.016Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2645gitlab # [ 280.748818] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7cd546b5e45f4a19761eb53","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7cd546b5e45f4a19761eb53: start","job_status":"start","queue_duration_s":1.55486,"scheduling_latency_s":1.554881}2646gitlab # [ 280.765145] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.032Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7cd546b5e45f4a19761eb53","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7cd546b5e45f4a19761eb53: done: 0.015011 sec","job_status":"done","queue_duration_s":1.55486,"scheduling_latency_s":1.554881,"redis_calls":13,"redis_duration_s":0.002748,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000862,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015011,"completed_at":"2026-09-06T06:50:35.032Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2647gitlab # [ 280.843063] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0cd676a58a970b5bca6469bf","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0cd676a58a970b5bca6469bf: start","job_status":"start","queue_duration_s":1.571532,"scheduling_latency_s":1.571553}2648gitlab # [ 280.845931] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.049Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0cd676a58a970b5bca6469bf","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0cd676a58a970b5bca6469bf: done: 0.014986 sec","job_status":"done","queue_duration_s":1.571532,"scheduling_latency_s":1.571553,"redis_calls":13,"redis_duration_s":0.002756,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014986,"completed_at":"2026-09-06T06:50:35.049Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2649gitlab # [ 280.922230] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.050Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b56cd6f84bd0db59c813d5ae","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b56cd6f84bd0db59c813d5ae: start","job_status":"start","queue_duration_s":1.587792,"scheduling_latency_s":1.587812}2650gitlab # [ 280.926125] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b56cd6f84bd0db59c813d5ae","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b56cd6f84bd0db59c813d5ae: done: 0.015056 sec","job_status":"done","queue_duration_s":1.587792,"scheduling_latency_s":1.587812,"redis_calls":13,"redis_duration_s":0.002734,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001869,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015056,"completed_at":"2026-09-06T06:50:35.065Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2651gitlab # [ 281.006049] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.067Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3e1cc6783fb3ffaa37b5323","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3e1cc6783fb3ffaa37b5323: start","job_status":"start","queue_duration_s":1.604568,"scheduling_latency_s":1.604589}2652gitlab # [ 281.007194] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3e1cc6783fb3ffaa37b5323","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3e1cc6783fb3ffaa37b5323: done: 0.015182 sec","job_status":"done","queue_duration_s":1.604568,"scheduling_latency_s":1.604589,"redis_calls":13,"redis_duration_s":0.002755,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000892,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001863,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015182,"completed_at":"2026-09-06T06:50:35.082Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2653gitlab # [ 281.104815] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89fff33ed3c19d1d0bfef845","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89fff33ed3c19d1d0bfef845: start","job_status":"start","queue_duration_s":1.621025,"scheduling_latency_s":1.621045}2654gitlab # [ 281.106275] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89fff33ed3c19d1d0bfef845","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89fff33ed3c19d1d0bfef845: done: 0.015088 sec","job_status":"done","queue_duration_s":1.621025,"scheduling_latency_s":1.621045,"redis_calls":13,"redis_duration_s":0.002874,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001064,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00181,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015088,"completed_at":"2026-09-06T06:50:35.098Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2655gitlab # [ 281.181217] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.100Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59b7a45a6493d53039165b62","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59b7a45a6493d53039165b62: start","job_status":"start","queue_duration_s":1.637707,"scheduling_latency_s":1.637728}2656gitlab # [ 281.182816] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.115Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59b7a45a6493d53039165b62","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59b7a45a6493d53039165b62: done: 0.01503 sec","job_status":"done","queue_duration_s":1.637707,"scheduling_latency_s":1.637728,"redis_calls":13,"redis_duration_s":0.002747,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00085,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01503,"completed_at":"2026-09-06T06:50:35.115Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2657gitlab # [ 281.261215] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.116Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eec9699fe3f9d28829d31ca8","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eec9699fe3f9d28829d31ca8: start","job_status":"start","queue_duration_s":1.65403,"scheduling_latency_s":1.654051}2658gitlab # [ 281.262770] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.132Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eec9699fe3f9d28829d31ca8","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eec9699fe3f9d28829d31ca8: done: 0.015112 sec","job_status":"done","queue_duration_s":1.65403,"scheduling_latency_s":1.654051,"redis_calls":13,"redis_duration_s":0.002746,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00082,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015112,"completed_at":"2026-09-06T06:50:35.132Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2659gitlab # [ 281.333933] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.133Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ddb98be6151f2aa9f645e9bc","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ddb98be6151f2aa9f645e9bc: start","job_status":"start","queue_duration_s":1.670435,"scheduling_latency_s":1.670455}2660gitlab # [ 281.335151] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ddb98be6151f2aa9f645e9bc","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ddb98be6151f2aa9f645e9bc: done: 0.015639 sec","job_status":"done","queue_duration_s":1.670435,"scheduling_latency_s":1.670455,"redis_calls":13,"redis_duration_s":0.002671,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000816,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001855,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015639,"completed_at":"2026-09-06T06:50:35.148Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2661gitlab # [ 281.408942] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.150Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"387950e0473c329c31ac9ad9","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-387950e0473c329c31ac9ad9: start","job_status":"start","queue_duration_s":1.687343,"scheduling_latency_s":1.687363}2662gitlab # [ 281.410204] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.165Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"387950e0473c329c31ac9ad9","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-387950e0473c329c31ac9ad9: done: 0.015066 sec","job_status":"done","queue_duration_s":1.687343,"scheduling_latency_s":1.687363,"redis_calls":13,"redis_duration_s":0.0026880000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000809,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001879,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010305,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015066,"completed_at":"2026-09-06T06:50:35.165Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2663gitlab # [ 281.501607] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44c9c1fc2465b22e0899a718","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44c9c1fc2465b22e0899a718: start","job_status":"start","queue_duration_s":1.703675,"scheduling_latency_s":1.703695}2664gitlab # [ 281.502848] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.182Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44c9c1fc2465b22e0899a718","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44c9c1fc2465b22e0899a718: done: 0.015644 sec","job_status":"done","queue_duration_s":1.703675,"scheduling_latency_s":1.703695,"redis_calls":13,"redis_duration_s":0.0031000000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001232,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001868,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015644,"completed_at":"2026-09-06T06:50:35.182Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2665gitlab # [ 281.585356] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7955bb00f8a63a671b999b9","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7955bb00f8a63a671b999b9: start","job_status":"start","queue_duration_s":1.720609,"scheduling_latency_s":1.72063}2666gitlab # [ 281.586897] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7955bb00f8a63a671b999b9","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7955bb00f8a63a671b999b9: done: 0.015202 sec","job_status":"done","queue_duration_s":1.720609,"scheduling_latency_s":1.72063,"redis_calls":13,"redis_duration_s":0.002851,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000868,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015202,"completed_at":"2026-09-06T06:50:35.198Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2667gitlab # [ 281.655216] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ce0e4ff7e659646b5e2bb5b","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ce0e4ff7e659646b5e2bb5b: start","job_status":"start","queue_duration_s":1.737145,"scheduling_latency_s":1.737176}2668gitlab # [ 281.656367] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ce0e4ff7e659646b5e2bb5b","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ce0e4ff7e659646b5e2bb5b: done: 0.017323 sec","job_status":"done","queue_duration_s":1.737145,"scheduling_latency_s":1.737176,"redis_calls":13,"redis_duration_s":0.0029490000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001028,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011721,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017323,"completed_at":"2026-09-06T06:50:35.217Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2669gitlab # [ 281.734342] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4538b95af4f15b80d14a78b8","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4538b95af4f15b80d14a78b8: start","job_status":"start","queue_duration_s":1.756192,"scheduling_latency_s":1.756219}2670gitlab # [ 281.735980] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.236Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4538b95af4f15b80d14a78b8","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4538b95af4f15b80d14a78b8: done: 0.017194 sec","job_status":"done","queue_duration_s":1.756192,"scheduling_latency_s":1.756219,"redis_calls":13,"redis_duration_s":0.002798,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010638,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017194,"completed_at":"2026-09-06T06:50:35.236Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2671gitlab # [ 281.806267] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2f01578e81ba7d1d39cfb04","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2f01578e81ba7d1d39cfb04: start","job_status":"start","queue_duration_s":1.7747,"scheduling_latency_s":1.77472}2672gitlab # [ 281.809307] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2f01578e81ba7d1d39cfb04","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2f01578e81ba7d1d39cfb04: done: 0.015385 sec","job_status":"done","queue_duration_s":1.7747,"scheduling_latency_s":1.77472,"redis_calls":13,"redis_duration_s":0.002694,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000846,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001848,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015385,"completed_at":"2026-09-06T06:50:35.252Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2673gitlab # [ 281.881338] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.254Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"479367627542746d6d743635","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-479367627542746d6d743635: start","job_status":"start","queue_duration_s":1.79134,"scheduling_latency_s":1.79136}2674gitlab # [ 281.952901] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.269Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"479367627542746d6d743635","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-479367627542746d6d743635: done: 0.015354 sec","job_status":"done","queue_duration_s":1.79134,"scheduling_latency_s":1.79136,"redis_calls":13,"redis_duration_s":0.002656,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000805,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001851,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015354,"completed_at":"2026-09-06T06:50:35.269Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2675gitlab # [ 281.955113] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0b0d2ada95c42bc45cabb28","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0b0d2ada95c42bc45cabb28: start","job_status":"start","queue_duration_s":1.807995,"scheduling_latency_s":1.808016}2676gitlab # [ 282.026128] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.286Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0b0d2ada95c42bc45cabb28","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0b0d2ada95c42bc45cabb28: done: 0.015843 sec","job_status":"done","queue_duration_s":1.807995,"scheduling_latency_s":1.808016,"redis_calls":13,"redis_duration_s":0.002732,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001834,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015843,"completed_at":"2026-09-06T06:50:35.286Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2677gitlab # [ 282.029050] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"674b1f2416fa1fd554c90e5b","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-674b1f2416fa1fd554c90e5b: start","job_status":"start","queue_duration_s":1.825118,"scheduling_latency_s":1.825138}2678gitlab # [ 282.097939] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.303Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"674b1f2416fa1fd554c90e5b","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-674b1f2416fa1fd554c90e5b: done: 0.015358 sec","job_status":"done","queue_duration_s":1.825118,"scheduling_latency_s":1.825138,"redis_calls":13,"redis_duration_s":0.002923,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000833,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00209,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015358,"completed_at":"2026-09-06T06:50:35.303Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2679gitlab # [ 282.168241] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"596dc12dd4d70b47333a97c2","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-596dc12dd4d70b47333a97c2: start","job_status":"start","queue_duration_s":1.842144,"scheduling_latency_s":1.842174}2680gitlab # [ 282.169794] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.320Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"596dc12dd4d70b47333a97c2","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-596dc12dd4d70b47333a97c2: done: 0.015074 sec","job_status":"done","queue_duration_s":1.842144,"scheduling_latency_s":1.842174,"redis_calls":13,"redis_duration_s":0.00301,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000816,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002194,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010184,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015074,"completed_at":"2026-09-06T06:50:35.320Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2681gitlab # [ 282.240955] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21a50370ce84e4d32de7fc0f","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21a50370ce84e4d32de7fc0f: start","job_status":"start","queue_duration_s":1.858487,"scheduling_latency_s":1.858507}2682gitlab # [ 282.242144] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21a50370ce84e4d32de7fc0f","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21a50370ce84e4d32de7fc0f: done: 0.015143 sec","job_status":"done","queue_duration_s":1.858487,"scheduling_latency_s":1.858507,"redis_calls":13,"redis_duration_s":0.0026569999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000841,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001816,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015143,"completed_at":"2026-09-06T06:50:35.336Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2683gitlab # [ 282.323177] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"588f69a8d275a084d823dded","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-588f69a8d275a084d823dded: start","job_status":"start","queue_duration_s":1.87489,"scheduling_latency_s":1.87491}2684gitlab # [ 282.324816] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"588f69a8d275a084d823dded","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-588f69a8d275a084d823dded: done: 0.015525 sec","job_status":"done","queue_duration_s":1.87489,"scheduling_latency_s":1.87491,"redis_calls":13,"redis_duration_s":0.0027559999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000815,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015525,"completed_at":"2026-09-06T06:50:35.353Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2685gitlab # [ 282.396238] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66d39bd80e05cbd74909f310","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66d39bd80e05cbd74909f310: start","job_status":"start","queue_duration_s":1.89168,"scheduling_latency_s":1.891701}2686gitlab # [ 282.397870] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66d39bd80e05cbd74909f310","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66d39bd80e05cbd74909f310: done: 0.015057 sec","job_status":"done","queue_duration_s":1.89168,"scheduling_latency_s":1.891701,"redis_calls":13,"redis_duration_s":0.00271,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000839,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001871,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015057,"completed_at":"2026-09-06T06:50:35.369Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2687gitlab # [ 282.473184] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb3d9ee47802ecfdfe5ab14f","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb3d9ee47802ecfdfe5ab14f: start","job_status":"start","queue_duration_s":1.908049,"scheduling_latency_s":1.908069}2688gitlab # [ 282.474754] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb3d9ee47802ecfdfe5ab14f","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb3d9ee47802ecfdfe5ab14f: done: 0.015334 sec","job_status":"done","queue_duration_s":1.908049,"scheduling_latency_s":1.908069,"redis_calls":13,"redis_duration_s":0.0028580000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000987,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001871,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015334,"completed_at":"2026-09-06T06:50:35.386Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2689gitlab # [ 282.543302] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b64584f42d5743eb783bccea","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b64584f42d5743eb783bccea: start","job_status":"start","queue_duration_s":1.924664,"scheduling_latency_s":1.924684}2690gitlab # [ 282.544377] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b64584f42d5743eb783bccea","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b64584f42d5743eb783bccea: done: 0.015197 sec","job_status":"done","queue_duration_s":1.924664,"scheduling_latency_s":1.924684,"redis_calls":13,"redis_duration_s":0.002891,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000859,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015197,"completed_at":"2026-09-06T06:50:35.402Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2691gitlab # [ 282.632132] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9515f35a915b5fb5365a221b","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9515f35a915b5fb5365a221b: start","job_status":"start","queue_duration_s":1.941414,"scheduling_latency_s":1.941433}2692gitlab # [ 282.633819] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.419Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9515f35a915b5fb5365a221b","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9515f35a915b5fb5365a221b: done: 0.015213 sec","job_status":"done","queue_duration_s":1.941414,"scheduling_latency_s":1.941433,"redis_calls":13,"redis_duration_s":0.002772,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015213,"completed_at":"2026-09-06T06:50:35.419Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2693gitlab # [ 282.702162] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.420Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d32e71f0c102bcaf6921dd4","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d32e71f0c102bcaf6921dd4: start","job_status":"start","queue_duration_s":1.957907,"scheduling_latency_s":1.957928}2694gitlab # [ 282.703750] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.436Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d32e71f0c102bcaf6921dd4","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d32e71f0c102bcaf6921dd4: done: 0.015386 sec","job_status":"done","queue_duration_s":1.957907,"scheduling_latency_s":1.957928,"redis_calls":13,"redis_duration_s":0.002677,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001823,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010495,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015386,"completed_at":"2026-09-06T06:50:35.436Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2695gitlab # [ 282.771937] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"530a6f347424ed0ff12d8f02","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-530a6f347424ed0ff12d8f02: start","job_status":"start","queue_duration_s":1.974593,"scheduling_latency_s":1.974614}2696gitlab # [ 282.773097] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:35.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"530a6f347424ed0ff12d8f02","created_at":"2026-09-06T06:50:33.400Z","trace_propagation_headers":{"sentry-trace":"861e7e84af6b4028b183c9bb86c560b4-c4e9e98d2a504e77","baggage":"sentry-trace_id=861e7e84af6b4028b183c9bb86c560b4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"47ad12d302b982f24a9e878f24b17ad4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-06T06:50:33.462Z","job_size_bytes":2,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-530a6f347424ed0ff12d8f02: done: 0.015236 sec","job_status":"done","queue_duration_s":1.974593,"scheduling_latency_s":1.974614,"redis_calls":13,"redis_duration_s":0.002842,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010299,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015236,"completed_at":"2026-09-06T06:50:35.452Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2697gitlab # [ 282.900559] gitaly[922]: time="2026-09-06T06:50:40.103Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ9QYZZKB3C3RW2MBF62F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:51:09.902" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:40.102" grpc.time_ms=0.595 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2698gitlab # [ 282.930746] gitaly[922]: time="2026-09-06T06:50:40.134Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ9G2RMJX8DSP1K5ES0SG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:49.932" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:40.102" grpc.time_ms=31.338 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2699gitlab # [ 282.953949] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:40 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/93214664af3f47b7fe6cc14cc480b997481ac1ac/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 70702700gitlab # [ 282.997327] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:40.200Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b303f943b721a2ca92a644c6","created_at":"2026-09-06T06:50:40.185Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-bbccb85037974266","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.196Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b303f943b721a2ca92a644c6: start","job_status":"start","queue_duration_s":0.003652,"scheduling_latency_s":0.003714}2701gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/93214664af3f47b7fe6cc14cc480b997481ac1ac/statuses, in 7.25 seconds)2702gitlab # [ 283.155548] gitaly[922]: time="2026-09-06T06:50:40.358Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ9G2RMJX8DSP1K5ES0SG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:40.358" grpc.time_ms=0.645 pid=922 span.kind=server system=grpc2703gitlab # [ 283.226575] gitaly[922]: time="2026-09-06T06:50:40.430Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ9G2RMJX8DSP1K5ES0SG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:40.429" grpc.time_ms=0.644 pid=922 span.kind=server system=grpc2704gitlab # [ 283.280321] gitaly[922]: time="2026-09-06T06:50:40.483Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ9G2RMJX8DSP1K5ES0SG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:40.483" grpc.time_ms=0.297 pid=922 span.kind=server system=grpc2705gitlab # [ 283.306499] gitaly[922]: time="2026-09-06T06:50:40.510Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ9G2RMJX8DSP1K5ES0SG diskcache=1ea07006-8735-4295-b667-f5fc3ff34d0e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:51:10.218" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:40.319" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2706gitlab # [ 283.322562] gitaly[922]: time="2026-09-06T06:50:40.510Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=145 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7279 command.oublock=0 command.real_time_ms=182 command.spawn_token_fork_ms=1 command.system_time_ms=82 command.user_time_ms=63 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ9G2RMJX8DSP1K5ES0SG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:51:10.218" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:40.319" grpc.time_ms=190.76 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2707gitlab # [ 283.325171] gitaly[922]: time="2026-09-06T06:50:40.517Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQEFNPRHMK8T7DZH4S121 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:51:10.014" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:40.516" grpc.time_ms=1.087 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2708gitlab # [ 283.415342] gitaly[922]: time="2026-09-06T06:50:40.618Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1TQQEFNPRHMK8T7DZH4S121 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:50.111" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:40.612" grpc.time_ms=6.459 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2709gitlab # [ 283.452344] gitaly[922]: time="2026-09-06T06:50:40.655Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ9G2RMJX8DSP1K5ES0SG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-06T06:51:10.553" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:40.653" grpc.time_ms=1.955 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2710gitlab # [ 283.480290] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:40 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 27412711gitlab # [ 283.486127] nixbot[2646]: {"ts": "2026-09-06T06:50:40.689Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/93214664af3f47b7fe6cc14cc480b997481ac1ac \"HTTP/1.1 201 Created\""}2712gitlab # [ 283.507436] gitaly[922]: time="2026-09-06T06:50:40.711Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ9G2RMJX8DSP1K5ES0SG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:51:10.609" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:40.710" grpc.time_ms=0.663 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2713gitlab # [ 283.535489] gitaly[922]: time="2026-09-06T06:50:40.739Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQH5SQTEFFXADGJP939VM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:51:10.438" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:40.738" grpc.time_ms=0.574 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2714gitlab # [ 283.544903] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:40.748Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"2013591c1d299eb69ef4cfa6","created_at":"2026-09-06T06:50:40.743Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"b303f943b721a2ca92a644c6","job_size_bytes":3,"pid":2654,"job_status":"deduplicated","message":"PipelineProcessWorker JID-2013591c1d299eb69ef4cfa6: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2715gitlab # [ 283.549605] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:40.753Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b303f943b721a2ca92a644c6","created_at":"2026-09-06T06:50:40.185Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-bbccb85037974266","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.196Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2654,"job_status":"rescheduled","message":"PipelineProcessWorker JID-b303f943b721a2ca92a644c6: rescheduled"}2716gitlab # [ 283.563785] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:40.767Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b303f943b721a2ca92a644c6","created_at":"2026-09-06T06:50:40.185Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-bbccb85037974266","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.196Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b303f943b721a2ca92a644c6: done: 0.567038 sec","job_status":"done","queue_duration_s":0.003652,"scheduling_latency_s":0.003714,"gitaly_calls":3,"gitaly_duration_s":0.241679,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.079103,"redis_read_bytes":239,"redis_write_bytes":21780,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002115,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.003705,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.036163,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14465,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.023607,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000542,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.003206,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.00765,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.055,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.011,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.015,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.03,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.154617,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.489869243,"duration_s":0.567038,"completed_at":"2026-09-06T06:50:40.767Z","load_balancing_strategy":"primary","db_duration_s":0.059691,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2717gitlab # [ 283.643139] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:40.769Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"54eeb61fc1219e286c4b4457","created_at":"2026-09-06T06:50:40.311Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.313Z","job_size_bytes":23,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-54eeb61fc1219e286c4b4457: start","job_status":"start","queue_duration_s":0.45607,"scheduling_latency_s":0.456094}2718gitlab # [ 283.644434] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:40.825Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"54eeb61fc1219e286c4b4457","created_at":"2026-09-06T06:50:40.311Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.313Z","job_size_bytes":23,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-54eeb61fc1219e286c4b4457: done: 0.056115 sec","job_status":"done","queue_duration_s":0.45607,"scheduling_latency_s":0.456094,"redis_calls":7,"redis_duration_s":0.004933,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004191,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000742,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.056115,"completed_at":"2026-09-06T06:50:40.825Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013622,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2719gitlab # [ 283.730098] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:40.830Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"d6a4579e09b266cbbde14756","created_at":"2026-09-06T06:50:40.516Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.523Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-d6a4579e09b266cbbde14756: start","job_status":"start","queue_duration_s":0.306696,"scheduling_latency_s":0.306723}2720gitlab # [ 283.731303] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:40.877Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"d6a4579e09b266cbbde14756","created_at":"2026-09-06T06:50:40.516Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.523Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-d6a4579e09b266cbbde14756: done: 0.047547 sec","job_status":"done","queue_duration_s":0.306696,"scheduling_latency_s":0.306723,"redis_calls":7,"redis_duration_s":0.005184,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003844,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00134,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047547,"completed_at":"2026-09-06T06:50:40.877Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014799,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2721gitlab # [ 283.800542] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:40.881Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"0f4da6f9597ca51486b2dc95","created_at":"2026-09-06T06:50:40.568Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.572Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-0f4da6f9597ca51486b2dc95: start","job_status":"start","queue_duration_s":0.308879,"scheduling_latency_s":0.308906}2722gitlab # [ 283.873326] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:40.931Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"0f4da6f9597ca51486b2dc95","created_at":"2026-09-06T06:50:40.568Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.572Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-0f4da6f9597ca51486b2dc95: done: 0.049513 sec","job_status":"done","queue_duration_s":0.308879,"scheduling_latency_s":0.308906,"redis_calls":7,"redis_duration_s":0.006918,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00522,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001698,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.049513,"completed_at":"2026-09-06T06:50:40.931Z","load_balancing_strategy":"primary","db_duration_s":0.011906,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2723gitlab # [ 283.888311] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:40.937Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"69938a414510e106f7affcff","created_at":"2026-09-06T06:50:40.585Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.592Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-69938a414510e106f7affcff: start","job_status":"start","queue_duration_s":0.344676,"scheduling_latency_s":0.344705}2724gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/93214664af3f47b7fe6cc14cc480b997481ac1ac/statuses2725gitlab # [ 283.964364] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:40.985Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"69938a414510e106f7affcff","created_at":"2026-09-06T06:50:40.585Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.592Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-69938a414510e106f7affcff: done: 0.048603 sec","job_status":"done","queue_duration_s":0.344676,"scheduling_latency_s":0.344705,"redis_calls":10,"redis_duration_s":0.009564,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005089,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002842,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001633,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048603,"completed_at":"2026-09-06T06:50:40.985Z","load_balancing_strategy":"primary","db_duration_s":0.00856,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2726gitlab # [ 284.038367] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:40.990Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"1932da68bf9d8f29888f78ee","created_at":"2026-09-06T06:50:40.594Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.597Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-1932da68bf9d8f29888f78ee: start","job_status":"start","queue_duration_s":0.393361,"scheduling_latency_s":0.393387}2727gitlab # [ 284.039647] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:41.045Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"1932da68bf9d8f29888f78ee","created_at":"2026-09-06T06:50:40.594Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.597Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-1932da68bf9d8f29888f78ee: done: 0.054815 sec","job_status":"done","queue_duration_s":0.393361,"scheduling_latency_s":0.393387,"redis_calls":7,"redis_duration_s":0.0062629999999999995,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004552,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001711,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.054815,"completed_at":"2026-09-06T06:50:41.045Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015688,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2728gitlab # [ 284.126334] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:41.049Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"947dac9dc87b81d197f243b2","created_at":"2026-09-06T06:50:40.598Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.606Z","job_size_bytes":19,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-947dac9dc87b81d197f243b2: start","job_status":"start","queue_duration_s":0.442631,"scheduling_latency_s":0.442657}2729gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/93214664af3f47b7fe6cc14cc480b997481ac1ac/statuses, in 0.19 seconds)2730gitlab # [ 284.128269] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:41.098Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"947dac9dc87b81d197f243b2","created_at":"2026-09-06T06:50:40.598Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.606Z","job_size_bytes":19,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-947dac9dc87b81d197f243b2: done: 0.049129 sec","job_status":"done","queue_duration_s":0.442631,"scheduling_latency_s":0.442657,"redis_calls":8,"redis_duration_s":0.011387999999999999,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008416,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002972,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.049129,"completed_at":"2026-09-06T06:50:41.098Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004628,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2731gitlab # [ 284.221472] gitaly[922]: time="2026-09-06T06:50:41.299Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1TQQH5SQTEFFXADGJP939VM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:51.263" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:41.293" grpc.time_ms=5.94 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2732gitlab # [ 284.222386] nixbot[2646]: {"ts": "2026-09-06T06:50:41.342Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/93214664af3f47b7fe6cc14cc480b997481ac1ac \"HTTP/1.1 201 Created\""}2733gitlab # [ 284.223256] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:41.102Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"50bec01b1fee97ef8cb9e973","created_at":"2026-09-06T06:50:40.608Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.615Z","job_size_bytes":66,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-50bec01b1fee97ef8cb9e973: start","job_status":"start","queue_duration_s":0.487532,"scheduling_latency_s":0.487561}2734gitlab # [ 284.224098] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:41.145Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"50bec01b1fee97ef8cb9e973","created_at":"2026-09-06T06:50:40.608Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.615Z","job_size_bytes":66,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-50bec01b1fee97ef8cb9e973: done: 0.042575 sec","job_status":"done","queue_duration_s":0.487532,"scheduling_latency_s":0.487561,"redis_calls":7,"redis_duration_s":0.006196999999999999,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003813,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002384,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015463,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042575,"completed_at":"2026-09-06T06:50:41.145Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006693,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2735gitlab # [ 284.300875] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:41 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 6442736gitlab # [ 284.302088] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:41 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/93214664af3f47b7fe6cc14cc480b997481ac1ac/statuses HTTP/1.1" 200 1313 "" "curl/8.21.0" 612737gitlab # [ 284.302908] gitaly[922]: time="2026-09-06T06:50:41.397Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQHTG0WPP0Y4PP9HT6BPH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:51:11.396" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:41.396" grpc.time_ms=0.621 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2738gitlab # [ 284.312922] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:41.149Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"18ff7ab997e6dd3dbbb2169b","created_at":"2026-09-06T06:50:40.618Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.624Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-18ff7ab997e6dd3dbbb2169b: start","job_status":"start","queue_duration_s":0.52453,"scheduling_latency_s":0.524556}2739gitlab # [ 284.381216] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:41.207Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"18ff7ab997e6dd3dbbb2169b","created_at":"2026-09-06T06:50:40.618Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.624Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-18ff7ab997e6dd3dbbb2169b: done: 0.058252 sec","job_status":"done","queue_duration_s":0.52453,"scheduling_latency_s":0.524556,"redis_calls":7,"redis_duration_s":0.006914,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005219,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001695,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.058252,"completed_at":"2026-09-06T06:50:41.207Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01566,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2740gitlab # [ 284.455188] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:41.212Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"976708839a01df9bb2874dc7","created_at":"2026-09-06T06:50:40.631Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.633Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-976708839a01df9bb2874dc7: start","job_status":"start","queue_duration_s":0.578758,"scheduling_latency_s":0.578784}2741gitlab # [ 284.456641] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:41.273Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"976708839a01df9bb2874dc7","created_at":"2026-09-06T06:50:40.631Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.633Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-976708839a01df9bb2874dc7: done: 0.061466 sec","job_status":"done","queue_duration_s":0.578758,"scheduling_latency_s":0.578784,"redis_calls":7,"redis_duration_s":0.009228,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004782,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004446,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.061466,"completed_at":"2026-09-06T06:50:41.273Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011391,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2742gitlab # [ 284.538211] gitaly[922]: time="2026-09-06T06:50:41.562Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ9G2RMJX8DSP1K5ES0SG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-06T06:51:11.461" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:41.561" grpc.time_ms=1.035 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2743gitlab # [ 284.540416] nixbot[2646]: {"ts": "2026-09-06T06:50:41.729Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/93214664af3f47b7fe6cc14cc480b997481ac1ac \"HTTP/1.1 201 Created\""}2744gitlab # [ 284.541412] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:41.277Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"26a630575fbc1c4e91bc1958","created_at":"2026-09-06T06:50:40.634Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.636Z","job_size_bytes":6,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-26a630575fbc1c4e91bc1958: start","job_status":"start","queue_duration_s":0.640698,"scheduling_latency_s":0.640723}2745gitlab # [ 284.545626] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:41.306Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"26a630575fbc1c4e91bc1958","created_at":"2026-09-06T06:50:40.634Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.636Z","job_size_bytes":6,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-26a630575fbc1c4e91bc1958: done: 0.029352 sec","job_status":"done","queue_duration_s":0.640698,"scheduling_latency_s":0.640723,"redis_calls":7,"redis_duration_s":0.007085999999999999,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005886,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0012,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029352,"completed_at":"2026-09-06T06:50:41.306Z","load_balancing_strategy":"primary","db_duration_s":0.002569,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2746gitlab # [ 284.651370] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:41 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/93214664af3f47b7fe6cc14cc480b997481ac1ac HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1162747gitlab # [ 284.652778] gitaly[922]: time="2026-09-06T06:50:41.608Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ9G2RMJX8DSP1K5ES0SG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:51:11.506" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:41.607" grpc.time_ms=0.657 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2748gitlab # [ 284.654044] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:41.321Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"629b0c584093d527d18814dd","created_at":"2026-09-06T06:50:40.637Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.640Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-629b0c584093d527d18814dd: start","job_status":"start","queue_duration_s":0.681874,"scheduling_latency_s":0.681906}2749gitlab # [ 284.657948] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:41.399Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"629b0c584093d527d18814dd","created_at":"2026-09-06T06:50:40.637Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.640Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-629b0c584093d527d18814dd: done: 0.078038 sec","job_status":"done","queue_duration_s":0.681874,"scheduling_latency_s":0.681906,"redis_calls":7,"redis_duration_s":0.01928,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007987,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.011293,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.078038,"completed_at":"2026-09-06T06:50:41.399Z","load_balancing_strategy":"primary","db_duration_s":0.028035,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2750gitlab # [ 284.741061] gitaly[922]: time="2026-09-06T06:50:41.654Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQJ2BT21QGZ6077PJ2GZQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-06T06:51:11.353" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-06T06:50:41.653" grpc.time_ms=0.846 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2751gitlab # [ 284.742862] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:41.404Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"2099f8fde78e5012ce5da926","created_at":"2026-09-06T06:50:40.754Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.757Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2099f8fde78e5012ce5da926: start","job_status":"start","queue_duration_s":0.647049,"scheduling_latency_s":0.64708}2752gitlab # [ 284.830852] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:41.646Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"2099f8fde78e5012ce5da926","created_at":"2026-09-06T06:50:40.754Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.757Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2654,"job_status":"rescheduled","message":"PipelineProcessWorker JID-2099f8fde78e5012ce5da926: rescheduled"}2753gitlab # [ 284.832288] gitaly[922]: time="2026-09-06T06:50:41.690Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQQJ2BT21QGZ6077PJ2GZQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-06T06:50:51.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:41.683" grpc.time_ms=6.296 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2754gitlab # [ 284.833756] gitaly[922]: time="2026-09-06T06:50:41.923Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ9G2RMJX8DSP1K5ES0SG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:41.923" grpc.time_ms=0.281 pid=922 span.kind=server system=grpc2755gitlab # [ 284.834901] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:41.681Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"2099f8fde78e5012ce5da926","created_at":"2026-09-06T06:50:40.754Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-d75fb1fb036c4b8c","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:40.757Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2099f8fde78e5012ce5da926: done: 0.277632 sec","job_status":"done","queue_duration_s":0.647049,"scheduling_latency_s":0.64708,"gitaly_calls":2,"gitaly_duration_s":0.009064,"redis_calls":37,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.08116,"redis_read_bytes":83,"redis_write_bytes":6416,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.005201,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.004934,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":4,"redis_queues_duration_s":0.002679,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2220,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.057432,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":979,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00126,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.002451,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002002,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":29,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.068,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":14,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.006,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.012,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.041,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.085561,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.126554352,"duration_s":0.277632,"completed_at":"2026-09-06T06:50:41.681Z","load_balancing_strategy":"primary","db_duration_s":0.076789,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2756gitlab # [ 284.917908] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:41.688Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"30f040a76b511b915f4df5a8","created_at":"2026-09-06T06:50:41.541Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-b54e329aa7ef4f8d","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:41.544Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-30f040a76b511b915f4df5a8: start","job_status":"start","queue_duration_s":0.143966,"scheduling_latency_s":0.143992}2757gitlab # [ 284.934338] gitaly[922]: time="2026-09-06T06:50:41.948Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ9G2RMJX8DSP1K5ES0SG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:41.947" grpc.time_ms=0.277 pid=922 span.kind=server system=grpc2758gitlab # [ 285.003073] gitaly[922]: time="2026-09-06T06:50:41.979Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1TQQ9G2RMJX8DSP1K5ES0SG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-06T06:50:41.978" grpc.time_ms=0.644 pid=922 span.kind=server system=grpc2759gitlab # [ 285.004172] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:42 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 442760gitlab # [ 285.004911] gitlab-workhorse[828]: time="2026-09-06T06:50:42Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672761gitlab # [ 285.006100] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:42 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 492762gitlab # [ 285.006950] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:41.761Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"30f040a76b511b915f4df5a8","created_at":"2026-09-06T06:50:41.541Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-b54e329aa7ef4f8d","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:41.544Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-30f040a76b511b915f4df5a8: done: 0.073426 sec","job_status":"done","queue_duration_s":0.143966,"scheduling_latency_s":0.143992,"redis_calls":7,"redis_duration_s":0.010745000000000001,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008703,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002042,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.073426,"completed_at":"2026-09-06T06:50:41.761Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021436,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2763gitlab # [ 285.040257] sidekiq-cluster[2654]: {"severity":"INFO","time":"2026-09-06T06:50:41.766Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"a20db49fecf27b67c0320464","created_at":"2026-09-06T06:50:41.649Z","trace_propagation_headers":{"sentry-trace":"07de5fecda324c598c97ad6b8a010e3a-b54e329aa7ef4f8d","baggage":"sentry-trace_id=07de5fecda324c598c97ad6b8a010e3a,sentry-release=Unknown"},"correlation_id":"01M1TQQ9G2RMJX8DSP1K5ES0SG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-06T06:50:41.654Z","job_size_bytes":3,"pid":2654,"sidekiq_tid":"m81i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a20db49fecf27b67c0320464: start","job_status":"start","queue_duration_s":0.111573,"scheduling_latency_s":0.1116}2764gitlab # [ 285.113055] gitaly[922]: time="2026-09-06T06:50:41.987Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ9G2RMJX8DSP1K5ES0SG diskcache=254c06f4-0d9d-46d9-971b-b0014b75879d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:51:11.797" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:41.897" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2765gitlab # [ 285.114164] gitaly[922]: time="2026-09-06T06:50:41.987Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=77 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7194 command.oublock=0 command.real_time_ms=84 command.spawn_token_fork_ms=0 command.system_time_ms=52 command.user_time_ms=25 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQ9G2RMJX8DSP1K5ES0SG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-06T06:51:11.797" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-06T06:50:41.897" grpc.time_ms=90.186 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2766gitlab # [ 285.115326] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:42 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 482767gitlab # [ 285.116139] gitlab-workhorse[828]: time="2026-09-06T06:50:42Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672768gitlab # [ 285.116940] gitlab-workhorse[828]: gitlab 2001:db8:1::1 - - [2026/09/06:06:50:42 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 522769gitlab # [ 285.118189] gitaly[922]: time="2026-09-06T06:50:42.137Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1TQQJHD1NHRWSQH8R4ECHQQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:42.129" grpc.time_ms=7.3 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2770gitlab # [ 285.130230] gitaly[922]: time="2026-09-06T06:50:42.188Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQJJVSZGBX8R8MM2XAQ5M grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:42.181" pid=922 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2771gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/93214664af3f47b7fe6cc14cc480b997481ac1ac/statuses2772gitlab # [ 285.210074] gitaly[922]: time="2026-09-06T06:50:42.188Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQJJVSZGBX8R8MM2XAQ5M grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:42.181" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2773gitlab # [ 285.211319] gitaly[922]: time="2026-09-06T06:50:42.189Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQJJVSZGBX8R8MM2XAQ5M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:42.181" grpc.time_ms=7.069 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2774gitlab # [ 285.212188] gitaly[922]: time="2026-09-06T06:50:42.260Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1TQQJN4RBFXYV8GD871H12F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:42.252" grpc.time_ms=7.465 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2775gitlab # [ 285.212943] gitaly[922]: time="2026-09-06T06:50:42.313Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQJPPVCV6ZC8WF6HAF99F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:42.306" pid=922 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc2776gitlab # [ 285.226580] gitaly[922]: time="2026-09-06T06:50:42.313Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQJPPVCV6ZC8WF6HAF99F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:42.306" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2777gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/93214664af3f47b7fe6cc14cc480b997481ac1ac/statuses, in 0.10 seconds)2778(finished: subtest: eval and build post commit statuses, in 14.21 seconds)2779(finished: run the VM test script, in 326.28 seconds)2780gitlab # [ 285.247166] gitaly[922]: time="2026-09-06T06:50:42.313Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1TQQJPPVCV6ZC8WF6HAF99F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-06T06:50:42.306" grpc.time_ms=7.154 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2781test script finished in 326.30s2782cleanup2783kill QemuMachine (pid 46)2784gitlab # [ 285.318232] gitaly[922]: time="2026-09-06T06:50:42.507Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_coqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2785gitlab # u2786(finished: cleanup, in 1.32 seconds)2787additionally exposed symbols:2788 gitlab,2789 vlan1,2790 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2791[]2792[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-06T06:49:23.642Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2793[]2794[]2795[]2796[]2797[]2798[]2799[]2800[]2801[]2802[]2803[]2804[]2805[]2806[]2807[]2808[]2809[]2810[]2811[]2812[]2813[]2814[]2815[]2816[]2817[]2818[]2819[]2820[]2821[]2822[]2823[]2824[]2825[]2826[]2827[]2828[]2829[]2830[]2831[]2832[]2833[]2834[]2835[]2836[]2837[]2838[]2839[]2840[]2841[]2842[]2843[]2844[]2845[]2846[]2847[]2848[]2849[]2850[]2851[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '93214664af3f47b7fe6cc14cc480b997481ac1ac', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-06T06:50:25.343451Z', 'started_at': '2026-09-06T06:50:25.874896Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2852[{'id': 5, 'sha': '93214664af3f47b7fe6cc14cc480b997481ac1ac', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T06:50:25.845Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2853[{'id': 5, 'sha': '93214664af3f47b7fe6cc14cc480b997481ac1ac', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T06:50:25.845Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2854[{'id': 5, 'sha': '93214664af3f47b7fe6cc14cc480b997481ac1ac', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T06:50:25.845Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2855[{'id': 5, 'sha': '93214664af3f47b7fe6cc14cc480b997481ac1ac', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T06:50:25.845Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2856[{'id': 5, 'sha': '93214664af3f47b7fe6cc14cc480b997481ac1ac', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-06T06:50:25.845Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2857[{'id': 6, 'sha': '93214664af3f47b7fe6cc14cc480b997481ac1ac', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 6s (1 warning)', 'created_at': '2026-09-06T06:50:40.663Z', 'started_at': None, 'finished_at': '2026-09-06T06:50:40.661Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 7, 'sha': '93214664af3f47b7fe6cc14cc480b997481ac1ac', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-09-06T06:50:41.316Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2858[{'id': 6, 'sha': '93214664af3f47b7fe6cc14cc480b997481ac1ac', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 6s (1 warning)', 'created_at': '2026-09-06T06:50:40.663Z', 'started_at': None, 'finished_at': '2026-09-06T06:50:40.661Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 7, 'sha': '93214664af3f47b7fe6cc14cc480b997481ac1ac', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-09-06T06:50:41.316Z', 'started_at': None, 'finished_at': '2026-09-06T06:50:41.705Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]